FPGA implementation of procedures for video quality assessment

• Autorzy: Wielgosz M. , Karwatowski M. , Pietron M. , Wiatr K.

Identyfikatory

DOI

10.7494/csci.2018.19.3.2825

• Języki publikacji: EN

Abstrakty

EN

The video resolutions used in a variety of media are constantly rising. While manufacturers struggle to perfect their screens, it is also important to ensure the high quality of the displayed image. Overall quality can be measured using a Mean Opinion Score (MOS). Video quality can be affected by miscellaneous artifacts appearing at every stage of video creation and transmission. In this paper, we present a solution to calculate four distinct video quality metrics that can be applied to a real-time video quality assessment system. Our assessment module is capable of processing 8K resolution in real time set at a level of 30 frames per second. The throughput of 2.19 GB/s surpasses the performance of pure software solutions. The module was created using a high-level language to concentrate on architectural optimization.

Słowa kluczowe

EN

video quality; video metrics; image processing; FPGA; Impulse C

• Wydawca: Wydawnictwa AGH
• Czasopismo: Computer Science
• Rocznik: 2018
• Tom: Vol. 19 (3)
• Strony: 279--305
• Opis fizyczny: Bibliogr. 51 poz., rys., tab.

Twórcy

autor

Wielgosz M.

• AGH University of Science and Technology, Academic Computer Center CYFRONET, Krakow, Poland

autor

Karwatowski M.

• AGH University of Science and Technology, Academic Computer Center CYFRONET, Krakow, Poland

autor

Pietron M.

• AGH University of Science and Technology, Academic Computer Center CYFRONET, Krakow, Poland

autor

Wiatr K.

• AGH University of Science and Technology, Academic Computer Center CYFRONET, Krakow, Poland

Bibliografia

• [1] CENELEC EN 50132, Alarm systems. CCTV surveillance systems for use in security applications, 2011.
• [2] Pico computing M503 manual, 2013. http://picocomputing.com/products/ hpc-modules/m-503/. Accessed: 23.06.2016.
• [3] Bodenner R.: Creating Platform Support Packages, 2011. http: //www.impulseaccelerated.com/AppNotes/APP109_PSP/IATAPP109_PSP.pdf. Accessed: 11.06.2018.
• [4] Cerqueira E., Janowski L., Leszczuk M., Papir Z., Romaniak P.: Video Artifacts Assessment for Live Mobile Streaming Applications. In: Mauthe A., Zeadally S., Cerqueira E., Curado M. (eds.), Future Multimedia Networking, Lecture Notes in Computer Science, vol. 5630, pp. 242–247. Springer Berlin Heidelberg, 2009. http://dx.doi.org/10.1007/978-3-642-02472-6_26.
• [5] Farias M.C., Mitra S.K.: No-reference video quality metric based on artifact measurements. In: IEEE International Conference on Image Processing 2005, vol. 3, pp. III–141, 2005. http://dx.doi.org/10.1109/ICIP.2005.1530348.
• [6] Farias M.C.Q., Heynderickx I., Macchiavello Espinoza B.L., Redi J.A.: Visual Artifacts Interference Understanding and Modeling (VARIUM). In: Seventh International Workshop on Video Processing and Quality Metrics for Consumer Electronics, vol. 1. Scottsdale, 2013.
• [7] Farias M.C.Q., Mitra S.K.: Perceptual contributions of blocky, blurry, noisy, and ringing synthetic artifacts to overall annoyance, Journal of Electronic Imaging, vol. 21(4), pp. 043013–043013, 2012. http://dx.doi.org/10.1117/1.JEI.21.4.043013.
• [8] Gancarczyk G., Wielgosz M., Wiatr K.: An introduction to offloading CPUs to FPGAs – Hardware programming for software developers, 2013. http://www.eetimes.com/document.asp?doc_id=1280560. Accessed: 11.06.2018.
• [9] Gustafsson J., Heikkila G., Pettersson M.: Measuring multimedia quality in mobile networks with an objective parametric model. In: 15th IEEE International Conference on Image Processing, ICIP 2008, pp. 405–408, 2008. http://dx.doi.org/10.1109/ICIP.2008.4711777.
• [10] International Telecommunication Union: ITU-T P.800, Methods for subjective determination of transmission quality, 1996. http://www.itu.int/rec/ T-REC-P.800-199608-I.
• [11] ITU: ITU-T P.830, Subjective performance assessment of telephone-band and wideband digital codecs, 1996. http://www.itu.int/rec/T-REC-P. 830-199602-I/en.
• [12] ITU: ITU-T P.930, Principles of a reference impairment system for video, 1996. http://www.itu.int/rec/T-REC-P.930-199608-I.
• [13] ITU: ITU-T P.910, Subjective video quality assessment methods for multimedia applications, 1999. http://www.itu.int/rec/T-REC-P.910-200804-I.
• [14] ITU: ITU-T J.144, Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference, 2004. http://www.itu.int/rec/T-REC-J.144-200403-I.
• [15] ITU: ITU-R BT.1702, Guidance for the reduction of photosensitive epileptic seizures caused by television, 2005. http://www.itu.int/rec/R-REC-BT.1702.
• [16] ITU: ITU-T G.100/P.10, Vocabulary for performance and quality of service, 2006. http://www.itu.int/rec/T-REC-P.10-200607-I.
• [17] ITU: ITU-T J.246, Perceptual visual quality measurement techniques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference, 2008. http://www.itu.int/rec/T-REC-J.246-200808-I.
• [18] ITU: ITU-T J.247, Objective perceptual multimedia video quality measurement in the presence of a full reference, 2008. http://www.itu.int/rec/T-REC-J.247-200808-I.
• [19] ITU: ITU-T P.912, Subjective video quality assessment methods for recognition tasks, 2008. http://www.itu.int/rec/T-REC-P.912-200808-I.
• [20] ITU: ITU-R BT.500-12, Methodology for the subjective assessment of the quality of television pictures, 2009. http://www.itu.int/rec/R-REC-BT. 500-12-200909-I.
• [21] ITU: ITU-T J.249, Perceptual video quality measurement techniques for digital cable television in the presence of a reduced reference, 2010. http://www.itu.int/rec/T-REC-J.249-201001-I.
• [22] ITU: ITU-T J.341, Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference, 2011. http://www.itu.int/rec/T-REC-J.341-201101-I.
• [23] ITU: ITU-T J.342, Objective multimedia video quality measurement of HDTV for digital cable television in the presence of a reduced reference signal, 2011. http://www.itu.int/rec/T-REC-J.342-201104-I.
• [24] ITU: ITU-T H.264, Advanced video coding for generic audiovisual services, 2012. http://www.itu.int/rec/T-REC-H.264-201201-P/en.
• [25] Jamro E., Wielgosz M., Wiatr K.: FPGA Implementation of Strongly Parallel Histogram Equalization. In: Girard P., Krasniewski A., Gramatová E., Pawlak A., Garbolino T. (eds.), DDECS, pp. 93–98. IEEE Computer Society, 2007. http://dx.doi.org/10.1109/DDECS.2007.4295260.
• [26] Karunasekera S.A., Kingsbury N.G.: A distortion measure for blocking artifacts in images based on human visual sensitivity, IEEE Transactions on Image Processing, vol. 4(6), pp. 713–724, 1995.
• [27] Karwatowski M., Russek P., Wielgosz M., Koryciak S., Wiatr K.: Energy Efficient Calculations of Text Similarity Measure on FPGA-Accelerated Computing Platforms. In: Wyrzykowski R., Deelman E., Dongarra J., Karczewski K., Kitowski J., Wiatr K. (eds.), PPAM (1), Lecture Notes in Computer Science, vol. 9573, pp. 31–40, Springer, 2015. https://doi.org/10.1007/978-3-319-32149-3_4.
• [28] van Kester S., Xiao T., Kooij R.E., Brunnström K., Ahmed O.K.: Estimating the impact of single and multiple freezes on video quality. In: Proceedings SPIE, Human Vision and Electronic Imaging XVI, vol. 7865, pp. 78650O–78650O–10. 2011. http://dx.doi.org/10.1117/12.873390.
• [29] Le Callet P., Viard-Gaudin C., Péchard S., Caillault É.: No reference and reduced reference video quality metrics for end to end QoS monitoring, IEICE transactions on communications, vol. 89(2), pp. 289–296, 2006.
• [30] Leszczuk M., Hanusiak M., Blanco I., Dziech A., Derkacz J.,Wyckens E., Borer S.: Key indicators for monitoring of audiovisual quality. In: Cetin E.A., Salerno E. (eds.), MUSCLE International Workshop on Computational Intelligence for Multimedia Understanding, p. 6. ERCIM, IEEE Xplore, Antalya, Turkey, 2013.
• [31] Lu L., Wang Z., Bovik A.C., Kouloheris J.: Full-reference video quality assessment considering structural distortion and no-reference quality evaluation of MPEG video. In: Proceedings of IEEE International Conference on Multimedia and Expo, ICME’02, vol. 1, pp. 61–64, 2002. http://dx.doi.org/10.1109/ ICME.2002.1035718.
• [32] Moore G.W.: Flatterland. Like Flatland. Only More So.: I. Stewart; Perseusblishing Cambridge, MA, 2001, pp 301, Neurocomputing, vol. 42(1-4), pp. 337–338, 2002. http://dx.doi.org/10.1016/S0925-2312(01)00637-3.
• [33] MSU Video Quality Measurement tools. http://www.compression.ru/video/quality_measure/. Accessed: 11.06.2018.
• [34] Mu M., Romaniak P., Mauthe A., Leszczuk M., Janowski L., Cerqueira E.: Framework for the integrated video quality assessment. In: Multimedia Tools and Applications, vol. 61(3), pp. 787–817, 2012. http://dx.doi.org/10.1007/s11042-011-0946-3.
• [35] Neborovski E., Marinkovic V., Katona M.: Video quality assessment approach with field programmable gate arrays. In: The 33rd International Convention MIPRO, pp. 713–717, 2010.
• [36] de Oliveira M., da Silva W., Fonseca K.V.O., Pohl A.D.A.P.: VHDL implementation of a No-Reference video quality metric using the Levenberg-Marquardt method. In: International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–5, 2014. http://dx.doi.org/10.1109/BMSB.2014.6873474.
• [37] Papu J.J., See O.H.: Design of a reconfigurable computing platform. In: Proceedings of Innovative Technologies in Intelligent Systems and Industrial Applications, pp. 148–153, 2009.
• [38] Pellerin D., Thibault S.: Practical FPGA programming in C, Prentice Hall Professional Technical Reference, Upper Saddle River, NJ, 2005.
• [39] Punchihewa A., Bailey D.G.: Artefacts in image and video systems: classification and mitigation. In: Proceedings of Image and Vision Computing New Zealand 2002, pp. 197–202, 2002.
• [40] Rohaly A.M., Corriveau P., Libert J., Webster A., Baroncini V., Beerends J., Blin J.L.: Video Quality Experts Group: Current Results and Future Directions, 2000.
• [41] Romaniak P.: Assessment of perceptual video quality affected by acquisition and bit-rate reduction artifacts, Ph.D. thesis, 2011.
• [42] Romaniak P., Janowski L., Leszczuk M., Papir Z.: A no reference metric for the quality assessment of videos affected by exposure distortion. In: IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6, 2011. http://dx.doi.org/10.1109/ICME.2011.6011903.
• [43] Romaniak P., Janowski L., Leszczuk M., Papir Z.: Perceptual quality assessment for H.264/AVC compression. In: Consumer Communications and Networking Conference (CCNC), pp. 597–602, 2012. http://dx.doi.org/10.1109/CCNC.2012.6181021.
• [44] Takahashi A., Schmidmer C., Lee C., Speranza F., Okamoto J., Brunnström K., Janowski L., Barkowsky M., Pinson M., Staelens Nicolas Huynh Thu Q., Green R., Bitto R., Renaud R., Borer S., Kawano T., Baroncini V., Dhondt Y.: Report on the Validation of Video Quality Models for High Definition Video Content, Tech. rep., Video Quality Experts Group, 2010.
• [45] Takahashi A., Yamagishi K., Kawaguti G.: Global Standardization Activities Recent Activities of QoS/QoE Standardization in ITU-T SG12, Ntt Technical Review, vol. 6(9), pp. 1–5, 2008.
• [46] Torres Vega M., Sguazzo V., Mocanu D.C., Liotta A.: An experimental survey of no-reference video quality assessment methods, International Journal of Pervasive Computing and Communications, vol. 12(1), pp. 66–86, 2016. http://dx.doi.org/10.1108/IJPCC-01-2016-0008.
• [47] Video Multi-Method Assessment Fusion. https://github.com/Netflix/vmaf. Accessed: 11.06.2018.
• [48] Wielgosz M., Panggabean M., Chilwan A., Rønningen L.A.: FPGA-Based Platform for Real-Time Internet. In: Stoica A., Zarzhitsky D., Howells G., Frowd C.D., McDonald-Maier K.D., Erdogan A.T., Arslan T. (eds.), Proceedings of Third International Conference on Emerging Security Technologies, Lisbon, 2012, IEEE Computer Society, pp. 131–134, 2012. http://dx.doi.org/10.1109/EST.2012.18.
• [49] Wielgosz M., Panggabean M., Rønningen L.A.: FPGA Architecture for Kriging Image Interpolation, International Journal of Advanced Computer Science and Applications(IJACSA), vol. 4(12), 2013. http://ijacsa.thesai.org/.
• [50] Wielgosz M., Panggabean M., Wang J., Rønningen L.A.: An FPGA-Based Platform for a Network Architecture with Delay Guarantee, Journal of Circuits, Systems, and Computers, vol. 22(6), 2013. http://dx.doi.org/10.1142/S021812661350045X.
• [51] Wyckens E.: Proposal studies on new video metrics. In: Webster A. (ed.), VQEG Hillsboro Meeting, p. 17. Orange Labs, Video Quality Experts Group (VQEG), Hillsboro, 2011.

Uwagi

PL

Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2018).