User experience evaluation study on the quality of 1K, 2K, and 4K H.265/HEVC video content

• Autorzy: Falkowski-Gilski Przemyslaw , Uhl Tadeus , Hoppe Christian

Identyfikatory

DOI

10.17402/595

• Języki publikacji: EN

Abstrakty

EN

Nowadays, most content creators focus on distributing rich media at the highest possible resolution. Currently, the majority of sold consoles, media players, computer hardware, as well as displays and TVs are advertised as 4K-compatible. The same trend is observed in the case of popular online streaming services and terrestrial TV broadcasts. Generally speaking, it is assumed that higher bitrates provide higher subjective judgements. In this paper, we present the results of a user experience (UX) evaluation study on the quality of video content coded and transmitted in different resolutions in the internet protocol (IP) environment. The image resolutions include 1K (1920×1080 pixels; full-HD), 2K (2560×1440 pixels; wide-QHD), and 4K (3840×2160 pixels; ultra-HD) content that are processed in the H.265/HEVC (high-efficiency video coding) format. A subjective evaluation is carried out in a laboratory consisting of 20 iMacs with a 21.5-inch 4K Retina (4096×2304 pixels) display. The group of viewers included 28 individuals aged between 21‒35 years old, comprising people with and without visual impairments. The obtained UX results are compared with previous experiments, including both objective quality of service (QoS) and subjective quality of experience (QoE), as well as the impact of downscaling to 1K from 2K and 4K. The outcomes of this study may be of particular interest to any party interested in video content processing and distribution, as well as consumption and storage.

Słowa kluczowe

EN

H.265/HEVC; High-Efficiency Video Coding; QoS; Quality of Service; QoE; Quality of Experience; UX; User Experience; ITU-T Rec. BT.500-14; video content

• Wydawca: Wydawnictwo Naukowe Politechniki Morskiej w Szczecinie
• Czasopismo: Zeszyty Naukowe Politechniki Morskiej w Szczecinie
• Rocznik: 2024
• Tom: nr 77 (149)
• Strony: 38--46

Twórcy

autor

Falkowski-Gilski Przemyslaw

• Gdansk University of Technology, Faculty of Electronics, Telecommunications and Informatics Poland

• https://orcid.org/0000-0001-8920-6969

autor

Uhl Tadeus

• Flensburg University of Applied Sciences, Germany

• https://orcid.org/0000-0001-6849-9168

autor

Hoppe Christian

• Viakom GmbH, Germany

Bibliografia

• 1. Baraković Husić, J., Baraković, S., Cero, E., Slamnik, N., Oćuz, M., Dedović, A. & Zupčić, O. (2020) Quality of experience for unified communications: A survey. International Journal of Network Management 30 (3), e2083, doi: 10.1002/nem.2083.
• 2. Biernacki, A. (2018) Traffic prediction methods for quality improvement of adaptive video. Multimedia Systems 24, pp. 531–547, doi: 10.1007/s00530-017-0574-5.
• 3. Biernacki, A. (2019) Identification of adaptive video streams based on traffic correlation. Multimedia Tools and Applications 78, pp. 18271–18291, doi: 10.1007/s11042- 019-7183-6.
• 4. Cisco (2019) Cisco visual networking index: Forecast and trends, 2017–2022. White paper.
• 5. Falkowski-Gilski, P. & Uhl, T. (2020) Current trends in consumption of multimedia content using online streaming platforms: a user-centric survey. Computer Science Review 37, 100268, doi: 10.1016/j.cosrev.2020.100268.
• 6. FFmpeg (2024) https://ffmpeg.org. [Accessed: January 20, 2024].
• 7. Hammer, F., Egger-Lampl, S. & Möller, S. (2018) Quality-of-user-experience: A position paper. Quality and User Experience 3, 9, doi: 10.1007/s41233-018-0022-0.
• 8. Hoppe, C. & Uhl, T. (2020) A comparison study of DASH technique by video streaming over IP under use the RTP and HTTP protocols. Journal of Telecommunications and Information Technology 67 (1), pp. 70–75, doi: 10.26636/ jtit.2020.137819.
• 9. ITU-T (2002) Rec. J.147: Objective picture quality measurement method by use of in-service test signals.
• 10. ITU-T (2004) Rec. J.144: Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference.
• 11. ITU-T (2008) Rec. J.247: Objective perceptual multimedia video quality measurement in the presence of a full reference.
• 12. ITU-T (2016) Rec. J.341: Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference.
• 13. ITU-T (2017) Rec. P.10: Vocabulary for performance, quality of service and quality of experience.
• 14. ITU-T (2019) Rec. BT.500-14: Methodologies for the subjective assessment of the quality of television images.
• 15. ITU-T (2020) Rec. P.1204.4: Video quality assessment of streaming services over reliable transport for resolutions up to 4K with access to full and reduced reference pixel in-formation.
• 16. Jacob, I.J., Shanmugam, S.K., Piramuthu, S. & Falkowski-Gilski, P. (2021) Data intelligence and cognitive informatics. In Proceedings of ICDICI 2020, Springer, Cham.
• 17. Klink, J. & Uhl, T. (2020) Video quality assessment: some remarks on the selected objective metrics. In Proceedings of the 28th International Conference on Software, Telecommunications and Computer Networks (SoftCOM’20), Split, Croatia, pp. 1‒5.
• 18. Klink, J., Pasławski, M., Pawłowski, P. & Uhl, T. (2019) Video quality assessment in the DASH Technique. In Proceedings of the 27th International Conference on Software, Telecommunications and Computer Networks (SoftCOM’19), Split, Croatia, pp. 1–5.
• 19. COM’19), Split, Croatia, pp. 1–5. 19. Law, E.L.C., Roto, V., Hassenzahl, M., Vermeeren, A.P.O.S. & Kort, J. (2009) Understanding, scoping and defining user experience: A survey approach. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, USA, pp. 719–728.
• 20. Mercat, A., Viitanen, M. & Vanne, J. (2020) UVG dataset: 50/120fps 4K sequences for video codec analysis and development. In Proceedings of the 2020 Multimedia Systems Conference (MMSys’2020), ACM, Istanbul, Turkey, pp. 297–302.
• 21. Mongay Batalla, J. (2020) On analyzing video transmission over wireless WiFi and 5G C-band in harsh IIoT environments. IEEE Access 8, 118534–118541, doi: 10.1109/ ACCESS.2020.3005641.
• 22. Reichl, P., Tuffin, B. & Maillé, P. (2012) Economics of quality of experience. In: Hadjiantonis, A. M., Stiller, B. (eds) Telecommunication Economics. LNCS, Springer, Berlin-Heidelberg, vol. 7216, pp. 158–166.
• 23. Reiter, U., Brunnström, K., De Moor, K., Larabi, M. C., Pereira, M., Pinheiro, A., You, J. & Zgank, A. (2014) Factors influencing quality of experience. In: Möller, S., Raake, A. (eds) Quality of Experience. TLABS, Springer, Cham, pp. 55–72.
• 24. Skowronek, J., Raake, A., Berndtsson G.H., Rummukainen, O.S., Usai, P., Gunkel, S.N.B., Johanson, M. Habets, E.A.P., Malfait, L., Lindero, D. & Toet, A. (2022) Quality of experience in telemeetings and videoconferencing: A comprehensive survey. IEEE Access 10, pp. 63885– 63931, doi: 10.1109/ACCESS.2022.3176369.
• 25. Song, W., Tjondronegoro, D. & Docherty, M. (2012) Understanding user experience of mobile video: Framework, measurement, and optimization. In: Tjondronegoro, D. (ed.) Mobile Multimedia – User and Technology Perspectives. InTech, Rijeka, pp. 3–30, doi: 10.5772/1366.
• 26. Staelens, N., Pinson, M.H., Corriveau, P., De Turck, F. & Demeester, P. (2015) Measuring video quality in the network: From quality of service to user experience. In Proceedings of the International Workshop Video Process. Consumer Electron (VPQM), pp. 1–6.
• 27. Uhl, T. & Hoppe, C. (2020) A new parameterized model for determining quality of online video service using the modern H.265/HEVC and VP9 codecs. Journal of Telecommunications and Information Technology 4, pp. 72–78, doi: 10.26636/jtit.2020.146220.
• 28. Uhl, T., Hoppe, C. & Klink, J. (2020) Modern codecs by video streaming under use DASH technique: A objective comparison study. In Proceedings of the 28th International Conference on Software, Telecommunications and Computer Networks (SoftCOM’20), Split, Croatia, pp. 1–5.
• 29. Uhl, T., Hoppe, C. & Klink, J. (2021) H.264/AVC and H.265/HEVC codecs in the IP environment: A comparison study of QoE, QoS and UX. In Proceedings of the 29th International Conference on Software, Telecommunications and Computer Networks (Soft-COM’21), Hvar, Croatia, pp. 1–6.
• 30. Uhl, T. & Jürgensen, H.S. (2014) New tool for examining QoS in the IPTV service. In Proceedings of the World Telecommunication Congress (WTC’14), Berlin, Germany pp. 1–3.
• 31. Uhl, T, Klink, J. & Hoppe, C. (2020) Suitability of transport techniques for video transmission in IP networks. International Journal of Electronics and Telecommunications 66 (1), pp. 133–138, doi: 10.24425/ijet.2020.131854.
• 32. Uhl, T., Nowicki, K., Klink, J. & Hoppe, C. (2018) Comparison study of H.264/AVC, H.265/HEVC and VP9-coded video streams for the service IPTV. In Proceedings of the 26th International Conference on Software, Telecommunications and Computer Networks (SoftCOM’18), Split, Croatia, pp. 1–6.
• 33. Wang, Z. & Bovik, A.C. (2002) A universal image quality index. IEEE Signal Processing Letters 9 (3), pp. 81–84, doi: 10.1109/97.995823.
• 34. Wang, Z. & Bovik, A.C. (2009) Mean squared error: Love it or leave it? A new look at signal fidelity measures. IEEE Signal Processing Magazine 26 (1), pp. 98–117, doi: 10.1109/ MSP.2008.930649.
• 35. Wang, Z., Bovik, A.C., Sheikh, H.R. & Simoncelli, E.P. (2004) Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13 (4), pp. 600–612, doi: 10.1109/TIP.2003.819861.
• 36. Wechsung, I. & De Moor, K. (2014) Quality of experience versus user experience. In: Möller, S., Raake, A. (eds) Quality of Experience. TLABS. Springer, Cham, pp. 35–54.
• 37. Wiśniewski, P., Mongay Batalla, J., Bęben, A., Krawiec, P. & Chydziński, A. (2017) On optimizing adaptive algorithms based on rebuffering probability. ACM Transactions on Multimedia Computing, Communications, and Applications 13 (3s), pp. 1–20, doi: 10.1145/3092837.
• 38. X265 preset options (2024) https://x265.readthedocs.io/en/ master/presets.html [Accessed: January 20, 2024].

Uwagi

Opracowanie rekordu ze środków MNiSW, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2024).