Video coding technique with a parametric modelling of noise

• Autorzy: Stankiewicz Olgierd

Identyfikatory

DOI

10.1016/j.opelre.2019.05.006

• Języki publikacji: EN

Abstrakty

EN

This paper presents a video encoding method in which noise is encoded using a novel parametric modelrepresenting spectral envelope and spatial distribution of energy. The proposed method has been exper-imentally assessed using video test sequences in a practical setup consisting of a simple, real-time noise reduction technique and High Efficiency Video Codec (HEVC). The attained results show that the use ofthe proposed parametric modelling of noise can improve the subjective quality of reconstructed videoby approximately 1.8 Mean Opinion Scope (MOS) points (in 11-point scale) related to the classical videocoding. Moreover, the present work confirms results attained in the previous works that the usage ofeven sole noise reduction prior to the encoding provides quality increase.

Słowa kluczowe

EN

video compression; HEVC; noise coding; noise representation; noise modeling

• Wydawca: Stowarzyszenie Elektryków Polskich ; Polska Akademia Nauk ; Wojskowa Akademia Techniczna im. Jarosława Dąbrowskiego
• Czasopismo: Opto-Electronics Review
• Rocznik: 2019
• Tom: Vol. 27, No. 3
• Strony: 241--251
• Opis fizyczny: Bibliogr. 31 poz., wykr., rys., tab., fot.

Twórcy

autor

Stankiewicz Olgierd

• Chair of Multimedia Telecommunications and Microelectronics, Poznan University of Technology, Pl. Marii Skłodowskiej-Curie 5, 60-965 Poznań, Poland

Bibliografia

• [1] S. Aslam, YouTube by the Numbers: Stats, Demographics & Fun Facts, onlineFeb. 2019 https://www.omnicoreagency.com/youtube-statistics/.
• [2] The Zettabyte Era: Trends and Analysis, 2017, Cisco White Paper.
• [3] Number of Netflix Streaming Subscribers Worldwide From 3rd Quarter 2011 to 4th Quarter 2018, 2019, online Feb https://www.statista.com/statistics/250934/quarterly-number-of-netflixstreaming-subscribers-worldwide/.
• [4] D. Karwowski, T. Grajek, K. Klimaszewski, O. Stankiewicz, J. Stankowski, K.Wegner, 20 years of progress in video compression - from MPEG-1 to MPEG-H HEVC. General view on the path of video coding development Image Processing and Communications Challenges 8, Advances in IntelligentSystems and Computing (ADV INTELL SYST), 525, Springer, Heidelberg, 2017, pp. 3–15.
• [5] ISO/IEC 13818-2, Int. Standard “Information Technology-Generic Coding of Moving Pictures and Associated Audio Information: Video”, 2nd ed., 2013, also: ITU-T Rec. H.262 Amd 1, 2013.
• [6] ISO/IEC 14496-10, Int. Standard “Generic Coding of Audio-Visual Objects–Part 10: Advanced Video Coding”, 7th ed., 2012, also: ITU-T Rec. H.264,Edition 7.0, 2012.
• [7] G.J. Sullivan, J.-R. Ohm, W.J. Han, T. Wiegand, Overview of the high efficiencyvideo coding (HEVC) standard, IEEE T. Circ. Syst. Vid. 22 (12) (2012)1649–1668.
• [8] ISO/IEC 23008-2, Int. Standard “Information Technology - High EfficiencyCoding and Media Delivery in Heterogeneous Environments-Part 2: HighEfficiency Video Coding”, 2015, also: ITU-T Rec. H.265, 2018.
• [9] R. Ohm, G.J. Sullivan, H. Schwarz, T.K. Tan, T. Wiegand, Comparison of thecoding efficiency of video coding standards - including High Efficiency Video Coding (HEVC), IEEE T. Circ. Syst Vid. 22 (12) (2012) 1669–1684.
• [10] J.-R. Ohm, Versatile video coding – towards the next generation of videocompression, Picture Coding Symposium 2018 (PCS2018) (2018).
• [11] Y. Chen, D. Murherjee, J. Han, et al., An overview of core coding tools in theAV1 video codec, Picture Coding Symposium 2018 (PCS2018) (2018).
• [12] O. Stankiewicz, M. Domanski, K. Wegner, Analysis of noise in multi-camerasystems, 3DTV Conference 2014 (3DTV CONF) (2014).
• [13] M.A. Farooque, J.S. Rohankar, Survey on various noises and techniques fordenoising the color image, Int. J. Appl. Innov. Eng. Manage. 2 (11) (2013)218–221.
• [14] B.C. Song, K.W. Chun, Motion-compensated temporal prefiltering for noisereduction in a video encoder, in: 2004 International Conference on Image Processing, ICIP’ 04 (IEEE IMAGE PROC), 2004, pp. 1221–1224.
• [15] O. Stankiewicz, K. Wegner, D. Karwowski, J. Stankowski, K. Klimaszewski, T.Grajek, Encoding mode selection in HEVC with the use of noise reduction, in:International Conference on Systems, Signals and Image Processing, Poznan,Poland, 2017.
• [16] O. Stankiewicz, K. Wegner, D. Karwowski, J. Stankowski, K. Klimaszewski, T.Grajek, HEVC encoding assisted with noise reduction, Int. J. Electron.Telecommun. 64 (3) (2018) 285–292, ISSN: 0867-6747, Electronics and Telecommunications Committee of Polish Academy of Sciences, Warsaw.
• [17] Y. Zhao, L. Yu, Z. Chen, C. Zhu, Video quality assessment based on measuring perceptual noise from spatial and temporal perspectives, IEEE T. Circ. Syst.Video Technol. 21 (12) (2011) 1890–1902.
• [18] ISO/IEC 13818-7, Int. Standard “Information Technology - Generic Coding of Moving Pictures and Associated Audio Information-Part 7: Advanced Audio Coding (AAC)”, 2nd ed., 2013.
• [19] B.T. Oh, S. Lei, C.-C. Jay Kuo, Advanced film grain noise extraction andsynthesis for high-definition video coding, IEEE T. Circ. Syst. Video Technol. 19(12) (2009) 1717–1729.
• [20] J. Dai, O.C. Au, C. Pang, W. Yang, F. Zou, Film grain noise removal and synthesisin video coding, IEEE International Conference on Acoustics, Speech andSignal Processing (INT CONF ACOUST SPEE) (2010) 890–893.
• [21] A. Norkin, N. Birkbeck, Film grain synthesis for AV1 video codec, IEEE Data Compression Conference 2018 (IEEE DATA COMPR CONF) (2018).
• [22] J.A. Martins, Low bit rate LPC vocoders using vector quantization andinterpolation, International Conference on Acoustics, Speech, and Signal Processing (INT CONF ACOUST SPEE) 1 (1991) 597–600.
• [23] M. Fizick, A. Balakhnin, T. Schniede, Mv-Tools Web-Page, online 1 Feb 2019, http://avisynth.org.ru/mvtools/mvtools.html.
• [24] R. Berg, K. Post, W. Dijkhof, E. Peche, B. Rudiak-Gould, Avi-Synth Webpage, online 1 Feb 2019 www.avisynth.org.
• [25] F. Bossen, Common test conditions and reference software configurations, in:Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO / IEC JTC1 / SC29 / WG11, Doc. JCTVC-J1100, 2012.
• [26] L.-M. Lee, H.-C. Wang, An extended Levinson-Durbin algorithm for theanalysis of noisy autoregressive process, IEEE Signal. Proc. Let. 3 (1) (1996)13–15.
• [27] S. Kim, D. Pak, S. Lee, SSIM-based distortion metric for film grain noise in HEVC, Signal Image Video P. 12 (3) (2018) 489–496.
• [28] Joint Call for Proposals on Video Compression Technology, 2010, ISO/IECJTC1/SC29/WG11 and ITU-T Q6/16, WG11 document N11113 and Q6/16 document VCEG-AM91, Kyoto, January.
• [29] Report of subjective test results of responses to the joint call for proposals(CfP) on video coding technology for High efficiency video coding (HEVC), in:Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11 1st Meeting: Dresden, DE, 2010 Document:JCTVC-A204, 2010.
• [30] Methodology for the Subjective Assessment of the Quality of Television Pictures, 2002, ITU-R Rec. BT.500-11.
• [31] G. Bjøntegaard, Calculation of Average PSNR Differences Between RD-curves, ITU-T SG16, Doc. VCEG-M33, 2001.

Uwagi

1. Opracowanie rekordu w ramach umowy 509/P-DUN/2018 ze środków MNiSW przeznaczonych na działalność upowszechniającą naukę (2019).

2. This work was supported by the Ministry of Science and Higher Education of Poland.