Modelling Saliency Awareness for Objective Video Quality Assessment

Document type: Conference Papers
Peer reviewed: Yes
Full text:
Author(s): Ulrich Engelke, Marcus Barkowsky, Patrick Le Callet, Hans-Jürgen Zepernick
Title: Modelling Saliency Awareness for Objective Video Quality Assessment
Conference name: Second International Workshop on Quality of Multimedia Experience
Year: 2010
Pagination: 212-217
Publisher: IEEE
City: Trondheim
Organization: Blekinge Institute of Technology
Department: School of Engineering - Dept. of Electrical Engineering (Sektionen för ingenjörsvetenskap - Avd. för elektroteknik)
School of Engineering S-371 79 Karlskrona
+46 455 38 50 00
Authors e-mail:
Language: English
Abstract: Existing video quality metrics do usually not take into consideration that spatial regions in video frames are of varying saliency and thus, differently attract the viewer's attention. This paper proposes a model of saliency awareness to complement existing video quality metrics, with the aim to improve the agreement of objectively predicted quality with subjectively rated quality. For this purpose, we conducted a subjective experiment in which human observers rated the annoyance of videos with transmission distortions appearing either in a salient region or in a non-salient region. The mean opinion scores confirm that distortions in salient regions are perceived much more annoying. It is shown that application of the saliency awareness model to two video quality metrics considerably improves their quality prediction performance.
Subject: Telecommunications\General
Signal processing\Image and Video Processing
Keywords: Video quality metrics, visual saliency, eye tracking, subjective quality experiment