Linking Distortion Perception and Visual Saliency in H.264/AVC Coded Video Containing Packet Loss

Document type: Conference Papers
Peer reviewed: Yes
Full text:
Author(s): Ulrich Engelke, Romuald Pepion, Patrick Le Callet, Hans-Jürgen Zepernick
Title: Linking Distortion Perception and Visual Saliency in H.264/AVC Coded Video Containing Packet Loss
Conference name: Visual Communications and Image Processing
Year: 2010
Pagination: 1-10
Publisher: SPIE
City: Huang Shan
URI/DOI: 10.1117/12.863508
Organization: Blekinge Institute of Technology
Department: School of Engineering - Dept. of Electrical Engineering (Sektionen för ingenjörsvetenskap - Avd. för elektroteknik)
School of Engineering S-371 79 Karlskrona
+46 455 38 50 00
Language: English
Abstract: In this paper, distortions caused by packet loss during video transmission are evaluated with respect to their perceived annoyance. In this respect, the impact of visual saliency on the level of annoyance is of particular interest, as regions and objects in a video frame are typically not of equal importance to the viewer. For this purpose, gaze patterns from a task free eye tracking experiment were utilised to identify salient regions in a number of videos. Packet loss was then introduced into the bit stream such as that the corresponding distortions appear either in a salient region or in a non-salient region. A subjective experiment was then conducted in which human observers rated the annoyance of the distortions in the videos. The outcomes show a strong tendency that distortions in a salient region are indeed perceived as much more annoying as compared to distortions in the non-salient region. The saliency of the distorted image content was further found to have a larger impact on the perceived annoyance as compared to the distortion duration. The findings of this work are considered to be of great use to improve prediction performance of video quality metrics in the context of transmission errors.
Subject: Telecommunications\General
Keywords: Visual saliency, distortion perception, video transmission, packet loss, subjective experiment