On Confidence and Response Times of Human Observers in Subjective Image Quality Assessment

Document type: Conference Papers
Peer reviewed: Yes
Full text:
Author(s): Ulrich Engelke, Anthony Maeder, Hans-Jürgen Zepernick
Title: On Confidence and Response Times of Human Observers in Subjective Image Quality Assessment
Conference name: International Conference on Multimedia and Expo
Year: 2009
Pagination: 910-913
ISBN: 978-1-4244-4291-1
Publisher: IEEE
City: New York City
ISI number: 000277357000223
Organization: Blekinge Institute of Technology
Department: School of Engineering - Dept. of Signal Processing (Sektionen för teknik – avd. för signalbehandling)
School of Engineering S- 372 25 Ronneby
+46 455 38 50 00
Authors e-mail: uen@bth.se
Language: English
Abstract: Mean opinion scores obtained in subjective image quality experiments are widely accepted as measures of perceived visual quality. They have, however, a strong limitation regarding the reliability of the rated quality, since there is no explicit information as to whether the human observer experienced difficulties when judging image quality. We thus suggest that additional information about the observers confidence should be provided along with the actual quality measure. In this paper, we analyse two ways of obtaining this confidence measure; firstly as a confidence score given by the human observer and secondly as an indirect measure of the observers response time to provide the quality score. We reveal strong relationships of confidence scores and response times to the quality scores. We further propose a model to predict observer confidence based on the quality scores and response times.
Subject: Human Work Science\Human Computer Interaction
Keywords: Subjective image quality experiment, observer confidence, observer response times