Audiovisual robustness: exploring perceptual tolerance to asynchrony and quality distortion

Verfasser / Beitragende:
[Ragnhild Eg, Carsten Griwodz, Pål Halvorsen, Dawn Behne]
Ort, Verlag, Jahr:
2015
Enthalten in:
Multimedia Tools and Applications, 74/2(2015-01-01), 345-365
Format:
Artikel (online)
ID: 605446776
LEADER caa a22 4500
001 605446776
003 CHVBK
005 20210128100128.0
007 cr unu---uuuuu
008 210128e20150101xx s 000 0 eng
024 7 0 |a 10.1007/s11042-014-2136-6  |2 doi 
035 |a (NATIONALLICENCE)springer-10.1007/s11042-014-2136-6 
245 0 0 |a Audiovisual robustness: exploring perceptual tolerance to asynchrony and quality distortion  |h [Elektronische Daten]  |c [Ragnhild Eg, Carsten Griwodz, Pål Halvorsen, Dawn Behne] 
520 3 |a Rules-of-thumb for noticeable and detrimental asynchrony between audio and video streams have long since been established from the contributions of several studies. Although these studies share similar findings, none have made any discernible assumptions regarding audio and video quality. Considering the use of active adaptation in present and upcoming streaming systems, audio and video will continue to be delivered in separate streams; consequently, the assumption that the rules-of-thumb hold independent of quality needs to be challenged. To put this assumption to the test, we focus on the detection, not the appraisal, of asynchrony at different levels of distortion. Cognitive psychologists use the term temporal integration to describe the failure to detect asynchrony. The term refers to a perceptual process with an inherent buffer for short asynchronies, where corresponding auditory and visual signals are merged into one experience. Accordingly, this paper discusses relevant causes and concerns with regards to asynchrony, it introduces research on audiovisual perception, and it moves on to explore the impact of audio and video quality on the temporal integration of different audiovisual events. Three content types are explored, speech from a news broadcast, music presented by a drummer, and physical action in the form of a chess game. Within these contexts, we found temporal integration to be very robust to quality discrepancies between the two modalities. In fact, asynchrony detection thresholds varied considerably more between the different content than they did between distortion levels. Nevertheless, our findings indicate that the assumption concerning the independence of asynchrony and audiovisual quality may have to be reconsidered. 
540 |a The Author(s), 2014 
690 7 |a Audiovisual asynchrony  |2 nationallicence 
690 7 |a Temporal integration  |2 nationallicence 
690 7 |a Perceived quality  |2 nationallicence 
690 7 |a Multimedia streaming  |2 nationallicence 
690 7 |a Active adaptation  |2 nationallicence 
700 1 |a Eg  |D Ragnhild  |u Department of Psychology, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
700 1 |a Griwodz  |D Carsten  |u Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
700 1 |a Halvorsen  |D Pål  |u Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
700 1 |a Behne  |D Dawn  |u Department of Psychology, Norwegian University of Science and Technology, Oslo, Norway  |4 aut 
773 0 |t Multimedia Tools and Applications  |d Springer US; http://www.springer-ny.com  |g 74/2(2015-01-01), 345-365  |x 1380-7501  |q 74:2<345  |1 2015  |2 74  |o 11042 
856 4 0 |u https://doi.org/10.1007/s11042-014-2136-6  |q text/html  |z Onlinezugriff via DOI 
898 |a BK010053  |b XK010053  |c XK010000 
900 7 |a Metadata rights reserved  |b Springer special CC-BY-NC licence  |2 nationallicence 
908 |D 1  |a research-article  |2 jats 
949 |B NATIONALLICENCE  |F NATIONALLICENCE  |b NL-springer 
950 |B NATIONALLICENCE  |P 856  |E 40  |u https://doi.org/10.1007/s11042-014-2136-6  |q text/html  |z Onlinezugriff via DOI 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Eg  |D Ragnhild  |u Department of Psychology, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Griwodz  |D Carsten  |u Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Halvorsen  |D Pål  |u Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway  |4 aut 
950 |B NATIONALLICENCE  |P 700  |E 1-  |a Behne  |D Dawn  |u Department of Psychology, Norwegian University of Science and Technology, Oslo, Norway  |4 aut 
950 |B NATIONALLICENCE  |P 773  |E 0-  |t Multimedia Tools and Applications  |d Springer US; http://www.springer-ny.com  |g 74/2(2015-01-01), 345-365  |x 1380-7501  |q 74:2<345  |1 2015  |2 74  |o 11042