caa a22 4500 605446776 CHVBK 20210128100128.0 cr unu---uuuuu 210128e20150101xx s 000 0 eng 10.1007/s11042-014-2136-6 doi (NATIONALLICENCE)springer-10.1007/s11042-014-2136-6 Audiovisual robustness: exploring perceptual tolerance to asynchrony and quality distortion [Elektronische Daten] [Ragnhild Eg, Carsten Griwodz, Pål Halvorsen, Dawn Behne] Rules-of-thumb for noticeable and detrimental asynchrony between audio and video streams have long since been established from the contributions of several studies. Although these studies share similar findings, none have made any discernible assumptions regarding audio and video quality. Considering the use of active adaptation in present and upcoming streaming systems, audio and video will continue to be delivered in separate streams; consequently, the assumption that the rules-of-thumb hold independent of quality needs to be challenged. To put this assumption to the test, we focus on the detection, not the appraisal, of asynchrony at different levels of distortion. Cognitive psychologists use the term temporal integration to describe the failure to detect asynchrony. The term refers to a perceptual process with an inherent buffer for short asynchronies, where corresponding auditory and visual signals are merged into one experience. Accordingly, this paper discusses relevant causes and concerns with regards to asynchrony, it introduces research on audiovisual perception, and it moves on to explore the impact of audio and video quality on the temporal integration of different audiovisual events. Three content types are explored, speech from a news broadcast, music presented by a drummer, and physical action in the form of a chess game. Within these contexts, we found temporal integration to be very robust to quality discrepancies between the two modalities. In fact, asynchrony detection thresholds varied considerably more between the different content than they did between distortion levels. Nevertheless, our findings indicate that the assumption concerning the independence of asynchrony and audiovisual quality may have to be reconsidered. The Author(s), 2014 Audiovisual asynchrony nationallicence Temporal integration nationallicence Perceived quality nationallicence Multimedia streaming nationallicence Active adaptation nationallicence Eg Ragnhild Department of Psychology, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut Griwodz Carsten Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut Halvorsen Pål Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut Behne Dawn Department of Psychology, Norwegian University of Science and Technology, Oslo, Norway aut Multimedia Tools and Applications Springer US; http://www.springer-ny.com 74/2(2015-01-01), 345-365 1380-7501 74:2<345 2015 74 11042 https://doi.org/10.1007/s11042-014-2136-6 text/html Onlinezugriff via DOI BK010053 XK010053 XK010000 Metadata rights reserved Springer special CC-BY-NC licence nationallicence 1 research-article jats NATIONALLICENCE NATIONALLICENCE NL-springer NATIONALLICENCE 856 40 https://doi.org/10.1007/s11042-014-2136-6 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Eg Ragnhild Department of Psychology, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut NATIONALLICENCE 700 1- Griwodz Carsten Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut NATIONALLICENCE 700 1- Halvorsen Pål Department of Informatics, University of Oslo, Norway and Simula Research Laboratory, Oslo, Norway aut NATIONALLICENCE 700 1- Behne Dawn Department of Psychology, Norwegian University of Science and Technology, Oslo, Norway aut NATIONALLICENCE 773 0- Multimedia Tools and Applications Springer US; http://www.springer-ny.com 74/2(2015-01-01), 345-365 1380-7501 74:2<345 2015 74 11042