caa a22 4500 445847824 CHVBK 20180317145404.0 cr unu---uuuuu 170323e20110601xx s 000 0 eng 10.1007/s10548-011-0174-1 doi (NATIONALLICENCE)springer-10.1007/s10548-011-0174-1 The Elicitation of Audiovisual Steady-State Responses: Multi-Sensory Signal Congruity and Phase Effects [Elektronische Daten] [Julian Jenkins III, Ariane Rhone, William Idsardi, Jonathan Simon, David Poeppel] Most ecologically natural sensory inputs are not limited to a single modality. While it is possible to use real ecological materials as experimental stimuli to investigate the neural basis of multi-sensory experience, parametric control of such tokens is limited. By using artificial bimodal stimuli composed of approximations to ecological signals, we aim to observe the interactions between putatively relevant stimulus attributes. Here we use MEG as an electrophysiological tool and employ as a measure the steady-state response (SSR), an experimental paradigm typically applied to unimodal signals. In this experiment we quantify the responses to a bimodal audio-visual signal with different degrees of temporal (phase) congruity, focusing on stimulus properties critical to audiovisual speech. An amplitude modulated auditory signal (‘pseudo-speech') is paired with a radius-modulated ellipse (‘pseudo-mouth'), with the envelope of low-frequency modulations occurring in phase or at offset phase values across modalities. We observe (i) that it is possible to elicit an SSR to bimodal signals; (ii) that bimodal signals exhibit greater response power than unimodal signals; and (iii) that the SSR power at specific harmonics and sensors differentially reflects the congruity between signal components. Importantly, we argue that effects found at the modulation frequency and second harmonic reflect differential aspects of neural coding of multisensory signals. The experimental paradigm facilitates a quantitative characterization of properties of multi-sensory speech and other bimodal computations. Springer Science+Business Media, LLC, 2011 Audio-visual nationallicence Cross-modal nationallicence Magnetoencephalography nationallicence Speech nationallicence Multi-sensory nationallicence Jenkins III Julian Department of Biology, University of Maryland, College Park, 1206 Biology-Psychology Building, 20742, College Park, MD, USA aut Rhone Ariane Department of Linguistics, University of Maryland, College Park, 1401 Marie Mount Hall, 20742, College Park, MD, USA aut Idsardi William Department of Linguistics, University of Maryland, College Park, 1401 Marie Mount Hall, 20742, College Park, MD, USA aut Simon Jonathan Department of Biology, University of Maryland, College Park, 1206 Biology-Psychology Building, 20742, College Park, MD, USA aut Poeppel David Department of Psychology, New York University, 6 Washington Place, 10003, New York, NY, USA aut Brain Topography Springer US; http://www.springer-ny.com 24/2(2011-06-01), 134-148 0896-0267 24:2<134 2011 24 10548 https://doi.org/10.1007/s10548-011-0174-1 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s10548-011-0174-1 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Jenkins III Julian Department of Biology, University of Maryland, College Park, 1206 Biology-Psychology Building, 20742, College Park, MD, USA aut NATIONALLICENCE 700 1- Rhone Ariane Department of Linguistics, University of Maryland, College Park, 1401 Marie Mount Hall, 20742, College Park, MD, USA aut NATIONALLICENCE 700 1- Idsardi William Department of Linguistics, University of Maryland, College Park, 1401 Marie Mount Hall, 20742, College Park, MD, USA aut NATIONALLICENCE 700 1- Simon Jonathan Department of Biology, University of Maryland, College Park, 1206 Biology-Psychology Building, 20742, College Park, MD, USA aut NATIONALLICENCE 700 1- Poeppel David Department of Psychology, New York University, 6 Washington Place, 10003, New York, NY, USA aut NATIONALLICENCE 773 0- Brain Topography Springer US; http://www.springer-ny.com 24/2(2011-06-01), 134-148 0896-0267 24:2<134 2011 24 10548 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer