caa a22 4500 445351896 CHVBK 20180317142846.0 cr unu---uuuuu 170323e20110601xx s 000 0 eng 10.1007/s00221-011-2686-z doi (NATIONALLICENCE)springer-10.1007/s00221-011-2686-z The effects of visual material and temporal synchrony on the processing of letters and speech sounds [Elektronische Daten] [Maria Mittag, Rika Takegata, Teija Kujala] Associating letters with speech sounds is essential for reading skill acquisition. In the current study, we aimed at determining the effects of different types of visual material and temporal synchrony on the integration of letters and speech sounds. To this end, we recorded the mismatch negativity (MMN), an index of automatic change detection in the brain, from literate adults. Subjects were presented with auditory consonant-vowel syllable stimuli together with visual stimuli, which were either written syllables or scrambled pictures of the written syllables. The visual stimuli were presented in half of the blocks synchronously with the auditory stimuli and in the other half 200ms before the auditory stimuli. The auditory stimuli were consonant, vowel or vowel length changes, or changes in syllable frequency or intensity presented by using the multi-feature paradigm. Changes in the auditory stimuli elicited MMNs in all conditions. MMN amplitudes for the consonant and frequency changes were generally larger for the sounds presented with written syllables than with scrambled syllables. Time delay diminished the MMN amplitude for all deviants. The results suggest that speech sound processing is modulated when the sounds are presented with letters versus non-linguistic visual stimuli, and further, that the integration of letters and speech sounds seems to be dependent on precise temporal alignment. Moreover, the results indicate that with our paradigm, a variety of parameters relevant and irrelevant for reading can be tested within one experiment. Springer-Verlag, 2011 Audiovisual processing nationallicence Mismatch negativity (MMN) nationallicence Event-related potentials (ERPs) nationallicence Letter-speech sound processing nationallicence Multisensory integration nationallicence Mittag Maria Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut Takegata Rika Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut Kujala Teija Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut Experimental Brain Research Springer-Verlag 211/2(2011-06-01), 287-298 0014-4819 211:2<287 2011 211 221 https://doi.org/10.1007/s00221-011-2686-z text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s00221-011-2686-z text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Mittag Maria Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut NATIONALLICENCE 700 1- Takegata Rika Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut NATIONALLICENCE 700 1- Kujala Teija Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of Helsinki, Helsinki, Finland aut NATIONALLICENCE 773 0- Experimental Brain Research Springer-Verlag 211/2(2011-06-01), 287-298 0014-4819 211:2<287 2011 211 221 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer