naa a22 4500 510739911 CHVBK 20180411083024.0 cr unu---uuuuu 180411e20130301xx s 000 0 eng 10.1007/s12193-012-0106-8 doi (NATIONALLICENCE)springer-10.1007/s12193-012-0106-8 Data-based analysis of speech and gesture: the Bielefeld Speech and Gesture Alignment corpus (SaGA) and its applications [Elektronische Daten] [Andy Lücking, Kirsten Bergman, Florian Hahn, Stefan Kopp, Hannes Rieser] Communicating face-to-face, interlocutors frequently produce multimodal meaning packages consisting of speech and accompanying gestures. We discuss a systematically annotated speech and gesture corpus consisting of 25 route-and-landmark-description dialogues, the Bielefeld Speech and Gesture Alignment corpus (SaGA), collected in experimental face-to-face settings. We first describe the primary and secondary data of the corpus and its reliability assessment. Then we go into some of the projects carried out using SaGA demonstrating the wide range of its usability: on the empirical side, there is work on gesture typology, individual and contextual parameters influencing gesture production and gestures' functions for dialogue structure. Speech-gesture interfaces have been established extending unification-based grammars. In addition, the development of a computational model of speech-gesture alignment and its implementation constitutes a research line we focus on. OpenInterface Association, 2012 Speech-and-gesture alignment nationallicence Multimodal data nationallicence Multimodal simulation nationallicence Multimodal dialogue nationallicence Iconic gesture nationallicence Lücking Andy Goethe-University Frankfurt am Main, Frankfurt am Main, Germany aut Bergman Kirsten CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut Hahn Florian CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut Kopp Stefan CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut Rieser Hannes CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut Journal on Multimodal User Interfaces Springer-Verlag 7/1-2(2013-03-01), 5-18 1783-7677 7:1-2<5 2013 7 12193 https://doi.org/10.1007/s12193-012-0106-8 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s12193-012-0106-8 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Lücking Andy Goethe-University Frankfurt am Main, Frankfurt am Main, Germany aut NATIONALLICENCE 700 1- Bergman Kirsten CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut NATIONALLICENCE 700 1- Hahn Florian CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut NATIONALLICENCE 700 1- Kopp Stefan CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut NATIONALLICENCE 700 1- Rieser Hannes CRC 673 "Alignment in Communication”, Bielefeld University, Bielefeld, Germany aut NATIONALLICENCE 773 0- Journal on Multimodal User Interfaces Springer-Verlag 7/1-2(2013-03-01), 5-18 1783-7677 7:1-2<5 2013 7 12193 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer