naa a22 4500 510739865 CHVBK 20180411083024.0 cr unu---uuuuu 180411e20130301xx s 000 0 eng 10.1007/s12193-012-0105-9 doi (NATIONALLICENCE)springer-10.1007/s12193-012-0105-9 Head movements, facial expressions and feedback in conversations: empirical evidence from Danish multimodal data [Elektronische Daten] [Patrizia Paggio, Costanza Navarretta] This article deals with multimodal feedback in two Danish multimodal corpora, i.e., a collection of map-task dialogues and a corpus of free conversations in first encounters between pairs of subjects. Machine learning techniques are applied to both sets of data to investigate various relations between the non-verbal behaviour—more specifically head movements and facial expressions—and speech with regard to the expression of feedback. In the map-task data, we study the extent to which the dialogue act type of linguistic feedback expressions can be classified automatically based on the non-verbal features. In the conversational data, on the other hand, non-verbal and speech features are used together to distinguish feedback from other multimodal behaviours. The results of the two sets of experiments indicate in general that head movements, and to a lesser extent facial expressions, are important indicators of feedback, and that gestures and speech disambiguate each other in the machine learning process. OpenInterface Association, 2012 Gestures nationallicence Head movements nationallicence Facial expressions nationallicence Feedback nationallicence Backchanneling nationallicence Paggio Patrizia Centre for Language Technology, University of Copenhagen, Njalsgade 240, 2300, Copenhagen, Denmark aut Navarretta Costanza Centre for Language Technology, University of Copenhagen, Njalsgade 240, 2300, Copenhagen, Denmark aut Journal on Multimodal User Interfaces Springer-Verlag 7/1-2(2013-03-01), 29-37 1783-7677 7:1-2<29 2013 7 12193 https://doi.org/10.1007/s12193-012-0105-9 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s12193-012-0105-9 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Paggio Patrizia Centre for Language Technology, University of Copenhagen, Njalsgade 240, 2300, Copenhagen, Denmark aut NATIONALLICENCE 700 1- Navarretta Costanza Centre for Language Technology, University of Copenhagen, Njalsgade 240, 2300, Copenhagen, Denmark aut NATIONALLICENCE 773 0- Journal on Multimodal User Interfaces Springer-Verlag 7/1-2(2013-03-01), 29-37 1783-7677 7:1-2<29 2013 7 12193 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer