caa a22 4500 467914508 CHVBK 20180406152858.0 cr unu---uuuuu 170328e20060501xx s 000 0 eng 10.1007/s11263-006-5166-3 doi (NATIONALLICENCE)springer-10.1007/s11263-006-5166-3 Representation Analysis and Synthesis of Lip Images Using Dimensionality Reduction [Elektronische Daten] [Michal Aharon, Ron Kimmel] Understanding facial expressions in image sequences is an easy task for humans. Some of us are capable of lipreading by interpreting the motion of the mouth. Automatic lipreading by a computer is a challenging task, with so far limited success. The inverse problem of synthesizing real looking lip movements is also highly non-trivial. Today, the technology to automatically generate an image series that imitates natural postures is far from perfect. We introduce a new framework for facial image representation, analysis and synthesis, in which we focus just on the lower half of the face, specifically the mouth. It includes interpretation and classification of facial expressions and visual speech recognition, as well as a synthesis procedure of facial expressions that yields natural looking mouth movements. Our image analysis and synthesis processes are based on a parametrization of the mouth configuration set of images. These images are represented as points on a two-dimensional flat manifold that enables us to efficiently define the pronunciation of each word and thereby analyze or synthesize the motion of the lips. We present some examples of automatic lips motion synthesis and lipreading, and propose a generalization of our solution to the problem of lipreading different subjects. Springer Science + Business Media, Inc, 2006 automatic lipreading nationallicence image sequence processing nationallicence speech synthesis nationallicence multidimensional scaling nationallicence dimension reduction nationallicence locally linear embedding nationallicence Aharon Michal Department of Computer Science, Technion—Israel Institute of Technology, 32000, Technion City, Haifa, Israel aut Kimmel Ron Department of Computer Science, Technion—Israel Institute of Technology, 32000, Technion City, Haifa, Israel aut International Journal of Computer Vision Kluwer Academic Publishers 67/3(2006-05-01), 297-312 0920-5691 67:3<297 2006 67 11263 https://doi.org/10.1007/s11263-006-5166-3 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s11263-006-5166-3 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Aharon Michal Department of Computer Science, Technion—Israel Institute of Technology, 32000, Technion City, Haifa, Israel aut NATIONALLICENCE 700 1- Kimmel Ron Department of Computer Science, Technion—Israel Institute of Technology, 32000, Technion City, Haifa, Israel aut NATIONALLICENCE 773 0- International Journal of Computer Vision Kluwer Academic Publishers 67/3(2006-05-01), 297-312 0920-5691 67:3<297 2006 67 11263 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer