Lip-motion biometrics for audio-visual identity recognition
2008 (English) Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]
Biometric recognition systems have been established as powerful security tools to prevent unknown users from entering high risk systems and areas. They are increasingly being utilized in surveillance and access management (city centers, banks, etc.) by using individuals' physical or biological characteristics. The present study reports on the use of lip motion as a standalone biometric modality as well as a modality integrated with audio speech for identity and digit recognition. First, we estimate motion vectors from a sequence of lip-movement images. The motion is modelled as the distribution of apparent line velocities in the movement of brightness patterns in an image. Then, we construct compact lip-motion features from the regional statistics of the local velocities. These can be used alone or merged with audio features to recognize individuals or speech (digits). In this work, we utilized two classifiers for identification and verification of identity as well as with digit recognition. Although the study is focused on processing lip movements in a video sequence, significant speech processing is a prerequisite given that the contribution of video analysis to speech analysis is studied in conjunction with recognition of humans and what they say (digits). Such integration is necessary to understand multimodel biometric systems to the benefit of recognition performance and robustness against noise. Extensive experiments utilizing one of the largest available databases, XM2VTS, are presented.
Place, publisher, year, edition, pages Göteborg: Chalmers university of technology , 2008. , p. 161
Series
Doktorsavhandlingar vid Chalmers tekniska högskola. Ny serie, ISSN 0346-718X ; 2842
Keywords [en]
Biometrics, Lip motion, Audio-visual signals, Speech recognition, Speaker recognition, Digit recognition
National Category
Computer graphics and computer vision
Identifiers URN: urn:nbn:se:hh:diva-1980 Local ID: 2082/2375 ISBN: 978-91-7385-161-9 OAI: oai:DiVA.org:hh-1980 DiVA, id: diva2:239198
Public defence
2008-09-16, Rum R1107, Högskolan i Halmstad, Kristian IV:s väg 3, Halmstad, 13:15 (English)
Opponent
2008-09-292008-09-292025-02-07 Bibliographically approved