hh.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Periocular Recognition Using CNN Features Off-the-Shelf
Halmstad University, School of Information Technology, Halmstad Embedded and Intelligent Systems Research (EIS), CAISR - Center for Applied Intelligent Systems Research.ORCID iD: 0000-0002-9696-7843
Halmstad University, School of Information Technology, Halmstad Embedded and Intelligent Systems Research (EIS), CAISR - Center for Applied Intelligent Systems Research.ORCID iD: 0000-0002-1400-346X
Halmstad University, School of Information Technology, Halmstad Embedded and Intelligent Systems Research (EIS), CAISR - Center for Applied Intelligent Systems Research.ORCID iD: 0000-0002-4929-1262
2018 (English)In: 2018 International Conference of the Biometrics Special Interest Group (BIOSIG), Piscataway, N.J.: IEEE, 2018Conference paper, Published paper (Refereed)
Abstract [en]

Periocular refers to the region around the eye, including sclera, eyelids, lashes, brows and skin. With a surprisingly high discrimination ability, it is the ocular modality requiring the least constrained acquisition. Here, we apply existing pre-trained architectures, proposed in the context of the ImageNet Large Scale Visual Recognition Challenge, to the task of periocular recognition. These have proven to be very successful for many other computer vision tasks apart from the detection and classification tasks for which they were designed. Experiments are done with a database of periocular images captured with a digital camera. We demonstrate that these offthe-shelf CNN features can effectively recognize individuals based on periocular images, despite being trained to classify generic objects. Compared against reference periocular features, they show an EER reduction of up to ~40%, with the fusion of CNN and traditional features providing additional improvements.

Place, publisher, year, edition, pages
Piscataway, N.J.: IEEE, 2018.
Series
2018 International Conference of the Biometrics Special Interest Group (BIOSIG), ISSN 1617-5468 ; 2018
Keywords [en]
Periocular recognition, deep learning, biometrics, Convolutional Neural Network
National Category
Signal Processing
Identifiers
URN: urn:nbn:se:hh:diva-37704DOI: 10.23919/BIOSIG.2018.8553348Scopus ID: 2-s2.0-85060015047ISBN: 978-3-88579-676-3 (print)OAI: oai:DiVA.org:hh-37704DiVA, id: diva2:1238869
Conference
International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany, Sept. 26-29, 2018
Projects
SIDUS-AIR
Funder
Knowledge Foundation, SIDUS-AIRSwedish Research Council, 2016-03497Vinnova, 2018-00472Knowledge Foundation, CAISRAvailable from: 2018-08-14 Created: 2018-08-14 Last updated: 2025-10-01Bibliographically approved
In thesis
1. Ocular Recognition in Unconstrained Sensing Environments
Open this publication in new window or tab >>Ocular Recognition in Unconstrained Sensing Environments
2024 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis focuses on the problem of increasing flexibility in the acquisition and application of biometric recognition systems based on the ocular region. While the ocular area is one of the oldest and most widely studied biometric regions thanks to its rich and discriminative elements and characteristics, most modalities such as retina, iris, eye movements, or oculomotor plant have limitations regarding data acquisition. Some require a specific type of illumination like the iris, a limited distance range like eye movements, or specific sensors and user collaboration like the retina. In this context, this thesis focuses on the periocular region, which stands out as the ocular modality with the fewest acquisition constraints. 

The first part focuses on using middle-layers' deep representation of pre-trained CNNs as a one-shot learning method, along with simple distance-based metrics and similarity scores for periocular recognition. This approach tackles the issue of limited data availability and collection for biometric recognition systems by eliminating the need to train the models for the target data. Furthermore, it allows seamless transitions between identification and verification scenarios with a single model, and tackles the problem of the open-world setting and training bias of CNNs. We demonstrate that off-the-shelf features from middle-layers can outperform CNNs trained for the target domain that followed a more extensive training strategy when target data is limited.

The second part of the thesis analyzes traditional methods for biometric systems in the context of periocular recognition. Nowadays, these methods are often overlooked in favor of deep learning solutions. However, we show that they can still outperform heavily trained CNNs in closed-world and open-world settings and can be used in conjunction with CNNs to further improve recognition performance. Moreover, we investigate the use of the complex structure tensor as a handcrafted texture extractor at the input of CNNs. We show that CNNs can benefit from this explicit textural information in terms of performance and convergence, offering the potential for network compression and explainability of the features used. We demonstrate that CNNs may not easily access the orientation information present in the images that are exploited in some more traditional approaches.

The final part of the thesis addresses the analysis of periocular recognition under different light spectra and the cross-spectral scenario. More specifically, we analyze the performance of the proposed methods under different light spectra. We also investigate the cross-spectral scenario for one-shot learning with middle-layers' deep representations and explore the possibility of bridging the domain gap in the cross-spectral scenario by training generative networks. This allows using simpler models and algorithms trained on a single spectrum.

Place, publisher, year, edition, pages
Halmstad: Halmstad University Press, 2024. p. 49
Series
Halmstad University Dissertations ; 114
Keywords
Biometrics, Computer Vision, Pattern Recognition, Periocular Recognition
National Category
Signal Processing Computer graphics and computer vision
Identifiers
urn:nbn:se:hh:diva-53257 (URN)978-91-89587-43-4 (ISBN)978-91-89587-42-7 (ISBN)
Public defence
2024-05-28, S3030, Kristian IV:s väg 3, 08:00 (English)
Opponent
Supervisors
Available from: 2024-04-24 Created: 2024-04-24 Last updated: 2025-10-01Bibliographically approved

Open Access in DiVA

fulltext(2795 kB)338 downloads
File information
File name FULLTEXT01.pdfFile size 2795 kBChecksum SHA-512
3e6d164b329a7c85ccbf02fb7c10fcf905ce02809d8dccf485a4ba8f0049aff5bb1df717bb3618f056127e663c6ebe30d072c0a358988c7baef27022434b0474
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopusFull text

Authority records

Hernandez-Diaz, KevinAlonso-Fernandez, FernandoBigun, Josef

Search in DiVA

By author/editor
Hernandez-Diaz, KevinAlonso-Fernandez, FernandoBigun, Josef
By organisation
CAISR - Center for Applied Intelligent Systems Research
Signal Processing

Search outside of DiVA

GoogleGoogle Scholar
Total: 341 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1080 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf