Research article · 2012
Research articlePublished 2017
Audio-Visual Person Recognition Using Deep Convolutional Neural Networks
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
Protection of data integrity and person identity has been an active research area for many years. Among the techniques investigated, developing multi-modal recognition systems using audio and face signals for people authentication holds a promising future due to its ease of use. A challenge in developing such a multi-modal recognition system is to improve its reliability for a practical application. In this paper, an efficient audio-visual bimodal recognition system which uses Deep Convolution Neural Networks (CNNs) as a primary model architecture. First, two separate Deep CNN models are trained with the help of audio and facial features, respectively. The outputs of these CNN models are then combined/fused to predict the identity of the subject. Implementation details with regard to data fusion are discussed in a great length in the paper. Through experimental verification, the proposed bimodal fusion approach is superior in accuracy performance when compared with any single modal recognition systems and with published results using the same data-set.
Subjects
Mathematics & StatisticsAsk about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Conference abstract · 19 Jul 2018
Appling both hybrid restricted Boltzmann machine and deep convolution neural networks to low-resolution face image recognition
Conference abstract · 2018
Appling both hybrid restricted Boltzmann machine and deep convolution neural networks to lowresolution face image recognition
Article · 16 Sep 2024
The recognition of severe thoracic aortic dissection using conventional chest radiography in conjunction with a whale optimized bilateral residual convolutional neural network
Research article · 16 Apr 2016
Handwritten Digit Recognition Using Convolutional Neural Networks
More from this journal
The newest in Journal of Biometrics & Biostatistics.
Article · 29 Dec 2025
Biometrics Enhance EHR Security and Patient Safety
Article · 29 Dec 2025
Biometric and Clinical Data for Enhanced Risk Prediction
Article · 29 Dec 2025
Advanced Statistics for Precision Public Health Innovations
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- JournalJournal of Biometrics & Biostatistics
- SubjectMathematics & Statistics
- BylineArticles whose byline prints “Sagar Vegad”
- BylineArticles whose byline prints “Harsh Patel”
- BylineArticles whose byline prints “Hanqi Zhuang”
- BylineArticles whose byline prints “Mehul Naik”

