Scholars Central

Conference abstractPublished 2018

Real-time highly accurate face alignment using a three-stage convolutional neural regression networks

Authors: Daijin Kim

Pohang University of Science and Technology, Republic of Korea

Ask about this article

Abstract

Select any words in the title or abstract, or press this and choose a sentence.

Recently, many face alignment methods using convolutional neural networks (CNN) have been introduced due to their high accuracies. However, they do not show real-time processing due to their high computational costs. In this paper, we propose a three-stage convolutional neural regression network (CNRN) to achieve a highly accurate face alignment in the real-time. The first stage consists of one CNRN that maps the facial image into the center positions of seven facial parts such as eyes, nose, mouth, etc. We obtain 68 local facial patches by aligning the center positions of seven facial parts onto the mean shape. The second stage consists of seven independent CNRNs, where each CNRN maps the local facial patches within its facial part into their displacements of x and y direction to reach the target positions. We obtain the fitted whole facial features and make a warped facial image from them. The third stage consists of one CNRN that maps the warped facial image into the appearance error. We repeat the second and third stage until the appearance error becomes small. The proposed method is fast because it trains first the facial parts and then facial features within the facial part like a coarse to fine fitting and each CNRN is relatively simple. The proposed method is highly accurate because it trains the facial features iteratively by performing the local regression on the facial features and the global regression on the warped appearance image. In the experiments, the proposed method will yield more accurate and stable face alignment or tracking under heavy occlusion and large pose variation than the existing the state of the art methods and run in the real-time. Recent Publications: 1. Ahmad Jalal, Yeon Ho Kim, Yong Joong Kim and Daijin Kim (2017) Robust human activity recognition from depth video using spatiotemporal multi-fused features. Pattern Recognition 61:295-308. 2. Inho Choi and Daijin Kim (2017) A variety of local structure patterns and their hybridization for accurate eye detection. Pattern Recognition 61:17-432. 3. Jongju Shin and Daijin Kim (2016) Robust face alignment and tracking by combining local search and global fitting. Image and Vision Computing 51:69-83. 4. Jongju Shin and Daijin Kim (2014) Hybrid approach for facial feature detection and tracking under occlusion. IEEE Signal Processing Letters 21(12):1486-1490. 5. Bongjin Jun, Inho Choi and Daijin Kim (2013) Local transform features and hybridization for accurate face and human detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(6):1423-1436.

Ask about this article

Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.

Try:

Similar by topic

More from this journal

The newest in Journal of Computer Engineering & Information Technology.

All its articles

Conferences in this field

Upcoming conferences in this field.

Follow

New articles from what you follow go into your email digest, once you agree to alert emails.

  • JournalJournal of Computer Engineering & Information Technology
  • SubjectComputer Science & IT
  • SubjectEngineering
  • BylineArticles whose byline prints “Daijin Kim”

For authors and organisers

Publish, present and keep up with your field

Find the right journal for your paper and submit your manuscript.

Photo: Pexels