Improving the performance of one-shot face recognition by using data augmentation

Authors

  • HIEU N. DUONG HCMUT
  • Trong Nguyen Thanh HCMUT
  • Thi Tran Thi Truong Hoa Sen University
  • Kien Luong Gia HCMUT
  • Hoa Tran Van HCMUT
  • Nam Thoai HCMUT

Keywords:

One-shot face recognition, CCTV, ISE, ASE

Abstract

For a past few years, the revolution of deep learning techniques has emerged and launched several state-of-the-art models, for instance, the breakthroughs of DeepFace and DeepID to face recognition in 2014. The face recognition in CCTV systems commonly encounters a few obstacles coming from practical conditions, such as ambient light, the diverse positions and angles of cameras, face masks, face poses, and so on. In addition, people who are monitored by the CCTV systems lack photos and typically have only one photo. These problems lead to face recognition reported with unstable performance and difficult to be successfully used in practice. To tackle these problems, this paper proposes an approach, namely ISE, to face augmentation which interpolates multiple samples from an original photo. Particularly, the samples produced by ISE contain real characteristics of cameras in the CCTV systems. By practically deploying a CCTV system at the Bach Khoa Dormitory, ISE indicates that it can boost the performance of face recognition up from 72%, 46% to 84%, 64% in daytime and day-and-nighttime, respectively.

References

Yaniv Taigman, Ming Yang, Marc Aurelio Ranzato, and Lior Wolf. Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1701–1708, 2014.

Yi Sun, Xiaogang Wang, and Xiaoou Tang. Deep learning face representation by joint identification–verification. arXiv preprint arXiv:1406.4773, 2014.

Jingtuo Liu, Yafeng Deng, Tao Bai, Zhengping Wei, and Chang Huang. Targeting ultimate accuracy: Face recognition via deep embedding. arXiv preprint arXiv:1506.07310, 2015.

Matthew Turk and Alex Pentland. Eigenfaces for recognition. Journal of cognitive neuroscience, 3(1):71–86, 1991.

Dong Chen, Xudong Cao, Fang Wen, and Jian Sun. Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3025–3032, 2013.

Mei Wang and Weihong Deng. Deep face recognition with clustering based domain adaptation. Neurocomputing, 393:1–14, 2020.

Xiang Wang, Kai Wang, and Shiguo Lian. A survey on face data augmentation for the training of deep neural networks. Neural computing and applications, pages 1–29, 2020.

Jiankang Deng, Jia Guo, Yuxiang Zhou, Jinke Yu, Irene Kotsia, and Stefanos Zafeiriou. Retinaface: Single-stage dense face localisation in the wild. arXiv preprint arXiv:1905.00641, 2019.

Zaheer Shaik and Vijayan Asari. A robust method for multiple face tracking using kalman filter. In 36th Applied Imagery Pattern Recognition Workshop (aipr 2007), pages 125–130. IEEE, 2007.

Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4690–4699, 2019.

Wei Dong, Charikar Moses, and Kai Li. Efficient k-nearest neighbor graph construction for generic similarity measures. In Proceedings of the 20th international conference on World wide web, pages 577–586, 2011.

James MacQueen et al. Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, volume 1, pages 281–297. Oakland, CA, USA, 1967.

Downloads

Published

2022-01-29

How to Cite

N. DUONG, H., Nguyen Thanh, T., Tran Thi Truong, T., Luong Gia, K., Tran Van, H. ., & Thoai, N. (2022). Improving the performance of one-shot face recognition by using data augmentation. International Journal of Machine Learning and Networked Collaborative Engineering, 4(4), 162–170. Retrieved from https://mlnce.net/index.php/Home/article/view/169