Super-Low Resolution Face Recognition using Integrated Efficient Sub-Pixel Convolutional Neural Network (ESPCN) and Convolutional Neural Network (CNN)

Saif Al-din M. Najim

Article Link , Download PDF

Abstract: Several deep image-based models, which depend on deep learning, have shown great success in the recorded computational and reconstruction efficiencies, especially for single high-resolution images. In the past, the use of super resolution was commonly characterized by interference, and hence, the need for a model with higher performance. This study proposed a method for low to super-resolution face recognition, called efficient sub-pixel convolution neural network. This is a convolutional neural network which is usually employed at the time of image pre-processing to increase the chances of recognizing images with low resolution. The proposed Efficient Sub-Pixel Convolutional Neural Network is used for the conversion of low-resolution images into a high-resolution format for onward recognition. This conversion is based on the features extracted from the image. Using several evaluation tools, the proposed Efficient Sub-Pixel Convolutional Neural Network recorded a higher performance in terms of image resolution when compared to the performance of the benchmarked traditional methods. The evaluations were carried out on a Yale face database and ORL dataset faces. For Yale and ORL datasets, the obtained accuracy of the proposed method was 95.3% and 93.5%, respectively, which were higher than those of the other related methods.

Keywords: Super-Resolution (SR), Face Recognition, Low Resolution (LR), Deep Learning

References:

M.W. Thornton, P.M. Atkinson, and D. Holland, “Sub˜ pixel mapping of rural land cover objects from fine spatial resolution satellite sensor imagery using super˜ resolution pixel˜ swapping”. International Journal of Remote Sensing, 2006. 27(3): p. 473-491.

B.K. Gunturk, “Eigenface-domain super-resolution for face recognition. IEEE transactions on image processing”. 2003. 12(5): p. 597-606.

S. Peled and Y. Yeshurun, “Superresolution in MRI: application to human white matter fiber tract visualization by diffusion tensor imaging”. Magnetic resonance in medicine, 2001. 45(1): p. 29-35.

W. Shi, J. Caballero, C. Ledig, X. Zhuang, W. Bai, K. Bhatia, K. and D. Rueckert, “Cardiac image super-resolution with global correspondence using multi-atlas patchmatch.” In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 9-16). Springer, Berlin, Heidelberg, 2013.

S. Borman and R.L. Stevenson. “Super-resolution from image sequences-a review. in Circuits and Systems”, 1998. Proceedings. 1998 Midwest Symposium on. 1998. IEEE.

S. Farsiu, M. D. Robinson, M. Elad and P. Milanfar. “Fast and robust multiframe super resolution”. IEEE transactions on image processing, 13(10), 1327-1344. 2004.

S. Awang, J. Sulaiman, N. Noor, K. Mohd and L. Bayuaji, L. “Comparison of accuracy performance based on normalization techniques for the features fusion of face and online signature”. Advanced Science Letters, 23(11), 2017, 11233-11236.

M. Furqan, A. Embong, S. Awang, S. W. Purnami and S. Sembiring. “Smooth support vector machine for face recognition using principal component analysis”. Proceeding 2nd International Conference On Green Technology and Engineering (ICGTE), 2009, 193-198.