Identity authentication on mobile devices using face verification and ID image recognition

Identity authentication is of great importance in the digital age where ID information is commonly used in finance, insurance, transportation and other fields. Challenges of identity authentication lie in the verification of the ID card provided by the user and the information extraction from the user's ID card. To meet the challenge, an identity authentication framework is proposed, which can extract and verify personal information through face verification and ID image recognition. The identity authentication is realized by the proposed face verification model which is called Inception-ResNet Face Embedding (IRFE). IRFE uses an Inception-ResNet structure to ensure a good feature extraction aiming at accurate face verification. Moreover, a robust ID card extraction method named Morphology Transformed Feature Mapping (MTFM) is proposed to extract ID information. Experimental results demonstrate that the proposed IRFE and MTFM outperform state-of-the-art methods both in face verification and in ID extraction.