USER AUTHENTICATION METHOD AND APPARATUS BASED ON AUDIO AND VIDEO DATA

摘要

A computer-implemented method is performed at a server having one or more processors and memory storing programs executed by the one or more processors for authenticating a user from video and audio data. The method includes: receiving a login request from a mobile device, the login request including video data and audio data; extracting a group of facial features from the video data; extracting a group of audio features from the audio data and recognizing a sequence of words in the audio data; identifying a first user account whose respective facial features match the group of facial features and a second user account whose respective audio features match the group of audio features. If the first user account is the same as the second user account, retrieve the sequence of words associated with the user account and compare the sequences of words for authentication purpose.

主权项

1. A computer-implemented method, comprising:
at a server having one or more processors and memory storing programs executed by the one or more processors:
receiving a login request from a mobile device, the login request including video data and audio data;extracting a group of facial features from the video data;extracting a group of audio features from the audio data and recognizing a sequence of words in the audio data;identifying, in a user account database, a first user account whose respective facial features match the group of facial features according to first predefined criteria;identifying, in the user account database, a second user account whose respective audio features match the group of audio features according to second predefined criteria;if the first user account is the same as the second user account:
comparing the recognized sequence of words with a predefined sequence of words associated with the first user account; andauthenticating the login request if the recognized sequence of words matches the predefined sequence of words according to third predefined criteria;if the first user account is different from the second user account:
returning a response to the mobile device, indicative of the denial of the login request.