Correlating video images of lip movements with audio signals to improve speech recognition

Abstract

A speech recognition device can include an audio signal receiver configured to receive audio signals from a speech source, a video signal receiver configured to receive video signals from the speech source, and a processing unit configured to process the audio signals and the video signals. In addition, the speech recognition device can include a conversion unit configured to convert the audio signals and the video signals to recognizable speech, and an implementation unit configured to implement a task based on the recognizable speech.

1 . A method of speech recognition, said method comprising the steps of: receiving audio signals from a speech source;
 receiving video signals from the speech source;   processing the audio signals and the video signals;   converting the audio signals and the video signals into recognizable information;   implementing a task based on the recognizable information.   
   
   
       2 - 15 . (canceled)