Audio visual speech recognition

A method and apparatus for indicating at least some of asequence of spoken phonemes in which detected sounds are analyzedto determine a group of phonemes to which a phoneme belongs, thelipshape is optically detected and the respective signalscorrelated by a computer to indicate the detected phoneme.

Beadles, R. (1988). IPC No. U.S. Audio visual speech recognition. (Patent No. 4757541).