Lip Sync Control

Captue a phrase to audio and gets its phoneme set and timings. Then apply an array to a figure that strips the array of phonemes and timing and plays the correct frame for the phoneme at the correct time. OS X has an app that will generate up to 100 phonemes in the Developer/Utilities/Speech directory named Repeat After Me.app with documentation on generating timing and arrays of phonemes which are then in animations applied to viseme frames (2D) or morphs (3D) . Visemes would be the visual representation of the phonemes.