Dummy
2024, Voice User Interface, Video, 6:05
Ventriloquy is the art of making one's voice appear to come from somewhere else.
Dummy is a voice user interface that explores the mouth as a visual language we read and have programmed how it should behave.
Using lip synchronization software, the interface or dummy uses audio amplitude and phonemes to approximate a mouth shape known as a viseme: a visual equivalent of a phoneme or unit of sound in spoken language, creating a general facial image that can be used to describe a particular sound.
Separating the sound and shape, the simulation uses viseme misalignments to generate elaborate facial shapes, expressions, and new meaning.
The video uses audio from an interview with Crazy Minnow Studio, creators of SALSA Lip-Sync an animation tool used to puppeteer character mouths in video games in 3D simulations.
Thank you to Crazy Minnow Studio