Talking to Objects 2024 - Ongoing, Dataset, Video with Lambda Vue

Computer vision models can recovers speech from the vibrations off objects. Using Lambda Vue, a software that amplifies small motions in video, and a microscope, the project captures microscopic voice markers from material vibrations. In this case study, tinfoyl (phonetic writing) is spoken to tinfoil, generating a visual dataset that matches each graphemes (letters) and phonemes (sounds).

With Caro Trigo, Mavis Yue Cao, Christie Wu

Video that visualizing the vibrations of speech. Saying tinfoil over tinfoil. Before and after Lamda Vue software processing

Tinfoil grid to define spoken phenomes and visual letters.

Separating each frame and phenome

TYPE SPECIMEN - Tinfoil

‘T’ frames

Identifying ‘T’ sound markers and characteristics in the material

Selecting high contrast markers for each phenome

Identifying sound markers and characteristics in the material

Sound markers

Microscope setup

Microscope setup in Immersion Lab

Video that visualizing the vibrations of speech on a strawberry.

HOUSE — Jenny Rodenhouse

designer — educator

[id="Q1004802321"] bodycopy { } [id="Q1004802321"].page { --page-mix: normal; background-color: #ffffff; } .overlay-content:has([id="Q1004802321"]) { --overlay-mix: normal; } [id="Q1004802321"] .page-content { border-radius: 0rem; background-color: #ffffff; }