Researchers extract audio from potato chip bag and other vibrating objects in video recordings

Salt and vinegar chipsResearchers at MIT, Microsoft, and Adobe have developed an algorithm that can reconstruct an audio signal from minute vibrations of objects in a video recording, including recovering intelligible speech from the vibrations of a potato-chip bag photographed 15 feet away through soundproof glass.

The researchers also successfully extracted audio from video of aluminum foil, the surface of a glass of water, and the leaves of a potted plant.

I wonder whether the technique might become sensitive enough to capture sound from old silent movies, newsreels, and home movies.

Extracting audio from visual information: Algorithm recovers speech from the vibrations of a potato-chip bag filmed through soundproof glass

Photo: Salt-and-Vinegar, by Gerolsteiner91. Licensed under CC BY-SA 2.5 via Wikimedia Commons

Advertisements

One thought on “Researchers extract audio from potato chip bag and other vibrating objects in video recordings

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s