Laugh now, but this could ultimately see the end of your foley job

[Andrew Smith]

If the latest A.I. ("machine learning" in reality) software developments continue, doing foley might be possible with merely a plugin.

From https://spectrum.ieee.org/tech-talk/...fects-are-real

"Using machine-learning, AutoFoley determines what actions are taking place in a video clip and creates realistic sound effects"

and more specifically ...

"In a more recent plot twist, researchers have created an automated program that analyzes the movement in video frames and creates its own artificial sound effects to match the scene. In a survey, the majority of people polled indicated that they believed the fake sound effects were real. The model, AutoFoley, is described in a study published June 25 in IEEE Transactions on Multimedia."

The first linked article comes with embedded YouTube samples.

Andrew

[Josh Bass]

I have no doubt that it could work, but unless the AI also accounts for the artistic aspects of the sounds, I dont think it’ll replace a person.

I’m talkin perspective (how should that footstep sound based on the shot size etc, how much should it echo due to the environment, and theres even something to be said for the quality of the sounds. Should the sound be ominous? Cheery? Etc. Sometimes perfect realism will not be what a director wants, in the name of mood/atmosphere etc. and I dont see how a machine would know that sort of thing.

[Paul R Johnson]

All the clever tools fall down when there's a technologist in charge instead of an artist.

[Paul Mailath]

I can see some screaming funny shit coming from this

[Josh Bass]

Quite literally maybe if the AI is watching a Cronenberg film