Laugh now, but this could ultimately see the end of your foley job at DVinfo.net
DV Info Net

Go Back   DV Info Net > The Tools of DV and HD Production > All Things Audio

All Things Audio
Everything Audio, from acquisition to postproduction.

Reply
 
Thread Tools Search this Thread
Old August 17th, 2020, 05:55 AM   #1
Equal Opportunity Offender
 
Join Date: Feb 2009
Location: Brisbane, Australia
Posts: 2,779
Laugh now, but this could ultimately see the end of your foley job

If the latest A.I. ("machine learning" in reality) software developments continue, doing foley might be possible with merely a plugin.

From https://spectrum.ieee.org/tech-talk/...fects-are-real

"Using machine-learning, AutoFoley determines what actions are taking place in a video clip and creates realistic sound effects"

and more specifically ...

"In a more recent plot twist, researchers have created an automated program that analyzes the movement in video frames and creates its own artificial sound effects to match the scene. In a survey, the majority of people polled indicated that they believed the fake sound effects were real. The model, AutoFoley, is described in a study published June 25 in IEEE Transactions on Multimedia."

The first linked article comes with embedded YouTube samples.

Andrew
Andrew Smith is offline   Reply With Quote
Old August 17th, 2020, 11:43 AM   #2
Slash Rules!
 
Join Date: Apr 2002
Location: Houston, Texas
Posts: 5,472
Re: Laugh now, but this could ultimately see the end of your foley job

I have no doubt that it could work, but unless the AI also accounts for the artistic aspects of the sounds, I dont think itíll replace a person.

Iím talkin perspective (how should that footstep sound based on the shot size etc, how much should it echo due to the environment, and theres even something to be said for the quality of the sounds. Should the sound be ominous? Cheery? Etc. Sometimes perfect realism will not be what a director wants, in the name of mood/atmosphere etc. and I dont see how a machine would know that sort of thing.
Josh Bass is offline   Reply With Quote
Old August 17th, 2020, 11:45 AM   #3
Inner Circle
 
Join Date: Nov 2005
Location: Lowestoft - UK
Posts: 3,807
Re: Laugh now, but this could ultimately see the end of your foley job

All the clever tools fall down when there's a technologist in charge instead of an artist.
Paul R Johnson is offline   Reply With Quote
Old August 19th, 2020, 05:15 AM   #4
Trustee
 
Join Date: Dec 2006
Location: Central Coast - NSW, Australia
Posts: 1,566
Re: Laugh now, but this could ultimately see the end of your foley job

I can see some screaming funny shit coming from this
__________________
Cheers - Paul M.
www.perbenyik.com
Paul Mailath is offline   Reply With Quote
Old August 19th, 2020, 07:07 AM   #5
Slash Rules!
 
Join Date: Apr 2002
Location: Houston, Texas
Posts: 5,472
Re: Laugh now, but this could ultimately see the end of your foley job

Quite literally maybe if the AI is watching a Cronenberg film
Josh Bass is offline   Reply
Reply

DV Info Net refers all where-to-buy and where-to-rent questions exclusively to these trusted full line dealers and rental houses...

B&H Photo Video
(866) 521-7381
New York, NY USA

Scan Computers Int. Ltd.
+44 0871-472-4747
Bolton, Lancashire UK


DV Info Net also encourages you to support local businesses and buy from an authorized dealer in your neighborhood.
  You are here: DV Info Net > The Tools of DV and HD Production > All Things Audio

Thread Tools Search this Thread
Search this Thread:

Advanced Search

 



All times are GMT -6. The time now is 12:59 PM.


DV Info Net -- Real Names, Real People, Real Info!
1998-2021 The Digital Video Information Network