Sound level determining the frame(number) of a video

Thu Jun 20, 2019 7:05 pm

Imagine a short animation.
I want the sound level to determine which frame is shown

For example:
Silence is frame 0
Maximum level shows frame 100

This way the sound level can drive a pre-rendered animation.
Is this possible? As I can't figure out how/where to do this.

The application possibilities would be endless!!
BenLiebrand
 
Posts: 6
Joined: Wed May 25, 2016 11:50 pm

Re: Sound level determining the frame(number) of a video

Thu Jun 20, 2019 7:30 pm

There are a few different ways to do this. The most efficient, most accurate, and probably easiest, is to use the JpegFolder module.

You will need some sort of video editing or encoding software to save your animation as a series of .jpg images.

Then, just use the JpegFolder module, and select the folder where you saved the .jpg's. The Index parameter controls which image # to display. So if you have 100 images, then you could link the Index to the Volume, and add a Scale modifier to scale the Volume by 100.

Make sense?

An alternative solution (without re-encoding your video) is to use the VideoFile module, and use the Start Time parameter in conjunction with the Goto Start parameter, similar to what this user did (but not exactly the same): viewtopic.php?f=2&t=1650&p=7641. However, you have to be careful about the video format. Formats like .mp4 are not meant to be played backward or to jump quickly to exact frame numbers, and you will get bad performance. Ideally you should use Motion JPEG or Hap, which encode every frame as a keyframe.
Eric
Site Admin
 
Posts: 2605
Joined: Wed Apr 09, 2014 9:28 pm

Re: Sound level determining the frame(number) of a video

Tue Jun 25, 2019 12:55 am

Thanks!
BenLiebrand
 
Posts: 6
Joined: Wed May 25, 2016 11:50 pm

Return to General Discussion

© 2019 Color & Music, LLC • This web site is mobile-friendly