Music video with AI generated art

Fri Nov 04, 2022 4:27 pm

Another visualization I created for my own music.

Ingredients:
  • AI-generated images, created with Stable Diffusion (see https://github.com/CompVis/stable-diffusion). The images are based on the lyrics of the song.
  • Morphing the images into a huge animation sequence (in this case 4320 images) and creating a video out of it
  • Controlling the video via MMV to synchronize it with the music. This part was quite tricky, as a lot of speed changes are required to make the right part of the movie play at the right time. Next time I have to find a better and less time consuming way to do this.
  • Adding some blinky stuff via MMV
  • Done
Not 100% perfect, but does the job: https://www.youtube.com/watch?v=ZLgQ-sk43IM
TKS
 
Posts: 111
Joined: Mon May 17, 2021 10:40 am

Re: Music video with AI generated art

Tue Nov 08, 2022 7:38 pm

[apologies for hijacking your post] No MMV in this one but this is a recent visual I created for a live gig using stable diffusion. Separate SD sequences spliced together in an regular video editor.

[media]
Sadler
 
Posts: 1020
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Re: Music video with AI generated art

Fri Nov 11, 2022 3:41 pm

Sadler wrote:[apologies for hijacking your post] No MMV in this one but this is a recent visual I created for a live gig using stable diffusion. Separate SD sequences spliced together in an regular video editor.

No problem. As you already wrote over at YouTube, there's a huge market for those AI generated images and videos, a) because they are amazing, and b) because you don't have to worry about copyright issues.
MMV is still my preferred choice for controlling everything, though 8-)
TKS
 
Posts: 111
Joined: Mon May 17, 2021 10:40 am

Return to User-Submitted Videos

© 2022 Color & Music, LLC • This web site is mobile-friendly