Dragon daydream

Mon Dec 06, 2021 12:16 am

Only the final few steps done in Magic.
[media]
Sadler
 
Posts: 964
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Re: Dragon daydream

Mon Dec 06, 2021 2:08 am

impressive! Kind of fractal Dragon.
If only last step done in Magic, what do you use before?
skarabee
 
Posts: 122
Joined: Fri Aug 28, 2015 3:11 am

Re: Dragon daydream

Mon Dec 06, 2021 7:24 am

The visual is using a PyTorch ML script called Illustrip and the music is composed by AIVA. There are better scripts but I don't have the hardware to run them.

Maybe obvious to most, Magic was used to react, pace and match the video to the music plus a little prost-processing.
Sadler
 
Posts: 964
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Re: Dragon daydream

Mon Dec 06, 2021 8:52 am

Sadler wrote:The visual is using a PyTorch ML script called Illustrip and the music is composed by AIVA. There are better scripts but I don't have the hardware to run them


Being a lifetime fan of surrealistic art I like this a lot. I've never heard of Illustrip before. What hardware did you use and how long did it need to render this?
As a Linux user :ugeek: I hate to ask: does it run on Windows? Because of the software I use my multimedia computer is the only one in my house running WIndows and therefore has the juicy hardware needed for that.

BTW, I'm playing around with AIVA as well, when you need original music for your videos it's a great help and source for inspiration!
TKS
 
Posts: 95
Joined: Mon May 17, 2021 10:40 am

Re: Dragon daydream

Mon Dec 06, 2021 10:12 am

Yes, it is running on Windows but I understand its an easier job to setup on Linux. This script runs on my laptop with an RTX 2080 8GB and this script took about 5 hours, if I remember correctly. You absolutely need NVidia because CUDA. The major limitation isn't the GPU (though it is required) it is the memory it has. 8GB is the very minimum, 12 would be better, 24 in a 4090 would be great. One day perhaps.
Sadler
 
Posts: 964
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Re: Dragon daydream

Tue Dec 07, 2021 9:38 pm

Did you use AdaBins for the 3D effect? I'm just testing Aphantasia, it's cool but doesn't looks like yours.

Edit: nevermind, I've used the (official) release v1.2b, which doesn't has illustrip.py.

Cloning the master branch did the job 8-)

Edit 2: care to share the text you've used? Is it in general better to have real sentences or just single words per line? Repeat important words to have one theme or does it remember what was in the first few lines?
TKS
 
Posts: 95
Joined: Mon May 17, 2021 10:40 am

Re: Dragon daydream

Wed Dec 08, 2021 12:20 am

Sure, the texts were all two word phrases containing the word dragon, e.g. Chinese Dragon etc. As far as I can tell, the concepts are broadly mixed between scene changes and even persist longer. I haven't experimented enough to know the optimal phrases yet - working on it.
Sadler
 
Posts: 964
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Re: Dragon daydream

Tue Dec 21, 2021 2:22 am

Sadler wrote:The visual is using a PyTorch ML script called Illustrip and the music is composed by AIVA. There are better scripts but I don't have the hardware to run them.

Maybe obvious to most, Magic was used to react, pace and match the video to the music plus a little prost-processing.


These fractal style morphs are amazing! I did a quick search on Illustrip and did not find anything I felt safe to click on. Any insight on how to get Illustrip and if it is difficult to use?
Vegadeth
 
Posts: 12
Joined: Fri Feb 10, 2017 3:13 am
Location: United States

Re: Dragon daydream

Tue Dec 21, 2021 3:48 pm

Check out Nerdy Rodent (and others) on YT who has some tutorials about how to set up and environment for running the python scripts - specifically for ML based art. The main steps are: install WSL, Anaconda and CUDA. Set up a conda (anaconda) environment and within that install (using pip or conda) the requirements (python, numpy etc) for your chosen repository.

Alternatively, find a colab. Here's the colab for Illustrip:
https://colab.research.google.com/githu ... ip3D.ipynb

The current daddy of the ML video art is PyTTI which you'll see a lot of on the various socials. It also has a colab but it is currently behind a patreon paywall.
Sadler
 
Posts: 964
Joined: Sat Aug 02, 2014 7:10 pm
Location: London, UK

Return to User-Submitted Videos

© 2022 Color & Music, LLC • This web site is mobile-friendly