Page 1 of 1

Video Spectrum

Posted: Wed Oct 18, 2023 8:41 pm
by Sadler
I had been thinking of an idea for a new suggestion for sprite sheets and related type effects. While trying to clarify that idea I discovered it can already be done. Here's one example that creates a video based spectrum effect.
_
...
I still have to explore what else can be done with this technique. It is a bit heavy on the GPU but has wide-ranging potential.

Re: Video Spectrum

Posted: Thu Oct 19, 2023 7:13 am
by Terry Payman
A really cool effect. Very inspiring.

Thanks Sadler! :D

Re: Video Spectrum

Posted: Thu Oct 19, 2023 1:48 pm
by TKS
This is amazing, so smooth and really well done.
Care to share some more details on how it's done?

Re: Video Spectrum

Posted: Thu Oct 19, 2023 7:01 pm
by Sadler
It is actually really simple. The basic idea is to find ways to move two or more polygons after applying them as a mask to some content. Trouble is, in order to mask one image (e.g. sprite sheet) or video to a group of polygons, they need to be 'grouped' as one. You can get around this by masking each polygon multiple times with the same image/video.
...
sprite-sheet.png
sprite-sheet.png (109.07 KiB) Viewed 20747 times
This arrangement locates 9 polys across a 3x3 sprite sheet, masks each sprite (the bird in various poses), then moves them, in this case, to the centre.

The InputSelector then plays each sprite in turn, animating the bird - but you could do any transform you like.

The fun starts when using an iterator. With an iterator you have the advantage of laying out all your polys according to iteration#, masking everything at once, then transform again using iterator#. Turn sprites into particles, turn video/images into spectrums and possibly other applications I haven't thought of.

As I said, not to most efficient process but even with 80 iterations (= 80 masks) for the demo spectrum, I can achieve 60fps on a 2080. Maybe Magic devs could come up with a way to make this more efficient and even simpler.

Re: Video Spectrum

Posted: Thu Oct 26, 2023 2:38 pm
by SpaceTraveller
Very interesting - thanks for posting - would be nice for the actual mmv file to dive straight in ;)

Re: Video Spectrum

Posted: Sun Oct 29, 2023 11:21 am
by Sadler
It would be better for everyone, if those who are inspired or even just mildly interested, to try to recreate or adapt interesting effects - on here or elsewhere - and to post results. Even if mistakes are made, serendipity is strong in this activity and you get the benefit of learning for yourself, not to mention finding bugs, pinch-points and new workflows which feed back and make this software even more amazing and fun.[/rant]

Here is a minimal network for the spectrum - I'm sure some of you could have worked this out.
Annotated network to create spectrum effect
Annotated network to create spectrum effect
Screenshot 2023-10-29 110036.png (89.56 KiB) Viewed 20576 times

Re: Video Spectrum

Posted: Sun Oct 29, 2023 4:19 pm
by SpaceTraveller
Hopefully will do - thanks 👍

Re: Video Spectrum

Posted: Mon Nov 06, 2023 10:10 am
by damstraversaz
that's beautiful, congratulations !