For anyone interested - Here's a more lengthy video with a deeper description of the tool set in the comments (included)
https://vimeo.com/rdrt/hybridanalogWhat is SPECTRUM?
- It's a Hybrid Analytical Engine implementation, focused on auditory changes, providing rigging output via MMVs many paths
- Spectrum listens to live input and creates a "real time" VJ mix, matching the tone of the song to the tone of the media displayed, utilizing rules to present media in a music video style structure
- Presented via a series of scenes, containing modules and global references in MMV
- Comprised of a number of globals, aka "analog" shift and hold registers and weighted if statements
- It is designed to be supported by several GPUs, allowing a continuously refresh-able matrix of images via Stable Diffusion (or whatever input media).
Main Scene Features
- History vs Input Mixing for Tone, Pitch and (8x) Octaves
- History vs Input Mixing for (4x) Octave Pairs, aka Actors
Functions
- Listens to input
- Creates Globals for capturing pitch, tone and (8x) octaves over 40+ bars History
- Creates Globals for mixing Pitch and Tone History vs input
- Attempts capture of BPM, leaves global rigging for improvement
- Attempts capture of Song Structure and Structure History over period (GBLVol0 > 0)
- Creates Globals for Song Structure comparison to input
- Attempts capture of (8x) Octave Structure, History, Significant Break vs input
- Creates Globals for (8x) Octave comparison to input
- Attempts to capture "Actor" movement by grouping (8x) octaves into (4x) actors
- Creates three mixing outputs based on actors, leaves rigging for improvement
Bonus Points
- Rigged for real-time refresh of media content
- Diagnostic Scenes for all Globals and Components
- Digit Counter Integration
- Snip Integration
- etc.
OOh/AAh
- Over 750 Globals (Analog Shift Registers ftw)
- NVidia 30x Gen or more for predictable performance
rdrtlabs
*Everything_is_always_WIP
hybrid analog is where it all goes down.