Soulweaver – Music Video with A.I. Visuals

Soulweaver is an original composition, written and performed by Austin Clark (Prestige Edition).

Buy the Song:
austinclark.bandcamp.com/track/soulweaver

Buy the Sheet Music:
austinclark.bandcamp.com/merch/soulweaver-sheet-music-pdf

The visuals were created using Disco Diffusion v5.6, an advanced A.I. that generates images from text prompts (similar to DALL-E2, VQGAN+CLIP, Midjourney, etc). The internet is going crazy with these!! The Python notebook I used can be accessed for FREE on the Google Colab platform:

https://colab.research.google.com/github/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb

During sections of the video, I uploaded frames from a recording of myself, before providing the A.I. with a more general text prompt (“dull charcoal drawing,” or “watercolor painting,” etc). The more dynamic animations were created with more specific prompts (“colorful watercolor painting of a lush desert at sunrise,” etc), along with instructions for how the camera should move between each frame. The final images were then upscaled using a separate A.I. (ESRGAN, using the fatal_anime model by twittman). Other programs used: Adobe Premiere CC, Adobe Audition CC, Adobe Photoshop CC, Presonus Studio One, Sound Magic Neo Piano One, and Avid Sibelius. The video was recorded with an iPad Pro.