Keeper of Stardust

Описание: Music 🎵
KEWL - Keeper of Stardust

Playlists 🤘
Lyric Videos:    • Lyric Videos  
Music Videos:    • Music Videos  
KEWL Stuff: https://open.spotify.com/playlist/57I...

Link Tree: https://hyperfollow.com/killemwithlove

Lyrics 🎶


Tools 🛠️
ChatGPT for idea and prompt generation
ComfyUI for image/video workflows
Flux for image generation
Stable Diffusion Deforum and AnimateDiff for moving animations
MiniMax for image to video
Adobe Premiere Pro for editing
After Effects for lyrics, audio reactive effects and colors
Suno for AI music production: https://suno.com/invite/@kewl
Distrokid for music distribution: https://distrokid.com/vip/seven/8374979

Process 🪄
1. Finding fitting stable diffusion prompts for the music video.
I ask ChatGPT to give me fitting prompts based on the lyrics I feed it. I test the outputs and make changes based on the results from img2img generations with Stable Diffusion. I also try out different models and Loras to find outputs I like.

2. Getting music reactive keyframes for the animation.
I give the song to this audio keyframe tool: https://www.chigozie.co.uk/audio-keyf... and give it suitable functions for the values I want. I personally use 25 frames per second, something like “0.60 - x^6” for strength schedule and “1 + x*10” for Translation Z in 3D mode. I often play around with these settings and also give the 3D rotations different functions to react to.

3. Setting up a render in Deforum.
Now I enter the keyframes and prompts into Deforum to start generating an animation. I usually do this 4 times with slightly tweaked settings and prompts to get different results to work with later.

4. Editing in Premiere Pro.
To get a more dynamic video, I cut between the different animations in a multicam sequence, picking the best parts and cutting to the music.

5. Finishing up in After Effects.
In After Effects I manually add the lyrics, timing and dividing them as I see fit. I also add a bunch of effects like additional 3D camera movements, shakes, overlays, particles, blur and chromatic aberration. Most of these are made to react to the music through generated audio keyframes.

#musicvideo #musicvisuals #audioreact