Making an AI music video to a song of mine live from start to finish

Introduction

In today’s digital landscape, creating art with technology becomes an exciting exploration of creativity. My name is Niik Nikol Cler, and I am the founder of an AI animation platform called Neur Frames. During a recent live stream, I embarked on an intriguing journey to create an AI-generated music video for an old song of mine—bringing together a mix of nostalgia and technological prowess.

The Journey Begins

The live stream commenced with silence and the echoes of virtual applause. While previously I had only attempted one live stream that was interrupted by a fire alarm, this session was a good opportunity to engage with viewers across YouTube, X, and Facebook Live.

Background: I stumbled upon an old song that I had composed over a decade ago. It was an experimental synthesis of my musical journey, one that I believed had dizzyingly faded from memory. But lo and behold, after multiple computer changes and backups, I uncovered this long-lost piece. Eager to merge my creative past with cutting-edge AI technology, I hatched a plan to translate the song into a visually stunning music video.

Step-by-Step Exploration

1. Finding Style References: My first task was to find a suitable style reference code from various genres of visual art. This led me to MidJourney—an image generation platform. I searched through social media to find inspiration for the visuals, choosing references that captured a surreal, dreamlike quality.

2. Creating Custom Images: Uploading dozens of generated images that adhered to this aesthetic, I aimed to create a unique AI model that encapsulated the essence of my music. Although aiming to upload 200 images seemed ambitious, I settled for around 50, making the process feel less daunting.

3. Training the AI Models: With the selected images ready, I commenced the training phase on Neur Frames, allowing the AI to learn from the art styles I had gathered. This process typically ranged from five to ten minutes, giving me ample time to interact with my live audience.

4. Composition of Visuals: As the song began, I implemented various visual prompts. The AI generated vibrant, abstract visuals that echoed the song's mood—requiring thoughtful adjustments regarding camera motion, styles, and transitions. The imagery took the audience on a swift journey through nostalgic cityscapes, rainy streets, and Kafka-esque reflections of humanity.

5. Finalizing the Music Video: After layering in intricate components from the song, such as synthesizers and vocals, it became clear that I needed to integrate an additional element of suspense and creativity—a portal into an aquatic world. My idea was to portray closing scenes in a mysterious underwater realm with surreal creatures, expanding the narrative canvas even further.

6. The Grand Finale: Building towards the end, I planned a dramatic conclusion by zooming in on the vibrant visuals created, resulting in an unforgettable visual climax. The energy surged through the live stream as viewers witnessed the synthesis of sound and sight, ultimately concluding with whispers of blackness—circling back to the theme of the forgotten past.

Upscaling and Conclusion

With the video finally exported and ready for upscaling, I ended the live stream with a sense of deep fulfillment. The interaction with viewers and the resulting art offered a glimpse into the synergy of human creativity and AI possibility.

Keywords

• AI Animation
• Music Video
• Neural Frames
• MidJourney
• Custom Models
• Visual Art
• Sound Synthesis
• Live Streaming
• Creative Process

FAQ

Q1: What is Neur Frames?
A1: Neur Frames is an AI animation platform that allows users to create custom animation and video content through machine learning.

Q2: How did you create the AI music video?
A2: I started by gathering style references from MidJourney, uploaded images to train a model on Neur Frames, and then crafted visuals to complement my song.

Q3: What kind of song did you choose?
A3: The song is a personal piece I composed over a decade ago, embodying themes of nostalgia and exploration.

Q4: Can anyone create their own AI music videos?
A4: Yes! With platforms like Neur Frames, anyone can explore AI tools to create their unique videos, provided they have access to images and a creative vision.

Q5: What technical skills are necessary to use Neur Frames?
A5: Familiarity with AI basics and some understanding of visual prompts may help, but the platform is designed to be user-friendly for creators at different skill levels.