Week 4 - Creative Exploration with AI Video & Audio
People & Blogs
Introduction
In Week 4 of my creative exploration with AI video and audio, I focused on generating a short how-to video on the theme of romantically riding bicycles in the countryside. This project required careful planning and multiple iterations to achieve a satisfying result.
Iteration Process
The first task involved generating a 10 to 30-second video with an AI tool called Runway. Initially, I crafted a detailed prompt that included specific elements like scenes, camera views, and subjects. However, the resulting content was not coherent; it generated a man riding his bicycle backward and only showed one scene despite my request for multiple scenes.
Recognizing the need for adjustment, I approached the second iteration by breaking down the prompt into distinct scenes and using Runway’s prompt examples for guidance. This time, the video content became more realistic, but I faced another issue: the man was blocking the woman, and again, I only received a single scene.
By the third iteration, I opted for simplicity and revised the prompt to just two scenes while leaving out extraneous details. This final iteration provided a satisfactory outcome, showcasing a man and a woman biking through the picturesque countryside, followed by a close-up of their legs. With little to no silliness involved, I felt decently satisfied with the results.
Adding a Narrative
The subsequent task was to incorporate a short narrative into the video. I decided to use a text-to-speech tool called 11 Labs, as I wanted to avoid being locked into a one-year contract. Before generating the voiceover, I needed to write a script, so I turned to GPT for assistance.
After plugging the script into 11 Labs, I initially used the default voice settings, but the output was too robotic, failing to capture the whimsical and tender tone I desired. Therefore, I searched for a voice that matched my vision—a whimsical tone with a Transatlantic accent.
After finding a suitable voice, I tinkered with the settings to enhance its animation. However, I encountered another issue: the voice output was slower than anticipated, which required me to extend the video duration. Unfortunately, this led to some unintended silliness in the final cut when the characters' faces transformed unexpectedly.
Despite these challenges, I was content with the overall outcome. The final voiceover featured a charming commentary:
“For a truly romantic bicycle ride in the countryside, conditions must be perfect—exactly 62.2°F. As you pedal, your knees should rise smoothly to just below the lower abdomen. It's not just a ride; it's a dance with nature.”
Thank you for watching my assignment presentation, and I hope your projects went well too!
Keywords
- AI Video
- Audio Exploration
- How-to video
- Iteration process
- Bicycle ride
- Runway
- 11 Labs
- Narrative
- Voiceover
- Creativity
FAQ
Q: What is the project about?
A: The project focuses on creating a short how-to video about romantically riding bicycles in the countryside using AI tools.
Q: Which AI tools did you use for the project?
A: I used Runway for video generation and 11 Labs for voiceover narration.
Q: What challenges did you face during the video creation process?
A: I faced several challenges, including incoherent initial outputs, the need to break down prompts into scenes, and issues with voiceover monotony and pacing.
Q: How did you achieve a whimsical tone in the voiceover?
A: I selected a voice that matched a Transatlantic accent and adjusted the settings in 11 Labs to make it more animated.
Q: Were you satisfied with the final output?
A: Yes, I was decently satisfied with the final video, despite some minor silliness in the character transformations at the end.