AI Story Video - Free Tutorial ?

Introduction

Creating amazing storytelling videos with AI is now easier than ever! In this tutorial, you will learn how to convert still images into captivating animations, including syncing character lip movements with their dialogues and generating sound effects using AI. We'll cover both paid tools and their free alternatives to ensure everyone can participate. Feel free to join my Discord for any questions or clarifications.

Step 1: Generating the Story

To start, you can generate a story using AI. I recommend using ChatGPT, but you can also explore Google's Gemini or Microsoft Copilot. If you prefer human-written stories, check out American Literature.

Once you have your story, instruct ChatGPT to separate the characters and their dialogues. This creates a clear script for your characters.

Step 2: Scene Generation

With your story drafted, it’s time to visualize it. Take the first paragraph and ask ChatGPT to identify all the scenes. Convert these scenes into prompts for AI image generation.

For consistent image generation, the best tool is MidJourney, starting at $ 10 per month. A great free alternative is Leonardo AI, which provides 150 credits daily.

Leonardo AI Settings:

1. Disable Legacy Mode: To access the new interface.
2. Present Style: Select 'onim'.
3. Image Dimensions: Use 16:9 for YouTube.

When generating your images, include terms like “3D animation” and “Disney Pixar” in your prompts for better results. Repeat this for all scenes and ensure uniformity by copying the seed for images that contain faces.

Step 3: Video Generation

Leonardo AI has a built-in video generator. Hover over your image to find the “Generate Motion Video” option, costing 25 credits.

If you'd like an alternative, consider Luma AI, which is a premium option requiring a subscription, or Hyper AI, which provides 300 free credits for new accounts. Use Hyper AI’s “Image to Video” feature for simple transitions.

Video Creation Steps on Hyper AI:

1. Upload your image.
2. Enter the same prompt used during image generation or leave it blank.
3. Adjust duration settings based on your credits and hit “Create”.

Step 4: Voiceover Generation

For voicing over your story, 11 Labs is a reliable paid option, starting at $ 5 a month, while Play.ht offers a free alternative.

Steps to Generate Voiceover with Play.ht:

1. Go to Play.ht and choose a voice, like Samuel for storytelling.
2. Copy and paste your main script into the platform.
3. Click on “Generate All” to create the voiceover file.
4. Repeat for character dialogues, using individual voices for each character.

Step 5: Lip Sync

For lip syncing, use Pika Art. If it struggles due to the cartoon faces, switch to Lamu Studio. It is accessible via Canva, where you’ll combine videos and audio.

Canva Steps:

1. Upload the video and audio clips.
2. Generate the lip-sync effect.

Step 6: Adding Background Music and Sound Effects

To add the finishing touches, you can generate music and sound effects with AI tools. Use ChatGPT to get prompts for background music.

Recommended Tools:

1. PAB: Upload your video and generate sound effects based on your prompt.
2. Pop Pop AI: Use smart mode for efficient music generation.

Step 7: Final Editing

Finally, combine all components in a video editor. Align the character dialogues with visual scenes, integrate background music, and utilize captions if needed.

Editing Steps:

1. Add all clips sequentially.
2. Merge voiceover and background music.
3. Apply color grading for enhanced visual effect.

Conclusion

Following these steps will help you create an amazing storytelling video that captivates your audience.

Keywords

• AI Storytelling
• Image Generation
• Video Animation
• Voiceover Creation
• Lip Sync
• Background Music

FAQ

Q: What tools do I need to create an AI story video?
A: You need tools for story generation (like ChatGPT), image generation (like MidJourney or Leonardo AI), video generation (like Hyper AI), and voiceover creation (like 11 Labs or Play.ht).

Q: Are there any free alternatives to the paid tools?
A: Yes, Leonardo AI offers free image generation, and Play.ht provides a free voiceover option.

Q: How can I add sound effects and music to my video?
A: You can use AI tools like PAB and Pop Pop AI to generate sound effects and background music.

Q: Can I edit my video using free software?
A: Yes, there are many free video editing software options available, but basic editing knowledge is beneficial.

Q: Is it necessary to use Canva for lip-sync?
A: No, but Lamu Studio works best in conjunction with Canva for video syncing.