Generative AI for Video: Runway ML + After Effects VFX Compositing Mastery
Film & Animation
Introduction
The advancements in generative AI have arrived at our doorstep, enabling creators to explore new frontiers in video production. In this guide, we will take a closer look at how to leverage Runway ML's Video Gen 3 tool in combination with After Effects to create stunning visual effects for your videos.
Getting Started with Runway ML
First, let’s dive into Runway ML, a platform packed with various creative tools. For this project, we’ll focus on the Video Gen 3 Alpha app. After launching the platform, the first step is to select the app assets.
For this demonstration, I’ve chosen a clip of a woman walking barefoot down a path. The next step involves adding a creative prompt and hitting the generate button. While many of the tools on Runway ML can be accessed via a free account, users will notice limited credits for extensive usage.
Once I ran various prompts, I was delighted with the results—each generated clip showcased impressive and unique variations. The next phase was compositing these clips in After Effects.
Compositing in After Effects
Now that we have a collection of generated clips, I opened After Effects to create a new composition. I imported all the clips that were aligned perfectly since they originate from the same video.
To combine these clips visually, I started by creating a mask around a specific area and inverted the mask to reveal a wintry scene. By adjusting and feathering the mask, I could aesthetically blend different elements. I also created additional masks to reveal sequences of a desert background, adding more depth to the composition.
For a fiery aesthetic, I brought in a clip containing flames, masked out the fire, and feathered it quite significantly. The continuous extension of the clip to the end of the composition ensured a seamless visual flow.
Enhancing the Video with Runway ML Tools
If I wished to remove the subject from the frame for a cleaner look, Runway ML has a remarkable feature for this task. By navigating to the inpainting tool, I could easily brush out the subject from the clip. The results were impressive, producing a nearly flawless clean plate that I could export for later use.
Another helpful tool available in Runway ML is the remove background function. This simplifies the process further by allowing me to select the subject using just a few clicks. If parts of the subject were missing during selection, the include mode let me add them back quickly, making this process less time-consuming. The final export came with a green screen background, which I could easily key in After Effects.
Conclusion
Thanks to Runway ML's powerful generative tools and After Effects' vast compositing capabilities, the possibilities for video creation are truly limitless. The final results showcase an engaging blend of environments and effects, demonstrating the future of video production powered by AI.
Keywords
- Generative AI
- Runway ML
- After Effects
- VFX
- Video Gen 3
- Compositing
- Inpainting
- Remove Background
- Clip Masking
FAQ
Q1: What is Runway ML?
A1: Runway ML is a creative platform with a suite of tools designed for artists and creators, enabling them to harness the power of generative AI in their projects.
Q2: What is the Video Gen 3 tool?
A2: Video Gen 3 is an application within Runway ML that allows users to generate unique video clips based on prompts, providing countless variations for creative projects.
Q3: How can After Effects enhance my video projects?
A3: After Effects is a robust software for creating visuals and effects, allowing users to composite different clips, add effects, and refine video projects creatively.
Q4: Can I remove subjects from my video using Runway ML?
A4: Yes, Runway ML offers tools like inpainting and background removal, making it simple to eliminate subjects or unwanted elements from video clips with high accuracy.
Q5: Do I need a paid subscription to use Runway ML?
A5: While many tools in Runway ML can be accessed with a free account, users may experience limitations on credits, which can affect extensive usage of tools.