After Effects Magic: Cinematic VFX on Budget with Generative AI

Film & Animation

Introduction

Creating stunning cinematic effects doesn't have to break the bank. With a little creativity, an inexpensive green screen, and the power of generative AI, anyone can produce impressive visual effects. In this article, we'll explore a step-by-step approach using Adobe After Effects and Microsoft Image Generator to enhance your video projects.

Setting Up the Scene

To begin, I had a shot of myself filmed outdoors with a green screen behind my lower half. Additionally, I generated an image featuring trees using the Microsoft Image Generator, which I intended to blend into a new scene.

Keying Out the Green Screen

The first step was to remove the green screen background. Using the Keylight effect in After Effects, I followed these steps:

  1. Select the green color from the green screen.
  2. Switch to the screen matte view.
  3. Adjust the screen gain and balance to eliminate the green while retaining the trees.
  4. Under the screen matte settings, tweak the levels until the screen is black and everything else is white.

Next, I returned to the final result view and refined my edges by setting the “Shrink Grow” parameter to -2 and the “Softness” to 2, ensuring a cleaner look.

Masking and Exporting to Photoshop

I created a quick mask to isolate the green portions and then used the “Composition” menu to save the frame as a Photoshop layer. Inside Photoshop Beta, I imported the generated image, specifically focusing on the diner part, and merged the visible layers together. Using the magic wand tool, I selected my alpha channel and expanded it by one pixel.

I then added my prompt and selected the reference image before initiating the generation process.

Color Correction and Background Integration

Once I was satisfied with the generated image, I imported it back into my After Effects composition to use as the background. I applied a Lumetri Color effect to my subject layer for initial color correction and used the Change Color effect to adjust the sky, ensuring it matched the fogginess of my scene.

To enhance the background, I brought in a stock tree alpha video clip and performed color correction to create motion in the foreground. I repeated this with another video clip featuring grass.

Rotoscoping and Final Adjustments

To give my scene an extra layer of depth, I duplicated my subject layer and used the Rotobrush tool to easily isolate myself from the background. This rough rotoscope helped create a light wrap effect around the subject.

I then applied the BCC Edge Lighting effect to my rotoscoped layer, adjusting the light direction, highlight color, and adding a blur. Tuning down the shadows added a soft, natural effect. I combined this layer with my main subject using a Luma track matte.

Motion Effects and Final Touches

To finish off the project, I added motion to the background. Within the background precomp, I duplicated my main layer and applied the BCC See Light Flicker effect to create dynamic lighting on specific parts of the scene.

Finally, I added an alpha video layer featuring smoke emanating from the diner roof, adjusting its position and scale. By inverting the mask, feathering it, and tweaking the opacity, I achieved a seamless integration. To add realism, I included a subtle camera shake to the final pre-made layer.

After executing all these steps, the result was a cohesive and engaging cinematic scene, made effortlessly with After Effects and generative AI!

Keyword

FAQ

Q1: What tools are needed to create cinematic effects with generative AI?
A1: You will need Adobe After Effects, a green screen, and generative AI tools like Microsoft Image Generator.

Q2: How do I remove the green screen from my footage?
A2: You can use the Keylight effect in After Effects to key out the green background by selecting the green color, adjusting screen gain and balance, and refining edges.

Q3: Can I combine stock footage with my own videos?
A3: Yes, you can import stock footage into After Effects and blend it with your own videos through color correction and layer adjustments.

Q4: What is rotoscoping, and why is it useful?
A4: Rotoscoping is a technique that allows you to isolate an object from its background. It is useful for creating a light wrap effect and adding depth to your scenes.

Q5: How can I add motion to my background?
A5: You can duplicate your layers and apply effects like light flicker or use stock footage to create dynamic motion in your background scenes.