In this article, I’m going to show you how to create some mind-blowing VFX shots and seamlessly blend them into your own footage using AI technology. With this method, you can create eye-catching social media posts or elevate your storytelling. I’ll share some of my favorite tips, and I’ll showcase a short film I made using these effects. So, let’s dive in!
To create these VFX shots, we will be using Runway's Gen-3 video generator. The first step is to shoot a video. For our example, I thought it would be cool to create an explosion effect. I filmed myself getting into my car and will generate the car exploding right after I get in.
For best practices, ensure your camera is locked on a tripod or, in my case, I propped my phone on a stable table. It is essential to lock the focus on the object you want to remain in focus, to avoid any autofocus issues that may distort the shot. Make sure auto white balance is off to prevent shifts in color tone throughout the video.
Next, take a snapshot or still frame from the video where you want the effect to take place—right when I get into the car in this example.
For a static shot, use terms like "still" or "static" in your prompt. For example, set the prompt to “still tripod shot of a car exploding. The camera remains still,” and let it generate.
You can also experiment with other VFX concepts like growth transformations. For instance, I drew inspiration from Runway's video where a plant grows while being sprayed. I found success using prompts like “static shot of a plant, the plant morphs, grows, and transforms into a larger plant.”
Moreover, I recorded myself spraying a plant and successfully merged this footage with the video of the plant growing. Always remember to create a clean plate by taking another shot without you in the frame for smooth integration.
Try to create a floating effect: I took a picture of an old guitar and prompted “the guitar starts floating.” After stitching this footage together, it looked impressive, complete with realistic shadows.
Runway also excels at simulating elements like paint falling, where I generated a video of green paint dropping onto a car. The realism of the paint's simulation was remarkable.
You can animate images in your video as well. For example, I used a bird image from a book and prompted “camera is still, the image on the book comes alive.” The results were fantastic, allowing for the animation of any artwork or images.
You can use any video editor, but in this tutorial, I’m using CapCut. First, import the original footage and the VFX footage. Adjust the color grading to match both footages and ensure they sync at the correct time in the timeline.
Using the masking tool is essential for merging different clips. For instance, I masked part of my hand while spraying to incorporate the growing plant and hide the unwanted sections.
Once you’ve done this, experiment with keyframes for camera movements, adding filters, and creating cinematic black bars for a more polished look.
Using these techniques, I created a captivating short film blending all the effects described. It illustrates that you don’t need a large budget to produce stunning visual effects. I encourage you to test out these tools and let your creativity flow.
1. What is Runway Gen-3?
Runway Gen-3 is an AI video generation tool that allows users to create high-quality visual effects for videos.
2. How do I ensure my footage blends well with VFX?
To blend VFX seamlessly, ensure your camera is locked, focus is stable, and the color grading matches your original footage after editing.
3. Can I animate images with Runway?
Yes, you can animate still images within your footage by using specific prompts tailored to your desired effect.
4. What video editors can I use with Runway's generated VFX?
You can use any video editor, but this tutorial specifically demonstrates using CapCut and Premiere Pro.
5. What types of VFX can I create with Runway?
You can create a variety of effects like explosions, transformations, floating objects, and more advanced simulations like paint falling or liquids filling containers.
In addition to the incredible tools mentioned above, for those looking to elevate their video creation process even further, Topview.ai stands out as a revolutionary online AI video editor.
TopView.ai provides two powerful tools to help you make ads video in one click.
Materials to Video: you can upload your raw footage or pictures, TopView.ai will edit video based on media you uploaded for you.
Link to Video: you can paste an E-Commerce product link, TopView.ai will generate a video for you.