How to Stylize Real Video with Ai | Runway Gen 3 Tutorial

Introduction

Welcome to Hidden Space! I'm Serge Green, and in this tutorial, we’ll explore how to stylize real videos using Runway Gen 3. This feature opens up incredible opportunities for creativity and storytelling, allowing us to create dynamic AI-generated videos. Follow along as we break down the tools and demonstrate the process step by step.

Getting Started with Video Stylization

The Video to Video mode in Runway is easy to learn and flexible to work with. You can find all the basic information on the official Runway page. With this mode, we can alter the style of an original video using a text prompt. Once Runway Gen 3 moves out of alpha, we expect the option to upload reference images as well.

Key Specifications:

Video clips can be 5-10 seconds long.
Formats supported: 16x9 HD 720p.
Maximum upload size: 64 MB.

After uploading a video, we describe the scene and the desired style. Runway Gen 3 excels with detailed prompts, leading to more predictable results. Another handy feature is the ability to create custom presets that streamline the process.

Additionally, we can control the strength of the generative model's effect through the structure transformation value, ranging from 0 to 1. A higher value produces more abstract results.

Practical Application: Step by Step

Navigating to the Tool: Inside the Runway web application, go to the generative video tab. Ensure the Gen 3 model is enabled, then upload your video.
Creating a Prompt: Once your video is uploaded, refer to the examples provided by the Runway team. Prompts can be divided into two parts: the first describes the style and mood; the second details the scene and characters involved.
Prompt Iteration: Start with default settings and experiment with the extremes of the structure transformation values. Based on my experience, I recommend mid-range values (0.5 to 0.7) for optimal results. A setting of zero may produce unstable results, while a value of one generates more dramatic alterations to the environment.
Using Presets: In the custom tab, create presets by naming the style and providing a description. This makes the prompt creation process more efficient. I’ve created various styles, including Impressionism, 8-bit graphics, Art Deco, and Cyberpunk. These presets can be easily applied, enhancing the creative process.
Dynamic Content: For dynamic videos (like dancing), select appropriate styles to suit the movement and context. While the videos may sometimes yield unstable results, the overall output can still impress.
Group Dynamics: When working with videos featuring multiple subjects (e.g., a family), pay attention to the interactions among subjects. Clear descriptions are crucial to avoid unexpected errors.
Post-Processing: Once the video has been stylized, consider upscaling it and enhancing the frame rate using tools like Topaz Video AI.
Final Example: After all these steps, you’ll achieve compelling and visually engaging video content.

Conclusion

This tutorial illustrates how Runway Gen 3 can transform real videos into stylized pieces of art. From initial setup to final processing, you can explore endless creative possibilities.

Keywords

Runway Gen 3
Video to Video
AI Video Stylization
Custom Presets
Structure Transformation
Dynamic Movement
Upscaling
Frame Rate Enhancement

FAQ

What is Runway Gen 3?
Runway Gen 3 is an AI tool that enables users to stylize videos by changing their artistic style using text prompts.

How do I create a video with Runway?
You can start by navigating to the generative video section, uploading your video, and then crafting detailed prompts to guide the stylization.

What are the recommended structure transformation values for best results?
It's advisable to use mid-range values between 0.5 and 0.7, as these tend to produce the most satisfactory results.

What formats and limitations are there for uploading videos?
You can upload videos that are 5-10 seconds long in a 16x9 HD 720p format with a maximum file size of 64 MB.

Can I create my own presets in Runway?
Yes, you can create custom presets to simplify the process of applying styles to your videos efficiently.

How can I enhance my final video?
After the stylization process, you can use AI tools such as Topaz Video AI to upscale the resolution and adjust the frame rate for improved quality.