Free AI Mocap from Video! Plask & Blender Tutorial

Introduction

In today’s tutorial, we will explore how to extract the motion of a person from a video and apply it to any 3D character using a remarkable AI tool that is completely free and user-friendly.

Preparing the Footage

To start, we will be using a video of a girl dancing, which can be downloaded for free from Pexels.com. Alternatively, you can record your own footage—just ensure you remain within the frame and position the camera on a tripod for stability. For this tutorial, as the footage was shot handheld, I stabilized it in post-production using Adobe After Effects. If you wish to follow along step by step, you can download this stabilized clip via the link in the video description.

Motion Capture Process with Plask

Next, we will turn our attention to Plask.ai to begin the motion capture process. Click on “Launch Plask” in the top right corner to enter the 3D workspace. In this interface, the library on the right displays various characters and animations, the middle section features the 3D viewport, and below it, the animation timeline can be found. The right-hand side houses the property window for adjustments.

To import the footage, simply drag and drop your video clip into the library panel. You can preview the clip and opt to trim it, removing any unnecessary segments.

Before extracting motion, define whether you wish to capture just a single character or multiple characters from the video. Since we have one dancer, we can leave this option unchanged. If you began your recording in a t-pose, enabling the t-pose option can yield better results, though often it works well without it.

Once everything is set up, click on “Extract,” give your animation a name, and wait for the processing to complete. After this, the new animation will appear in the library.

Previewing and Applying the Animation

Plask provides several default characters for motion capture previewing. To apply the extracted animation to a character, select it and drag it over the character in the viewport. You can click the play button in the timeline to preview the animation, which should demonstrate good results for our character.

Importing Custom Characters

You can also import custom characters into Plask. A fantastic resource for free compatible characters is Mixamo.com. Here, you can select and download a character, typically leaving all download settings at the default.

If your character is unique or lacks a rig, I recommend checking out my auto-rigging tutorial, which shows how to upload and rig your characters for use with Mixamo.

After importing your new character into Plask by clicking the plus button in the library, you might see a default Mixamo animation. You can delete this, as we will apply our custom motion capture animation instead. Drag and drop it onto the rigged character, play the timeline again to see the animation in motion.

Downloading the Animation

Once satisfied, right-click on the character and select “Export.” Ensure you have the correct animation selected and proceed with the download in FBX format.

Importing into Blender

Now, let’s bring the character into Blender. From the top menu, navigate to File > Import and select FBX. Locate your downloaded file, and in the import settings, activate "Automatic Bone Orientation." This will help import your character along with its rig.

Press play in the timeline to preview the animation. To view the textures correctly, switch to viewport shading in the top right corner. If there are any shader issues, select the mesh, go to the material properties, and disable "Show Backface," which should resolve these discrepancies.

Upon reviewing the animation closely, you will notice it performed admirably, especially compared to the original footage. The only notable issue might be the feet not aligning perfectly with the ground plane. This could be corrected by enabling foot locking in Plask, although this feature is only provided in the paid version. Nevertheless, the free version is exceptionally capable and covers most needs effectively.

Thank you for joining me for this tutorial! I hope you learned something valuable. If you have any further questions, feel free to leave them in the comments. I am Nick from Blender Daily, and I’ll see you in the next tutorial!

Keyword

• Plask.ai
• Motion Capture
• 3D Character
• Video Stabilization
• FBX Export
• Mixamo
• Blender
• Animation

FAQ

Q1: Can I use my own video footage for motion capture?
A1: Yes, you can use your own footage. Just ensure that you remain within the frame and keep the camera stationary on a tripod.

Q2: Do I need a premium account to use all features in Plask?
A2: While Plask offers a free version that is very capable, some advanced features, like foot locking, are only available in the paid version.

Q3: How can I fix animation issues such as feet not aligning with the floor?
A3: Enabling foot locking in Plask can help correct alignment issues, but note that this feature requires a paid subscription.

Q4: Where can I find free characters for motion capture?
A4: Mixamo.com provides a wide selection of free characters compatible with the motion capture process.

Q5: How do I import my animated character into Blender?
A5: After exporting your character from Plask in FBX format, go to Blender, then use File > Import > FBX to bring your character in. Make sure to set the appropriate import settings.