Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

Film & Animation

Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

In this article, we're going to guide you through using your phone to scan your surroundings and create cinematic camera movements in post-production with Luma AI. We'll also discuss how to use a standard DJI drone to generate FPV-looking videos, even when dealing with average video quality. The technology is promising, and we'll share some tips to help you achieve the best quality possible.

Getting Started: iPhone vs. Android

If you're an iPhone user, you can easily use the dedicated Luma app, which offers real-time guidelines. For Android users, don’t worry—it's still possible to capture videos and upload them directly to Luma from your browser. However, before you start shooting, there are essential camera settings you should follow:

  1. Resolution: Shoot in 4K.
  2. Disable HDR.
  3. Disable Video Stabilization.
  4. Focal Length: Use either a wide or normal focal length.

Check out Luma's detailed list of guidelines and best practices for more information.

Recording Techniques

To capture a high-quality scan, shoot a single video in loops from three different heights:

  1. Chest Level: Start with the phone at chest level, looking straight ahead.
  2. Above Head: Move the phone higher, above your head, pointing down towards the center of the scene.
  3. Knee Level: Finally, record from knee level, pointing upwards towards your subject.

It's crucial to keep your subject in the frame and centered.

Uploading and Processing

Once you’ve finished recording:

  1. Visit Luma’s Website: Head over to lumalabs.ai and create an account.
  2. Upload: Upload your video, give the project a descriptive name, and wait for it to process.
  3. Download: Download the 3D scene as an object or mesh, or access the browser-based editor to manipulate camera movements.

Editing and Exporting

In the editor:

  1. Camera Tools: Click to access camera tools.
  2. Background: If the background isn’t visible, click on the layers icon.
  3. First Person View: Switch to first person view.
  4. Preset Trajectories or Custom: Use orbit and oscillate presets or create your own using keyframes.

To create motion, add keyframes and animate the camera over time. For a more dynamic effect, adjust the focal length and camera roll settings. If parts of the environment aren't captured, use Luma’s solid background color option. Before exporting, remember to tweak the video resolution.

Vertical Videos for Social Platforms

Currently, Luma doesn’t support rotating videos within the app. Export in landscape mode, and then crop it in your editing software. For better output quality, add 90 degrees to the camera roll setting for each keyframe—a time-consuming but rewarding process.

Once you're satisfied with your animation:

  1. Render: Click on render to export your video.
  2. Editing: Import it into your editing software (e.g., Premiere Pro), adjust the frame dimensions, and add motion blur using a plugin like RSMB.

Scanning with Drones

You can also use a drone to scan:

  1. Fly Around the Subject: Orbit the subject from different heights.
  2. 4K Recording for Better Quality: If using a DJI Mini 3 Pro, note that its built-in orbit feature records up to 1080p. Upscale it using Topaz Video AI for better results.
  3. Combining AI Tools: Mix Luma scans with AI video tools like gen-1 from RunwayML for unique outcomes.

For more information on Gen-1 and other AI tools, check out additional helpful videos and articles.

Keywords

  • Luma AI
  • Cinematic camera movements
  • 3D scan
  • FPV videos
  • iPhone
  • Android
  • Drone scanning
  • Post-production
  • Keyframes
  • Video resolution
  • Motion blur
  • Topaz Video AI
  • RunwayML

FAQ

Q1: What camera settings are required for using Luma AI?
A1: Shoot in 4K resolution, disable HDR, disable video stabilization, and use either a wide or normal focal length.

Q2: How do I keep my subject centered while recording?
A2: Capture a single video in loops from three different heights—chest level, above head, and knee level—making sure the subject remains centered in the frame.

Q3: How do I upload and process my video on Luma AI?
A3: Head to lumalabs.ai, create an account, upload your video, name the project, and wait for it to process.

Q4: How can I adjust camera settings in the Luma AI editor?
A4: Click on the camera tools, switch to first person view, use either preset trajectories like orbit and oscillate or create custom ones with keyframes.

Q5: Can I create vertical videos for social platforms using Luma AI?
A5: Luma AI doesn’t support rotation within the app, so edit keyframes to add 90 degrees to the camera roll or use desktop editing software to crop the video.

Q6: How can I scan using a DJI drone?
A6: Orbit the subject at different heights, ideally recording in 4K. If using a DJI Mini 3 Pro, upscale 1080p footage to 4K using software like Topaz Video AI.

Q7: Are there additional tools I can use along with Luma AI for unique results?
A7: Yes, combine Luma scans with AI video tools like gen-1 from RunwayML for innovative video creations.

Other than that, stay creative and continue experimenting.

End of the article