AI Audio Editing From Adobe (Enhance Speech)

Introduction

Today, I’m testing out a revolutionary AI audio editing software from Adobe. Earlier at my shoot, my buddy, Yokani, sent me a text with examples of him editing audio from interviews and a wedding ceremony, and my mind was blown. I had to find out more about it and try it for myself.

The Experiment

Initial Recording

I asked my client to say a few lines for me. Normally, I use a Rode VideoMic Pro, so I had him record with both the on-camera microphone and the Rode mic. My goal was to compare how the original audio stacks up against the AI-enhanced audio.

Setting Up

I imported the recordings into Adobe Premiere to create a sequence named “AI Test”. I then adjusted the gain to ensure that the audio levels were appropriate:

Hello there, this should be the new AI generated audio.

Exporting

Next, I rendered the clip as an MP3 file. The software accepts MP3 and WAV formats, so I chose MP3 for convenience.

Using Adobe's Enhanced Speech

The Platform

The software we’re exploring is called Enhanced Speech by Adobe, formerly known as Project Shasta. It essentially creates a new, improved version of your voice based on your input.

Uploading Audio

I uploaded the MP3 file to the Enhanced Speech platform. It took around 20 seconds to process.

Results

I downloaded the transformed audio file and compared it with the original:

Original Audio:

Hello there, this should be the new AI generated audio.

AI-Enhanced Audio:

Hello there, this should be the new AI generated audio.

The difference was astonishing. The AI version sounded significantly better than anything I could achieve with traditional audio editing techniques.

Conclusion

The Enhanced Speech software by Adobe is a game-changer. It leverages AI to produce studio-quality audio, potentially eliminating the need for manual audio editing. While it's not perfect—for instance, it struggles with distant recordings where the AI can't decipher the words—it still represents a monumental leap forward in audio technology.

Keywords

AI Audio Editing
Adobe Enhanced Speech
Project Shasta
Rode VideoMic Pro
Audio Processing

FAQ

Q: What is Adobe's Enhanced Speech? A: It's an AI-powered audio editing software that improves audio quality by creating an enhanced version of your voice based on the input file.

Q: What formats does Adobe Enhanced Speech accept? A: It accepts MP3 and WAV files.

Q: How long does it take to process audio? A: The processing time is relatively short, usually around 20 seconds.

Q: Is it always accurate? A: While the AI does a fantastic job with clear and direct recordings, it struggles with distant recordings where the audio is faint or unclear.

Q: Can this software replace traditional audio editing? A: Although it handles many tasks exceptionally well, it might not entirely replace traditional audio editing, especially in complex scenarios. However, it can significantly reduce the workload.