I recently stumbled upon a bizarre instance involving AI voice dubbing technology from 11 Labs, which promises to seamlessly translate audio from one language to another. Intrigued by its capabilities, I decided to put it to the test by translating a video through multiple languages and back to English. The results were chaotic, hilarious, and nonsensical.
Original Content: The video started with a casual conversation, with someone mentioning they had a video that they were sure others hadn't seen before. Upon playing the video, odd phrases started cropping up, with a recurring insistence that "the phone is ringing" interspersed with more dramatic lines like "you left me homeless."
Voice Swapping Feature: Using 11 Labs' voice dubbing feature, we translated the video into Russian and then back to English. The translations wavered drastically, leading to a mix of somber, comedic, and downright confusing excerpts.
Back to English: After translation, some examples included:
Internal Monologue and Randomness: The AI-generated speech ventured into nonsensical territory:
Audio Checks: During further tests, sentences often lost their original meaning entirely. Queries like "What will it say?" ended up producing meaningless, yet humorous lines.
Content Loss and Misinterpretation: The text mangling went on with oddly poetic constructs such as:
Eerie and Disturbing: The AI's output sometimes suggested deeply personal and unsettling plot lines, e.g., mentions of unsourced relationships and inappropriate content.
Random AI Outputs: The AI often spat out phrases with no relation to our input, like "I'm so hot banana" and "banana banana banana."
Technology Misfires: Commands meant for virtual assistants were placed into the script, making Alexa or Google perform unexpected tasks, irrelevant to the test.
While the promise of AI-driven voice dubbing holds potential, this experiment highlights its limitations. The translation through multi-language circuit exhibited significant deviations from intended messages, leading to strings of chaotic and humorous output.
What was the initial video about?
What is voice dubbing in the context of this article?
Did the translated video maintain coherence?
Were there any recurring themes in the AI's output?
Did the AI generate any disturbing content?
Can AI voice dubbing technology be trusted currently?
Were there any comedic outputs from the translation?
In addition to the incredible tools mentioned above, for those looking to elevate their video creation process even further, Topview.ai stands out as a revolutionary online AI video editor.
TopView.ai provides two powerful tools to help you make ads video in one click.
Materials to Video: you can upload your raw footage or pictures, TopView.ai will edit video based on media you uploaded for you.
Link to Video: you can paste an E-Commerce product link, TopView.ai will generate a video for you.