Topview Logo
  • Create viral videos with
    GPT-4o + Ads library
    Use GPT-4o to edit video empowered by Youtube & Tiktok & Facebook ads library. Turns your links or media assets into viral videos in one click.
    Try it free
    gpt video

    AI Voices Gone Horribly Wrong 2

    blog thumbnail

    AI Voices Gone Horribly Wrong 2

    Introduction

    I recently stumbled upon a bizarre instance involving AI voice dubbing technology from 11 Labs, which promises to seamlessly translate audio from one language to another. Intrigued by its capabilities, I decided to put it to the test by translating a video through multiple languages and back to English. The results were chaotic, hilarious, and nonsensical.

    The Initial Video

    1. Original Content: The video started with a casual conversation, with someone mentioning they had a video that they were sure others hadn't seen before. Upon playing the video, odd phrases started cropping up, with a recurring insistence that "the phone is ringing" interspersed with more dramatic lines like "you left me homeless."

    2. Voice Swapping Feature: Using 11 Labs' voice dubbing feature, we translated the video into Russian and then back to English. The translations wavered drastically, leading to a mix of somber, comedic, and downright confusing excerpts.

    The AI Translation Chaos

    1. Back to English: After translation, some examples included:

      • Erratic expressions like "the Medusa head" and odd reviews of "Jinky hang."
      • The surreal declaration, "rest in peace animator," popping up unexpectedly.
      • Interspersion of random exclamations like "Mickey Mouse."
    2. Internal Monologue and Randomness: The AI-generated speech ventured into nonsensical territory:

      • Phrases like "we do not like the sky" repeated without context, resembling a counter-spell.
      • The distortion of coherent speech into fractured and unrelated statements.

    The Resulting Transcripts

    1. Audio Checks: During further tests, sentences often lost their original meaning entirely. Queries like "What will it say?" ended up producing meaningless, yet humorous lines.

    2. Content Loss and Misinterpretation: The text mangling went on with oddly poetic constructs such as:

      • "Chicken nuggets were so tasty and crunchy that I could hardly contain myself," turning into extensive, verbose sentences.
      • Portions of the video changed context completely with no resemblance to the original subject.
    3. Eerie and Disturbing: The AI's output sometimes suggested deeply personal and unsettling plot lines, e.g., mentions of unsourced relationships and inappropriate content.

    Funny and Surreal Moments

    1. Random AI Outputs: The AI often spat out phrases with no relation to our input, like "I'm so hot banana" and "banana banana banana."

    2. Technology Misfires: Commands meant for virtual assistants were placed into the script, making Alexa or Google perform unexpected tasks, irrelevant to the test.

    Conclusion

    While the promise of AI-driven voice dubbing holds potential, this experiment highlights its limitations. The translation through multi-language circuit exhibited significant deviations from intended messages, leading to strings of chaotic and humorous output.


    Keywords

    • AI Voice Dubbing
    • Translation Errors
    • 11 Labs
    • Original Content
    • Chaotic Output
    • Incoherent Speech
    • Hilarious Misfires
    • Surreal Audio

    FAQ

    1. What was the initial video about?

      • It was a casual conversation featuring someone showing a video they were confident others had not seen before.
    2. What is voice dubbing in the context of this article?

      • Voice dubbing here refers to using AI to translate spoken audio from one language to another.
    3. Did the translated video maintain coherence?

      • No, the translated content varied greatly, producing disjointed, humorous, and often nonsensical output.
    4. Were there any recurring themes in the AI's output?

      • Yes, themes like “the phone is ringing” and absurd repetitions of phrases like “we do not like the sky” were recurring.
    5. Did the AI generate any disturbing content?

      • At times, the AI produced unsettling and personal plot lines that were inappropriate or entirely off-topic.
    6. Can AI voice dubbing technology be trusted currently?

      • While it shows promise, the technology still has significant issues, especially when translating through multiple languages.
    7. Were there any comedic outputs from the translation?

      • Yes, many of the AI-generated lines were humorous due to their randomness and lack of context.

    One more thing

    In addition to the incredible tools mentioned above, for those looking to elevate their video creation process even further, Topview.ai stands out as a revolutionary online AI video editor.

    TopView.ai provides two powerful tools to help you make ads video in one click.

    Materials to Video: you can upload your raw footage or pictures, TopView.ai will edit video based on media you uploaded for you.

    Link to Video: you can paste an E-Commerce product link, TopView.ai will generate a video for you.

    You may also like