Home Community ElevenLabs Releases Eleven Multilingual v2: An AI Speech Model Supporting 30 Languages

ElevenLabs Releases Eleven Multilingual v2: An AI Speech Model Supporting 30 Languages

ElevenLabs Releases Eleven Multilingual v2: An AI Speech Model Supporting 30 Languages

Recent research by ElevenLabs released a multilingual voice generation model called Eleven Multilingual v2 that produces ’emotionally wealthy’ AI audio in nearly 30 languages. This work will enable producers to localize audio for European, Asian, and Middle Eastern markets.

The research team studied human speech indicators for 18 months and developed latest methods for detecting context, expressing emotions in speech generation, and synthesizing latest, distinctive voices. The model robotically recognizes nearly 30 written languages and generates voice in them with an unprecedented level of authenticity when text is entered into the ElevenLabs text-to-speech platform.

The cloned or synthetic voice retains the distinctive characteristics of the speaker’s voice, akin to their native accent, in all languages spoken. It’s now possible to utilize the identical voice to animate material in 28 different languages.

This launch got here after the platform made it possible for all authors to make use of skilled voice cloning. Users can now make a digital replica of their voice that’s practically indistinguishable from the unique because of this update, which was released alongside improved security and protections. Adding on to the prevailing languages (English, Polish, German, Spanish, French, Italian, Hindi, and Portuguese), the brand new model also supports Chinese, Korean, Dutch, Turkish, Swedish, Indonesian, Filipino, Japanese, Ukrainian, Greek, Czech, Finnish, Romanian, Danish, Bulgarian, Malay, Slovak, Croatian, Classical Arabic, and Tamil.

ElevenLabs has verified that the platform is exiting beta today, following the introduction of latest features and ongoing enhancements. This variation represents a watershed point in the corporate’s commitment to serving its 1 million+ users throughout the world with dependable and state-of-the-art resources.

ElevenLabs can be working on a way that may enable users to collaborate with AI to create latest audio through the platform.

By adding text-to-speech in lots of languages to visual content, the appliance makes it more accessible to individuals with visual impairments or other learning requirements. Some examples are as follows:

  1. The multilingual speech generation tool opens up latest possibilities for indie game developers and publishers to translate game experiences and audio content for international audiences, allowing them to attach with players and listeners of their languages without sacrificing quality or accuracy.
  2. Similarly, schools now have the resources to supply students with timely access to high-quality, native-speaker audio content in goal languages, improving students’ listening and pronunciation abilities and meeting a wide range of instructional preferences inside their international student body.

By lowering the time and expense needed to supply high-quality audio in quite a few languages, ElevenLabs is assisting businesses and creators in producing more original and accessible content that’s comprehensible by people of all backgrounds and languages.

Try the Reference Article. All Credit For This Research Goes To the Researchers on This Project. Also, don’t forget to affix our 29k+ ML SubReddit, 40k+ Facebook Community, Discord Channel, and Email Newsletter, where we share the newest AI research news, cool AI projects, and more.

For those who like our work, you’ll love our newsletter..


” data-medium-file=”https://www.marktechpost.com/wp-content/uploads/2022/11/20221028_101632-Dhanshree-Shenwai-169×300.jpg” data-large-file=”https://www.marktechpost.com/wp-content/uploads/2022/11/20221028_101632-Dhanshree-Shenwai-576×1024.jpg”>

Dhanshree Shenwai is a Computer Science Engineer and has a superb experience in FinTech firms covering Financial, Cards & Payments and Banking domain with keen interest in applications of AI. She is obsessed with exploring latest technologies and advancements in today’s evolving world making everyone’s life easy.

🚀 CodiumAI enables busy developers to generate meaningful tests (Sponsored)


Please enter your comment!
Please enter your name here