Blog Post

AI - Azure AI services Blog
9 MIN READ

9 More Realistic AI Voices for Conversations Now Generally Available

Melissa_Ma's avatar
Melissa_Ma
Icon for Microsoft rankMicrosoft
Mar 30, 2024

By Peter Pan, Gang Wang, Xi Wang, Lihui Wang, Yufei Liu, Zheng Niu, Jun-Wei Gan, Yan Deng, Zhihang Xu, Garfield He, Nick Zhao, Lei He, Binggong Ding, Sheng Zhao, Suhrid Palsule, Shubham Bansal, Naman Joshi, Arijit Mukherjee and Vikas Joshi

 

Microsoft is always finding new ways to use AI to increase creativity, productivity, and skills. With the advent of high-quality, human-like AI voices, industries and applications are being transformed, making it easier and more natural to interact with devices and services.

 

Now, in human-bot conversational interactions, AI can produce more natural, fluent, and high-quality responses than ever before with the power of Large Language Models (LLMs) such as Azure OpenAI GPT. Consequently, when engaging in verbal conversations, the demand for naturalness and expressiveness in Text-to-Speech (TTS) voices is higher than ever.

 

Today, we are excited to announce that 9 new realistic voices are generally available which gives you better choices and variety for business scenarios using conversation. The new realistic voices are perfect matches for any application necessitating lifelike speech interactions, including chatbots, voice assistants, gaming, e-learning, entertainment, and more. For example, for voice agent scenario, Yellow.AI uses Ava voice for the customer support.

 

Presently, all of multilingual voices are characterized by a more conversational style, stemming from diverse primary languages. This expansion broadens our capacity to articulate content across 91 languages and their variants. This advancement underscores our steadfast commitment to surmounting language barriers and promoting a more inclusive and accessible global communication landscape. You can also check out the August 2024 announcement to experience the power of our expanded collection of 60+ realistic multilingual voices.

 

Meet new GA voices available today: en-US-AvaMultilingualNeural, en-US-AndrewMultilingualNeural, en-US-EmmaMultilingualNeural, en-US-BrianMultilingualNeural, De-DE-FlorianMultilingualNeural, De-DE-SeraphinaMultilingualNeural, Fr-FR-RemyMultilingualNeural, Fr-FR-VivienneMultilingualNeural and zh-CN-XiaoxiaoMultilingualNeural, learn more details below.

 

What’s new?

Whether you are creating a speech-based chatbot, a voice assistant, or a conversational agent, these new voices will ensure your interactions are more realistic, lifelike, and engaging. Compared to the voices designed for general purpose, conversation-optimized voices sound more natural and engaging when reading conversational and casual text. Plus, they even include interjections like laughter and filled pauses that add a human touch to your virtual conversations.

 

Voices optimized for life-like conversations

Existing voices designed for general purposes

Ava, Andrew, Emma and Brian - group chat

Aria and Guy - group chat

 

More examples of GA voices

Please note that the provided samples showcase only a selection of languages. Feel free to experiment with your own texts using the Audio content creator in Speech Studio.

 

Voice

Scenario

Script + Audio

en-US-AvaMultilingualNeural

(Female): bright, engaging female voice with a beautiful tone

 

Conversation

 

Yes, it is a big achievement to be accepted into the Microsoft Startup Programs. The program has specific requirements that startups must meet in order to qualify, so being accepted means that your startup meets those requirements and has been recognized for its potential. Congratulations again!

Conversation with interjection

Hmm, I'm not sure what to wear to the party tonight. I want to look nice, but I also want to be comfortable. Maybe I’ll wear my new dress and heels. Oh no, but what if my feet start hurting after a while? Maybe I should bring a pair of flats just in case.

Meditation

 

Find comfort in the stillness, feeling the earth's energy beneath you. With each inhale, draw in strength and stability; with each exhale, release what no longer serves you. You are grounded, centered, and at peace.

News

 

In a groundbreaking development, a team of international scientists has successfully deployed an artificial reef structure that supports coral growth, offering a new ray of hope for endangered marine life.

Poem

 

In the garden of life, every rose has its dawn,

Petals strewn on the paths we've drawn.

Thorns may prick, under the sun's keen light,

Yet, blooms stand proud, amidst the plight.

en-US-AndrewMultilingualNeural (Male): warm, engaging male voice that sounds like someone you want to know.


Conversation

Winnebago Industries is a company that manufactures motor homes, travel trailers, and other recreational vehicles. Its stock ticker symbol is WGO and it is traded on the New York Stock Exchange (NYSE). I hope this helps! Let me know if you have any other questions.

Conversation with interjection

Wow, that sounds magical! I’ve always wanted to see the Northern Lights. Hmm, imagine those vibrant colors dancing across the Arctic sky. Yup, it’s on my bucket list!

Advertisement

 

Savor the journey with Wanderlust Backpacks, your ultimate travel companion. Engineered for the modern nomad, our backpacks feature ergonomic design, built-in solar chargers, and a GPS tracker to keep your adventures on course. Wherever you roam, Wanderlust carries your world with ease.

News

 

The global tech community is buzzing with excitement as a new era of quantum computing begins, with a startup unveiling the first commercially viable quantum processor that promises to solve complex problems in seconds.

Story

 

Waves crashed against the lighthouse, where old Captain Grey kept watch. "Will the storm ever end?" he bellowed into the tempest, his voice laced with defiance. The thunder roared back, a deep and powerful sound that promised, "All storms bow to time, and this too shall pass."

en-US-EmmaMultilingualNeural (Female) :  friendly, light-hearted, and pleasant female voice that works well for education and explanations.

Conversation

 

Yes, it is a big achievement to be accepted into the Microsoft Startup Programs. The program has specific requirements that startups must meet in order to qualify, so being accepted means that your startup meets those requirements and has been recognized for its potential. Congratulations again!

Conversation with interjection

Hey, uh, did you hear about that new movie coming out next week? It's supposed to be a thriller with a twist ending. I, um, can't wait to see it, but I'm also a little nervous because I don't handle suspense very well.

e-learning

 

Today's lesson takes us on a journey through the cosmos. We'll explore the stars and planets, learning how they move and shine. Each one tells a story, and together, we'll unravel the mysteries of the universe.

News

 

Amidst a historic labor movement, employees at one of the world's largest gig economy platforms have achieved a landmark victory, securing minimum wage guarantees and benefits after a unanimous vote.

en-US-BrianMultilingualNeural (Male): youthful, cheerful, and versatile voice well-suited to a wide variety of contexts.

 

Conversation

The Unemployment Insurance Fund (UIF) is a fund that provides short-term relief to workers when they become unemployed or are unable to work because of illness, maternity or adoption leave. PAYE is a tax system used to collect income tax from employees. I hope that helps!

 

Conversation with interjection

I was, uh, driving down the interstate, and this, this huge truck just came out of nowhere. It was so close, I mean, I literally had to swerve to the—oh, what do you call it—the shoulder! Yeah, and I almost hit the barrier.

 

Story

Under the big top, the clown painted a smile wider than his sorrow. "Who knows my truth?" he asked the mirror, his painted grin belying the sadness in his eyes. His reflection seemed to reply, "Only the one behind the mask, for it's the soul that holds your joy and pain."

 

Advertisement

Envelope yourself in luxury with Silk Haven bedding. Our sheets, woven from the finest threads and infused with soothing aloe, turn sleep into an exquisite experience. Drift away in the soft embrace of Silk Haven, where dreams are just the beginning.

De-DE-FlorianMultilingualNeural

(Male)

Custom Service

 

 

Ein Abonnent eines Kabelfernsehsenders in Stuttgart erhielt eine hohe Rechnung für einen Dienst, den er nicht abonniert hatte. Trotz mehrerer Versuche, das Problem telefonisch zu lösen, blieb der Abrechnungsfehler bestehen, sodass der Kunde frustriert war und eine schnelle Lösung und Rückerstattung forderte.

News

 

 

In einer Welt, die ständig in Bewegung ist, wird ein gesunder Lebensstil immer wichtiger, um das eigene Wohlbefinden zu fördern. Erfahren Sie mehr über einige grundlegende Prinzipien, die Ihnen helfen können, einen gesunden Lebensstil zu pflegen und Ihr Leben in eine Richtung der Vitalität zu lenken.

Advertisement

 

 

Tauchen Sie ein in eine Welt der Entspannung und Erholung in unserem exklusiven Wellness-Spa. Genießen Sie luxuriöse Behandlungen, von Massagen bis hin zu Gesichtsanwendungen, und lassen Sie den Alltagsstress hinter sich. Gönnen Sie sich eine Auszeit und verwöhnen Sie Körper und Geist!

De-DE-SeraphinaMultilingualNeural

(Female)

Custom Service

 

 

Ein Kunde aus Hamburg wurde von einem Supportmitarbeiter unhöflich behandelt, als er Hilfe bei einem Abrechnungsproblem suchte. Er fühlte sich respektlos und verlangte eine Entschuldigung und die Zusicherung, dass das Personal besser geschult werde, um ähnliche Vorfälle zu verhindern.

Meditation

 

 

Stellen Sie sich ein goldenes Licht vor, das Sie umgibt und dessen Wärme heilsam und beruhigend wirkt. Erlauben Sie diesem Licht, Sie von innen zu erfüllen, jegliche Dunkelheit aufzulösen und jede Zelle mit Ruhe zu erfüllen. Sie sind ein Leuchtfeuer der Gelassenheit.

News

 

 

In städtischen Zentren gewinnen Graswurzelbewegungen an Fahrt, um die Plastikverschmutzung anzugehen. Bürger organisieren Reinigungsaktionen entlang der Strände und öffentlicher Plätze und sensibilisieren für die schädlichen Auswirkungen von Einwegplastik. Gleichzeitig setzen Unternehmen auf umweltfreundliche Alternativen, was zu einer Reduzierung des Plastikmülls beiträgt.

Fr-FR-RemyMultilingualNeural

(Male)

News

 

 

Des projets de renouvellement urbain transforment les quartiers défavorisés en espaces revitalisés. Ces projets n'incluent pas seulement le développement immobilier, mais intègrent également des espaces verts, des installations culturelles et des opportunités économiques pour favoriser une vie communautaire florissante.

Custom Service

 

En tant que client, vous êtes au cœur de tout ce que nous faisons, c'est pourquoi nous sommes toujours là pour vous écouter et vous soutenir. Que vous ayez des questions, des préoccupations ou des commentaires, nous sommes là pour vous aider de toutes les manières possibles. Votre satisfaction est notre plus grande récompense, et nous ferons tout notre possible pour vous offrir un service client exceptionnel à chaque interaction.

Advertisement

 

 

Découvrez une vie plus savoureuse avec nos produits ! De la première bouchée jusqu'à la dernière gorgée, chaque instant est une célébration de saveurs exquises et d'expériences culinaires inoubliables. Laissez-vous emporter par la délicieuse sensation de satisfaction à chaque fois que vous choisissez nos produits !

Fr-FR-VivienneMultilingualNeural

(Female)

Custom Service

 

 

Chez nous, le service client ne se limite pas à la résolution des problèmes, mais à la création de relations durables. Nous vous accueillons chaleureusement à chaque interaction et nous efforçons de dépasser vos attentes à chaque étape du processus. Notre objectif est de vous offrir une expérience client exceptionnelle qui vous incitera à revenir encore et encore.

Advertisement

 

 

Libérez votre potentiel avec notre programme de remise en forme ! Chaque séance d'entraînement est une étape vers une version plus forte, plus saine et plus confiante de vous-même. Ressentez l'énergie et la vitalité circuler à travers votre corps à chaque mouvement. Préparez-vous à dépasser vos limites et à atteindre de nouveaux sommets de bien-être !

News

 

 

À l'heure où la protection de l'environnement devient une priorité mondiale, des gestes simples au quotidien peuvent avoir un impact significatif. Voici quelques initiatives accessibles à tous pour contribuer à la préservation de notre planète.

zh-CN-XiaoxiaoMultilingualNeural

(Female)

 

Conversation

但我现在对这个职业的热爱还是非常的,呵呵,非常的,嗯,怎么说呢?日月可鉴的,哈哈,嗯还是希望可以把这个职业做下去或者做这个声音相关领域的工作,嗯,就是把自己的优势发挥的大一点,尽可能能用到自己擅长的东西,而不是说为了工作,为了挣钱而工作。

Podcast

我们需要加的是生抽、老抽、料酒、白糖还有一点点的醋、盐,然后把它翻炒均匀就可以了。接下来就是收汁的阶段了哈,我们加入适量的水淀粉翻炒到这个鸡丁上色,而且汤汁呢,稍稍已经比较浓稠,啊不会轻易的滑落。

 

Examples of the new multilingual voice in some languages

Please note that the provided samples showcase only a selection of languages. Feel free to experiment with your own texts using the Audio content creator in Speech Studio.

  

Voice

Locale (s)

Script + Audio

ja-JP-MasaruMultilingual (Male)

Japanese

Ja-JP

(Primary locale)

パンダンは熱帯地域で育つハーブで、東南アジアのベトナム、タイ、マレーシア、シンガポール、フィリピンなどの料理で香辛料として使用され、特にデザートによく使われます。

German

De-DE

Pandan ist eine krautige Pflanze aus den tropischen Regionen, die als Gewürz in der Küche Südostasiens wie in Vietnam, Thailand, Malaysia, Singapur und den Philippinen verwendet wird, insbesondere in süßen Desserts.

Italian

It-IT

Il pandan è una pianta erbacea delle regioni tropicali utilizzata come pezia nella cucina del sud-est asiatico come in Vietnam, Thailandia, Malesia, Singapore e Filippine, soprattutto nei dolci.

Spanish

Es-ES

El pandan es una planta herbácea de las regiones tropicales utilizada como especia en la cocina del sudeste asiático como en Vietnam, Tailandia, Malasia, Singapur y Filipinas, especialmente en postres dulces.

Chinese

Zh-CN

香兰是一种热带地区的草本植物,在东南亚的越南、泰国、马来西亚、新加坡和菲律宾等地的烹饪中被用作调味品,尤其是在甜点中。

 

Additional updates

  • En-US-RyanMultilingual is GA on all regions.
  • En-US-JennyMultilingualV2 is GA on all regions, merged with en-US-JennyMultilingual.
  • Preview available for updated en-IN-NeerjaNeural and hi-IN-SwaraNeural with 3 new styles in East US, West Europe and Southeast Asia.
  • Preview available for new female voices in Central India: en-IN-KavyaNeural, en-IN-AnanyaNeural, en-IN-AashiNeural, hi-IN-KavyaNeural, hi-IN-AnanyaNeural.

Get started

Microsoft offers over 400 neural voices covering more than 140 languages and locales. With these Text-to-Speech voices, you can quickly add read-aloud functionality for a more accessible app design or give a voice to chatbots to provide a richer conversational experience to your users. In addition, with the Custom Neural Voice capability, you can easily create a brand voice for your business.

 

Visit ai.azure.com, you now have the capability to listen the demo from Voice gallery or activate the Speech feature in ChatGPT Playground. This enhancement facilitates seamless audio testing, offering a refined and more authentic conversational experience for integration into your bot application.

 

Updated Nov 27, 2024
Version 19.0