Forum Discussion
Language Detection ACS Call Automation
Hey there,
I am trying to build a multilingual voice bot using ACS and a web service. As users might speak different languages I am looking for a way to either translate the STT or at least detect the spoken language to adjust my backend accordingly. I do know this is possible with the Speech SDK. I am stuck now on how to connect these as I am using the Call Automation Library at the moment. Maybe there is even a better way i did not even think about.
Also if someone knows why the Python library seems to be so much slower than the dotnet one when it comes to speech recognition please let me know.
Thanks in advance,
kugelblytz
1 Reply
- Martin-Apps4RentIron Contributor
You can handle multilingual voice bots by streaming the ACS call audio to the Azure Speech SDK, which supports auto language detection and translation, then feeding the detected language or translated text into your backend and using Speech SDK TTS to reply in the right language through ACS; ACS itself only manages calls, while Speech SDK provides STT/translation, and if latency is critical, prefer .NET SDK since it’s faster and more optimized than Python.