Forum Discussion
MartinLaplante
May 20, 2021Iron Contributor
Products based on new large models
Microsoft Research has been doing amazing work recently on huge models with DeepSpeed, ZeRO and ZeRO-infinity, and some great language-independent and zero-shot learning research. When will we see those new models applied in speech products, and what is the expected quality of translations?
- We are working closely with Microsoft Research and other Microsoft Organizations on various research direction including the experimental work on large scale models that you refer to and how those could be applied to speech tasks for enhanced quality and low-resource language. We don't have immediate plan or timeline to announce the availability of those to our Products.
2 Replies
- JianwuFormer EmployeeWe are working closely with Microsoft Research and other Microsoft Organizations on various research direction including the experimental work on large scale models that you refer to and how those could be applied to speech tasks for enhanced quality and low-resource language. We don't have immediate plan or timeline to announce the availability of those to our Products.
- chrisbasoglu
Microsoft
Please see the following article about large models in Cognitive Services: https://www.microsoft.com/en-us/research/blog/a-holistic-representation-toward-integrative-ai/