Event banner
Azure Cognitive Search AMA: Vector search, Azure OpenAI Service, generative apps, plugins & more
Event Ended
Tuesday, Jul 25, 2023, 09:00 AM PDTEvent details
In this session we’ll answer questions about the emerging Retrieval-Augmented Generation pattern and how you can use Azure OpenAI service and Azure Cognitive Search to implement it today in your appl...
EricStarker
Updated Jul 25, 2023
Faddykenny_09
Jul 25, 2023Copper Contributor
Could you EricStarker provide insights into the scalability and performance aspects of the Azure OpenAI interface? How does it handle large-scale AI workloads and ensure efficient resource utilization?
- DerekLegenzoffJul 25, 2023Former Employee
The biggest thing to keep in mind when it comes to the scalability of Azure OpenAI service are the quota and limits. I'd start by taking a look at this page that talks about the limits. It's also important to learn how to manage the quota for your service.
In terms of performance, the best thing I can recommend is trying out your prompts in Azure OpenAI to understand the performance. One big factor for performance is the length of your prompts, particularly the number of output tokens.
- Faddykenny_09Jul 25, 2023Copper ContributorSounds great. I will work on that and learn for myself how it works.
- EricStarkerJul 25, 2023Former EmployeeHello! I am not a product expert, just a community manager here, so I'll leave that for the Microsoft folks here to answer when they can.
- Faddykenny_09Jul 25, 2023Copper ContributorOh, Sorry about that misunderstanding. I thought you was an expert.