Event banner

Azure Cognitive Search AMA: Vector search, Azure OpenAI Service, generative apps, plugins & more

Event Ended
Tuesday, Jul 25, 2023, 09:00 AM PDT
In-Person

Event details

In this session we’ll answer questions about the emerging Retrieval-Augmented Generation pattern and how you can use Azure OpenAI service and Azure Cognitive Search to implement it today in your appl...
EricStarker
Updated Jul 25, 2023
azure ai search
openai
DerekLegenzoff's avatar
DerekLegenzoff
Former Employee
Jul 25, 2023

The biggest thing to keep in mind when it comes to the scalability of Azure OpenAI service are the quota and limits. I'd start by taking a look at this page that talks about the limits. It's also important to learn how to manage the quota for your service.

 

In terms of performance, the best thing I can recommend is trying out your prompts in Azure OpenAI to understand the performance. One big factor for performance is the length of your prompts, particularly the number of output tokens.

Faddykenny_09's avatar
Faddykenny_09
Copper Contributor
Jul 25, 2023
Sounds great. I will work on that and learn for myself how it works.
Date and Time
Jul 25, 20239:00 AM - 10:00 AM PDT