Event banner

Azure Cognitive Search AMA: Vector search, Azure OpenAI Service, generative apps, plugins & more

Event Ended
Tuesday, Jul 25, 2023, 09:00 AM PDT
In-Person

Event details

In this session we’ll answer questions about the emerging Retrieval-Augmented Generation pattern and how you can use Azure OpenAI service and Azure Cognitive Search to implement it today in your appl...
EricStarker
Updated Jul 25, 2023
azure ai search
openai
brennan510's avatar
brennan510
Copper Contributor
Jul 25, 2023
I'd love to gain some insight into the pricing model of vector search. Based on the limited information available on the semantic feature in Cognitive Search, I'm guessing there will be some base cost of ~$500 per month. Why the base cost component? Also, what will be the price be approximately per token/document ingested? Thanks!
liamca-msft's avatar
liamca-msft
Icon for Microsoft rankMicrosoft
Jul 25, 2023
That is correct Brennan, unfortunately (or fortunately), the semantic model leverages GPU's that has a cost associated with it. We do understand that it makes more sense for some customers to have a more gradual ("pay per usage") type model as opposed to having the $500 cost for a large number of transactions. Please keep an eye out for that. It is important to note that for the semantic search capability, there is no cost for ingesting data as it is purely a reranking model. More details can be found here: https://learn.microsoft.com/en-us/azure/search/semantic-search-overview
Date and Time
Jul 25, 20239:00 AM - 10:00 AM PDT