Optimize Azure OpenAI Applications with Semantic Caching

Introduction One of the ways to optimize cost and performance of Large Language Models (LLMs) is to cache the responses from LLMs, this is sometimes referred to as “semantic caching”. In this blog,...