Blog Post

Azure AI Foundry Blog
2 MIN READ

Implementing Event Hub Logging for Azure OpenAI Streaming APIs

hieunhu's avatar
hieunhu
Icon for Microsoft rankMicrosoft
Nov 14, 2024
Azure OpenAI's streaming responses use Server-Sent Events (SSE), which support only one subscriber. This creates a challenge when using APIM's Event Hub Logger as it would consume the stream, prevent...
Updated Nov 15, 2024
Version 8.0
azure ai services
azure openai service
John_Carroll's avatar
John_Carroll
Icon for Microsoft rankMicrosoft
Dec 11, 2024

hi hieunhu , regarding the extension scenarios, are there plans to implement any of these extensions? I am specifically interested in 'Cost Analysis: Token usage mapping to Azure billing metrics.' This would be significantly useful for tracking AOAI token consumption from streaming requests.