openai token usage log exports
Hi, I am trying to find a way to transfer the model token usage data to BigQuery, here are my attampts: 1. OpenAI model- deployment - metrics. It provides token usage directly, but I failed to find a way to export it on a scheduled basis. 2. API management service. Not working when using streaming responses with Azure OpenAI models because it requires more configuration to capture model completions. As I am developing a chatbot, the streaming feature is necessary. 3. Export native logs by diagnostic settings. Unfortunately there is no token usage related info included. So I wanna kindly ask for a potential solution for exporting the token usage to BigQuery with streaming function when using openai model. Thanks!