Forum Discussion

emmae157's avatar
emmae157
Copper Contributor
Mar 27, 2024

deployed azure ai chatbot assistant app service with gpt 4 1106-preview model

hi I've deployed an app in azure app services. It uses the gpt 4 1106-preview model that has been deployed in azure open ai studio. When running the app, I get chat responses that are quite slow. Wh...
emmae157's avatar
emmae157
Copper Contributor
Mar 28, 2024

hello Nitinnks thanks for your response

I've tried allocating more resources towards my app service and it seems to not be making a difference. The pricing tier I currently have for the GPT-4 model deployment in Azure OpenAI Studio is currently S0 standard. Is that the highest pricing tier currently? I can't seem to find a tier higher to upgrade?

What tool and performance metrics can I use to identify bottlenecks and areas for improvement?

 

thanks

Nitinnks's avatar
Nitinnks
Copper Contributor
Mar 28, 2024

Hello emmae157   you can use below tools for the monitoring...

 

  1. Azure Monitor: Azure Monitor provides comprehensive monitoring capabilities for Azure resources, including Azure App Service and Azure OpenAI Studio deployments. It offers features like metrics, logs, alerts, and insights to track performance and identify bottlenecks.

  2. Application Performance Monitoring (APM) Tools: Tools like Application Insights, New Relic, Datadog, or Dynatrace offer deep insights into application performance, including response times, resource utilization, and transaction traces. They can help pinpoint performance issues and optimize resource allocation.