Forum Discussion
Leo_H1500
Jun 24, 2024Copper Contributor
Azure OpenAI Quota
Hi all, I have a question about the Azure OpenAI deployment quota and hope someone can help me understand. I understand the quota is shared among deployments in the same region (Japan East) a...
DTB
Jun 24, 2024Iron Contributor
Hi Leo_H1500,
Understanding Azure OpenAI Quotas
The quota for Azure OpenAI resources is indeed an important consideration. Here's a detailed explanation to help you understand how quotas are managed in different scenarios:
Quota Sharing within a Subscription:
- Region and Subscription Boundaries: Within a single subscription, the quota for Azure OpenAI deployments is shared across all instances in the same region. For example, if you have multiple deployments of GPT-4 in the Japan East region under the same subscription, they will all share the same quota.
Separate Subscriptions:
- Independent Quotas: When you deploy instances in separate subscriptions, each subscription has its own independent quota allocation. Even if these subscriptions (Tech-dev and Support-dev) are owned by the same company, their quotas will not be shared.
- Example Scenario: In your case, since you have deployments in separate subscriptions (Tech-dev and Support-dev), each of these subscriptions will maintain its own quota for the GPT-4 instances in the Japan East region. The quotas will not be pooled or shared between these subscriptions.
Company Ownership:
- No Impact on Quotas: The ownership of the subscriptions by the same company does not impact the quota sharing. Quotas are strictly managed at the subscription level, regardless of the organizational ownership.
Practical Implications
- Resource Planning: Knowing that quotas are not shared across subscriptions allows you to plan your resource allocation more effectively. You can ensure that each group (Tech-dev and Support-dev) has sufficient resources without affecting the other.
- Monitoring Usage: It’s important to monitor the usage and quotas within each subscription to avoid hitting limits unexpectedly. Azure provides tools and dashboards to help you keep track of quota usage.
Conclusion
To summarize, the quotas for Azure OpenAI deployments are not shared across different subscriptions, even if they belong to the same company. Each subscription (Tech-dev and Support-dev) will have its own independent quota for the GPT-4 instances deployed in the Japan East region.
Leo_H1500
Jun 30, 2024Copper Contributor
Thank you