Blog Post
AI Gateway tier of API Management now in public preview
I believe the AI Gateway tier is for the scenarios where you don't need other advanced API management capabilities. Other tiers of APIM currently support the AI gateway features as well including adding llm APIs, MCP servers, token metrics etc. So it's not going to be that you have two APIM instances running one with AI gateway tier and one with another. You select based on your use case. I don't see a reason why a medium to big size enterprise won't just use the current v2 SKU with ai gateway features. Or probably you need to separate your AI gateway with you enterprise API gateway.
https://learn.microsoft.com/en-us/azure/api-management/genai-gateway-capabilities
https://iaminazure.substack.com/p/azure-api-management-ai-gateway-capabilities
Tried capturing the difference