bicep
3 TopicsFinOps for AI Workloads on Azure: Tokens, PTU and Pay-As-You-Go
Originally published on Substack: https://gisli78.substack.com/p/finops-for-ai-workloads-on-azure Part 3 of my Azure AI landing zone series is about FinOps for AI workloads. Tokens are the AI bill most teams actually get, so the post covers: Picking the deployment type first: Global Standard, Data Zone, Batch and Flex (preview) Why quota isn't billing, and why max_tokens eats your TPM PTU vs pay-as-you-go, and when hourly PTU actually pays off Sizing PTU with Microsoft's formula, and how prompt caching helps Spillover: PTU for the baseline, pay-per-token for the peaks Showback per team with llm-token-limit and llm-emit-token-metric in API Management Cost Management: group by meter, tag your deployments, and remember budgets only alert Read the full article on Substack: https://gisli78.substack.com/p/finops-for-ai-workloads-on-azure Bicep sample: https://github.com/gislig/azure-ai-landing-zone/tree/main/examples/ai-finops82Views0likes0CommentsA secure Azure landing zone for AI: private endpoints, managed identity, APIM token limits (Bicep)
I wrote up a reference pattern for running Azure AI Foundry workloads inside a secure landing zone: Foundry (AIServices) behind a private endpoint with the three required private DNS zones, local auth disabled in favour of managed identity, and Azure API Management in front using llm-token-limit and llm-emit-token-metric to control and measure token usage. Article: https://gisli78.substack.com/p/a-secure-azure-landing-zone-for-ai Code (Bicep, with automated tests): https://github.com/gislig/azure-ai-landing-zone Feedback welcome, especially from anyone running this pattern in production. #mvpbuzz #azure #azug #microsoft116Views1like0CommentsBicep create random string with length of x
Hi Trying to create a storage account and I run into problems that StorageAccountAlredyTaken. What is best practice of doing this. // getting paramerts from json file param storageName string //pseudo code 1. get length of storageName 2. add random string behind "storageName" and add a random length of x-characters so that the storage name get 24 characters ex storageName = rg-supercode-dev-westeurope-<random>(total of 24 characters length)3KViews0likes1Comment