Blog Post

Azure Arc Blog
5 MIN READ

Build, deploy, and govern sovereign AI with Foundry Local on Azure Local

insagiv's avatar
insagiv
Icon for Microsoft rankMicrosoft
Jun 02, 2026

Not every AI workload can run in the cloud. For many of our customers, data needs to stay within defined boundaries, connectivity may be limited or absent, and latency, governance, and auditability are non-negotiable. 

With Foundry Local on Azure Local, you can use the same model catalog, developer workflows, and governance capabilities you know from Azure, while running AI entirely within your own environment where your data resides. 

  • Foundry Local provides the model catalog and developer experience. 
  • Azure Local provides the customer-managed infrastructure. 
  • Azure Arc provides unified policy, governance, and lifecycle management across cloud and local environments. 

This gives developers a consistent way to build, deploy, and operate AI. The same az commands, the same model catalog, the same Arc policies, all running on hardware you control.  

Expansion of Foundry Local on Azure Local  

We're expanding the Foundry Local model offering on Azure Local, with support for multi-node deployments and new agents and tools that run locally, in preview. 

  • Deploy and run AI models locally. Run models with Foundry Local in customer-managed environments on Azure Local, across sovereign, private, and edge scenarios, including fully disconnected operation. 
  • Choose from a flexible, high-performance model catalog. Access proprietary and community models through Foundry Local, now expanded with vLLM-optimized models alongside ONNX-based offerings. You explore and deploy through the same catalog API experience, then operate locally on Azure Local. 
  • Build for production realities. Bring governance, identity, and auditability into your applications while keeping execution inside your controlled boundary. 

See what’s new in Foundry Local on Azure Local in the Tech Community blog.

From intelligence to action: agents and tools inside the enterprise boundary 

Most production AI use cases need two things: grounded answers and the ability to act on them, without sending data outside the environment. Here's how we're enabling that locally. 

  • Preview: Agentic retrieval with Foundry Local: Ground agents in enterprise data using retrieval-augmented generation across local Microsoft 365 services, including Exchange and SharePoint. Read the Tech Community blog to learn more. 
  • Preview: Agents and tools with Foundry Local: Build AI systems that reason, retrieve information, and take action within customer-controlled environments. Learn more.
  • Preview: Developer acceleration templates: Jump-start local AI application development with new Foundry solution templates, including local chat experiences and video agents, powered by Azure AI Video Indexer. Read the Tech Community to learn more.

GitHub Enterprise Local: Now available in public preview 

Sovereign AI is also about how systems are built and secured, not just where they run. With GitHub Enterprise Local on Azure Local, you can bring your full software development lifecycle on-premises:  

  • Source control and repositories 
  • CI/CD pipelines 
  • Security and DevSecOps workflows 

GitHub Enterprise Local deploys entirely within customer-owned infrastructure, so teams get the developer tools they expect without compromising on data residency or operational control. This extends modern DevSecOps practice into sovereign environments and pairs naturally with the AI development workflows above: build, secure, and ship your AI applications within the same boundary where they run. 

Read the tech community blog to learn more about GitHub Enterprise Local and how to join the preview.  

Accelerating High-performance AI at the Edge with NVIDIA  

We are expanding our collaboration with NVIDIA to deliver high-performance AI capabilities directly at the edge. 

At Build, we are bringing: 

  • Azure Local and Foundry Local on NVIDIA-powered GPUs, including NVIDIA RTX PRO 6000 Blackwell Server Edition, with expanded GPU support coming soon 
  • Integration with Nemotron models, optimized for enterprise performance 
  • A scalable foundation for data-intensive, low-latency workloads 

This partnership ensures that organizations can run advanced AI workloads where data is generated - without dependency on centralized cloud infrastructure. 

Hardware options: AI factory configurations are available now in the catalog  

Alongside our hardware partners, we’re bringing integrated solutions to customers building AI within sovereign environments. The Azure Local hardware catalog now includes AI factory configurations from our OEM partners, including NVIDIA-certified 8xH100 systems, with options from DataON, Dell, HPE, and Lenovo. These configurations are sized for the performance that model serving and agentic workloads require on customer-managed infrastructure. 

Together with Microsoft, we are advancing sovereign AI by bringing the open NVIDIA Nemotron model family to Microsoft Foundry Local on Azure Local. This collaboration gives organizations a production-ready AI platform that enables them to deploy AI where their data resides while maintaining the governance, control, and performance needed to scale AI across the enterprise.”
Kari Briski, VP Generative AI Software Products, NVIDIA

 

”Sovereign AI is becoming increasingly important for governments, regulated industries, and enterprises that want to use AI while maintaining control of their data, location, and operations. Lenovo’s ThinkAgile MX Series delivers trusted, enterprise-grade infrastructure with global deployment expertise to help customers run AI wherever their data resides. Co-engineered with Foundry Local and Azure Local, this solution provides an optimized platform to deploy, run, and scale AI locally with greater simplicity, consistency, and control, while helping meet strict data residency, security, and compliance requirements." 

Scott Patti - VP Infrastructure Solutions Group (ISG), Lenovo 

From AI models to trusted, mission-critical systems: what this unlocks for developers and operators  

AI is evolving from systems that answer questions to systems that plan, reason, and take action across workloads. These capabilities move AI from a cloud-only assumption to something you can deploy where sensitive work actually happens, with governance and operational controls intact. For our customers, this means you can now: 

  • Keep data, identities, and audit trails inside your sovereign boundary. 
  • Run AI inference and agentic workloads in connected, intermittently connected, or fully disconnected modes. 
  • Apply consistent policy and governance across cloud and local environments through Azure Arc. 
  • Use the same Foundry catalog and developer experience you already know, on infrastructure you own. 
  • Build, secure, and ship your AI applications with GitHub Enterprise Local, keeping source control, CI/CD, and DevSecOps workflows inside the same sovereign boundary. 

Resources  

Updated Jun 03, 2026
Version 7.0

1 Comment

  • Great new solution! Very exciting for those of us, that want or need to run things on premise. Love the options to run it large scale on Azure Local or small scale on Windows Server. Watch this video from the Build 26 "https://www.youtube.com/watch?v=8Y7IIw6jlSM". 

    The links from "Join us on Build" are not working for me.