Azure ML Inference Cluster - AKS with Private IP

Copper Contributor

I have an AKS cluster in a VNET/Subnet. My AKS is linked to AzureML.

I successfully deployed an Azure ML service to that AKS.

However, I see that the azureml-fe service is responding to a public IP and not a private IP from my VNET/Subnet.

How can I make it so my AzureML inference service is exposed with a private IP?

1 Reply

Hi
You can implement for AKS and ML workspace Azure Private Link.
So you can have a fully private environment . Check also the limitations before implementing .
If you hide everything from the Internet you will need to provide a way to access workloads . It can be Jumphost inside the Azure or behind VPN /Express route connection .

https://docs.microsoft.com/en-us/azure/machine-learning/how-to-configure-private-link?tabs=python
https://docs.microsoft.com/en-us/azure/aks/private-clusters