Azure Monitor Private Links introduces new modes and enforces Network Isolation strictly

Published Jul 29 2021 05:38 AM 2,096 Views
Microsoft

*** Update: The below update to Network Isolation settings enforcement and the addition of AMPLS flags will be release by end of August, 2021 ***

 

Azure Monitor Private Links are used extensively, to provide a direct, private connection between customer VNets and their monitoring resources - Log Analytics workspaces and Application Insights components. We continuously see more customers and more traffic going to Private Links, and with it also a need to improve how it is controlled and applied to networks and resources.

 

Starting mid-August, we'll roll out two improvements intended to help you both onboard private links, and use it as best fits your needs.

Note that networks deploying new Private Link setups after this date will default to a new, open behavior, allowing these networks to reach non-private-link resources as well!

 

Selecting how Private Links apply to your network traffic - an open vs a private mode

Until now, Azure Monitor Private Links acted mostly as "All or Nothing" - it required organizations to onboard all their resources to Private Links, or none at all. Customer feedback showed us that this requirement made onboarding too difficult, and also wasn't truly required for all customers. Many customers wish to use Private Links for some resources, but not limit their Azure Monitor traffic to Private Links alone.

 

Starting August 16, 2021, we'll have new controls to allow you to choose how Private Links should apply to your networks:

  • Private Only mode - allowing network traffic to reach only resources added to the network's Azure Monitor Private Link Scope (AMPLS)
  • Open mode - allowing network traffic to reach AMPLS resources as well as resources out of the AMPLS. Note that requests sent to resources out of the AMPLS aren't valid Private Link requests (by definition) so they will only go through if the target resource allows query/ingestion from public networks.

While using the open mode, you get these Private Link benefits - 

  • Allowing closed VNets with no internet access to reach Azure Monitor resources through a private IP, over the Microsoft backbone
  • Protecting from data infiltration (foreign data leaking in) by allowing resources (such as workspaces) to accept ingestion only over Private Link connections (meaning from known networks)

However, to fully protect your network and set handle the risk of data exfiltration (org data leaking out), use the Private Only mode, allowing your network to access only specific resources, through a Private Link. External resources won't be reachable to assure your logs remain within the boundaries you set. Before you switch to the Private Only mode, make sure to carefully map your Azure Monitor resources (Log Analytics workspaces and Application Insights components) and add them to the AMPLS. And remember - close your firewall, to make sure only your client on your network can only use Private Links.

 

Where can I set these settings?

These new settings can be set on the AMPLS to apply to all networks connecting to it, or even for specific networks (using the Private Endpoint Connections on the AMPLS). Note they are split between ingestion and query to give you the flexibility you may need. Initially you'll be able to set these settings through ARM templates, policies, CLI and REST calls, and later we'll support configuration through the Azure Portal.

You may already be able to see the new settings on your AMPLS JSON but will only be able to set them after August 16.

 

What are the default settings?

Creating a new AMPLS object will require you to provide your preferences (Open or Private Only, for ingestion and for queries). It will not have default values. We recommend using the Private Only mode cautiosly - while it is most secure and protects from data exfiltration, it also means traffic to resources not in the AMPLS will fail, across all networks that use share the DNS server, and regardless of subscription or tenant. We'd therefore recommend to start with the Open access mode, and switching to Private Only after adding all resources to the AMPLS. Using the Open mode means a Private Link will be used when possible (i.e., when the target resource is connected to an AMPLS) but won't drop requests to resources out of the AMPLS, as long as these resources accept queries/ingestion from public networks.

 

What happens to my existing setup?

Existing setups keep their existing behavior, which is:

  • Ingestion has a Private Only mode - ingestion requests are limited to resources in the AMPLS.
  • Query has an Open mode - queries can reach resources out of the AMPLS.

You can of course change these settings on your existing environment to fit your needs.

 

Avoiding configuration errors

Azure Monitor resources have Network Isolation settings that allow them to block queries and log ingestion from public networks (meaning the requests aren't sent over a Private Link). We found that in some cases users chose to block traffic from public networks without connecting the resource to an Azure Monitor Private Link Scope (AMPLS). That effectively meant the resource isn't accessible both publicly and privately. While this configuration is valid, in many cases it's a simple mistake.

 

A change of behavior: Network Isolation settings will be enforced strictly.

Our query mechanism treated this configuration as invalid, and therefore only blocked queries from public networks if the resource was associated with an AMPLS. Starting August 16, 2021, resources that block queries from public networks will stop accepting public queries, even if they're not associated with any AMPLS. Please make sure your workspaces and components don't block queries from public networks without connecting to an AMPLS for Private Link access.

 

Improved Network Isolation experience

In order to avoid configuration errors, the Network Isolation page has been updated to show clearer messages and also alert when users set an irregular configuration.

In addition, we're also alerting on irregular settings through a new banner, notifying you to review your Network Isolation configuration and avoid unintentionally blocking queries. 

Network isolation blade.png

  • Alerting on irregular settings - to help prevent mis-configuration and help prepare, a new banner will alert you if your resource configuration should be reviewed:

Banner.png

 

Feedback

We appreciate your feedback! comment on this blog post and let us know what you think of the this feature.

1 Comment
Occasional Contributor

Hi MS Peeps,

 

I am getting this message

 

"This resource has irregular settings that may prevent data ingestion and queries. You should review and edit its Network Isolation settings"

 

 

..now I go to change the toggle to turn it all off (there are no privatelink scopes set) and its says it has done what I have asked and it just turns it back on.   Only on this one LAW.   Can you advise of the settings to set to turn this to allow.  OR point me in the direction of the correct forum please.

 

Nath

%3CLINGO-SUB%20id%3D%22lingo-sub-2519136%22%20slang%3D%22en-US%22%3EAzure%20Monitor%20Private%20Links%20introduces%20new%20modes%20and%20enforces%20Network%20Isolation%20strictly%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2519136%22%20slang%3D%22en-US%22%3E%3CP%3E***%20Update%3A%20The%20below%20update%20to%20Network%20Isolation%20settings%20enforcement%20and%20the%20addition%20of%20AMPLS%20flags%20will%20be%20release%20by%20end%20of%20August%2C%202021%20***%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAzure%20Monitor%20Private%20Links%20are%20used%20extensively%2C%20to%20provide%20a%20direct%2C%20private%20connection%20between%20customer%20VNets%20and%20their%20monitoring%20resources%20-%20Log%20Analytics%20workspaces%20and%20Application%20Insights%20components.%26nbsp%3BWe%20continuously%20see%20more%20customers%20and%20more%20traffic%20going%20to%20Private%20Links%2C%20and%20with%20it%20also%20a%20need%20to%20improve%20how%20it%20is%20controlled%20and%20applied%20to%20networks%20and%20resources.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EStarting%20mid-August%2C%20we'll%20roll%20out%20two%20improvements%20intended%20to%20help%20you%20both%20onboard%20private%20links%2C%20and%20use%20it%20as%20best%20fits%20your%20needs.%3C%2FP%3E%0A%3CP%3ENote%20that%20networks%20deploying%20new%20Private%20Link%20setups%20after%20this%20date%20will%20default%20to%20a%20new%2C%20open%20behavior%2C%20allowing%20these%20networks%20to%20reach%20non-private-link%20resources%20as%20well!%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--413253399%22%20id%3D%22toc-hId--385693940%22%20id%3D%22toc-hId--385693940%22%20id%3D%22toc-hId--385693940%22%3E%3CSTRONG%3ESelecting%20how%20Private%20Links%20apply%20to%20your%20network%20traffic%20-%20an%20open%20vs%20a%20private%20mode%3C%2FSTRONG%3E%3C%2FH2%3E%0A%3CP%3EUntil%20now%2C%20Azure%20Monitor%20Private%20Links%20acted%20mostly%20as%20%22All%20or%20Nothing%22%20-%20it%20required%20organizations%20to%20onboard%20all%20their%20resources%20to%20Private%20Links%2C%20or%20none%20at%20all.%20Customer%20feedback%20showed%20us%20that%20this%20requirement%20made%20onboarding%20too%20difficult%2C%20and%20also%20wasn't%20truly%20required%20for%20all%20customers.%20Many%20customers%20wish%20to%20use%20Private%20Links%20for%20some%20resources%2C%20but%20not%20limit%20their%20Azure%20Monitor%20traffic%20to%20Private%20Links%20alone.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EStarting%20August%2016%2C%202021%2C%20we'll%20have%20new%20controls%20to%20allow%20you%20to%20choose%20how%20Private%20Links%20should%20apply%20to%20your%20networks%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EPrivate%20Only%20mode%20-%20allowing%20network%20traffic%20to%20reach%20only%20resources%20added%20to%20the%20network's%20Azure%20Monitor%20Private%20Link%20Scope%20(AMPLS)%3C%2FLI%3E%0A%3CLI%3EOpen%20mode%20-%20allowing%20network%20traffic%20to%20reach%20AMPLS%20resources%20as%20well%20as%20resources%20out%20of%20the%20AMPLS.%20Note%20that%20requests%20sent%20to%20resources%20out%20of%20the%20AMPLS%20aren't%20valid%20Private%20Link%20requests%20(by%20definition)%20so%20they%20will%20only%20go%20through%20if%20the%20target%20resource%20allows%20query%2Fingestion%20from%20public%20networks.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EWhile%20using%20the%20open%20mode%2C%20you%20get%20these%20Private%20Link%20benefits%20-%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EAllowing%20closed%20VNets%20with%20no%20internet%20access%20to%20reach%20Azure%20Monitor%20resources%20through%20a%20private%20IP%2C%20over%20the%20Microsoft%20backbone%3C%2FLI%3E%0A%3CLI%3EProtecting%20from%20data%20infiltration%20(foreign%20data%20leaking%20in)%20by%20allowing%20resources%20(such%20as%20workspaces)%20to%20accept%20ingestion%20only%20over%20Private%20Link%20connections%20(meaning%20from%20known%20networks)%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EHowever%2C%20to%20fully%20protect%20your%20network%20and%20set%20handle%20the%20risk%20of%20data%20exfiltration%20(org%20data%20leaking%20out)%2C%20use%20the%20Private%20Only%20mode%2C%20allowing%20your%20network%20to%20access%20only%20specific%20resources%2C%20through%20a%20Private%20Link.%20External%20resources%20won't%20be%20reachable%20to%20assure%20your%20logs%20remain%20within%20the%20boundaries%20you%20set.%20Before%20you%20switch%20to%20the%20Private%20Only%20mode%2C%20make%20sure%20to%20carefully%20map%20your%20Azure%20Monitor%20resources%20(Log%20Analytics%20workspaces%20and%20Application%20Insights%20components)%20and%20add%20them%20to%20the%20AMPLS.%20And%20remember%20-%20close%20your%20firewall%2C%20to%20make%20sure%20only%20your%20client%20on%20your%20network%20can%20only%20use%20Private%20Links.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId--1519643284%22%20id%3D%22toc-hId--1492083825%22%20id%3D%22toc-hId--1492083825%22%20id%3D%22toc-hId--1492083825%22%3E%3CSTRONG%3EWhere%20can%20I%20set%20these%20settings%3F%3C%2FSTRONG%3E%3C%2FH4%3E%0A%3CP%3EThese%20new%20settings%20can%20be%20set%20on%20the%20AMPLS%20to%20apply%20to%20all%20networks%20connecting%20to%20it%2C%20or%20even%20for%20specific%20networks%20(using%20the%20Private%20Endpoint%20Connections%20on%20the%20AMPLS).%20Note%20they%20are%20split%20between%20ingestion%20and%20query%20to%20give%20you%20the%20flexibility%20you%20may%20need.%20Initially%20you'll%20be%20able%20to%20set%20these%20settings%20through%20ARM%20templates%2C%20policies%2C%20CLI%20and%20REST%20calls%2C%20and%20later%20we'll%20support%20configuration%20through%20the%20Azure%20Portal.%3C%2FP%3E%0A%3CP%3EYou%20may%20already%20be%20able%20to%20see%20the%20new%20settings%20on%20your%20AMPLS%20JSON%20but%20will%20only%20be%20able%20to%20set%20them%20after%20August%2016.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-967869549%22%20id%3D%22toc-hId-995429008%22%20id%3D%22toc-hId-995429008%22%20id%3D%22toc-hId-995429008%22%3E%3CSTRONG%3EWhat%20are%20the%20default%20settings%3F%20What%20happens%20to%20my%20existing%20setup%3F%3C%2FSTRONG%3E%3C%2FH4%3E%0A%3CP%3E%3CSTRONG%3EBy%20default%2C%20new%20Private%20Link%20setups%20will%20use%20the%20Open%20mode%3C%2FSTRONG%3E%20-%20allowing%20both%20ingestion%20and%20query%20requests%20to%20reach%20all%20resources.%20This%20means%20a%20Private%20Link%20will%20be%20used%20when%20possible%20(i.e.%2C%20when%20the%20target%20resource%20is%20connected%20to%20an%20AMPLS)%20but%20won't%20drop%20requests%20to%20resources%20out%20of%20the%20AMPLS%2C%20as%20long%20as%20they%20accept%20queries%2Fingestion%20from%20public%20networks.%3C%2FP%3E%0A%3CP%3EThese%20setting%20were%20selected%20to%20allow%20for%20an%20easy%20onboarding%20to%20Azure%20Monitor%20Private%20Links%2C%20without%20force-applying%20it%20to%20all%20resources%20in%20your%20environment.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EExisting%20setups%20keep%20their%20existing%20behavior%2C%20which%20is%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EIngestion%20has%20a%20Private%20Only%20mode%20-%20ingestion%20requests%20are%20limited%20to%20resources%20in%20the%20AMPLS.%3C%2FLI%3E%0A%3CLI%3EQuery%20has%20an%20Open%20mode%20-%20queries%20can%20reach%20resources%20out%20of%20the%20AMPLS.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3EYou%20can%20of%20course%20change%20these%20settings%20on%20your%20existing%20environment%20to%20fit%20your%20needs.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--1540649492%22%20id%3D%22toc-hId--1513090033%22%20id%3D%22toc-hId--1513090033%22%20id%3D%22toc-hId--1513090033%22%3E%3CSTRONG%3EAvoiding%20configuration%20errors%3C%2FSTRONG%3E%3C%2FH2%3E%0A%3CP%3EAzure%20Monitor%20resources%20have%20Network%20Isolation%20settings%20that%20allow%20them%20to%20block%20queries%20and%20log%20ingestion%20from%20public%20networks%20(meaning%20the%20requests%20aren't%20sent%20over%20a%20Private%20Link).%20We%20found%20that%20in%20some%20cases%20users%20chose%20to%20block%20traffic%20from%20public%20networks%20without%20connecting%20the%20resource%20to%20an%20Azure%20Monitor%20Private%20Link%20Scope%20(AMPLS).%20That%20effectively%20meant%20the%20resource%20isn't%20accessible%20both%20publicly%20and%20privately.%20While%20this%20configuration%20is%20valid%2C%20in%20many%20cases%20it's%20a%20simple%20mistake.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId-1647927919%22%20id%3D%22toc-hId-1675487378%22%20id%3D%22toc-hId-1675487378%22%20id%3D%22toc-hId-1675487378%22%3E%3CSTRONG%3EA%20change%20of%20behavior%3A%20Network%20Isolation%20settings%20will%20be%20enforced%20strictly.%3C%2FSTRONG%3E%3C%2FH4%3E%0A%3CP%3E%3CEM%3EO%3C%2FEM%3Eur%20query%20mechanism%20treated%20this%20configuration%20as%20invalid%2C%20and%20therefore%20only%20blocked%20queries%20from%20public%20networks%20if%20the%20resource%20was%20associated%20with%20an%20AMPLS.%20Starting%20August%2016%2C%202021%2C%20resources%20that%20block%20queries%20from%20public%20networks%20will%20stop%20accepting%20public%20queries%2C%20even%20if%20they're%20not%20associated%20with%20any%20AMPLS.%20Please%20make%20sure%20your%20workspaces%20and%20components%20don't%20block%20queries%20from%20public%20networks%20without%20connecting%20to%20an%20AMPLS%20for%20Private%20Link%20access.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId--159526544%22%20id%3D%22toc-hId--131967085%22%20id%3D%22toc-hId--131967085%22%20id%3D%22toc-hId--131967085%22%3E%3CSTRONG%3EImproved%20Network%20Isolation%20experience%3C%2FSTRONG%3E%3C%2FH4%3E%0A%3CP%3EIn%20order%20to%20avoid%20configuration%20errors%2C%20the%20Network%20Isolation%20page%20has%20been%20updated%20to%20show%20clearer%20messages%20and%20also%20alert%20when%20users%20set%20an%20irregular%20configuration.%3C%2FP%3E%0A%3CP%3EIn%20addition%2C%20we're%20also%20alerting%20on%20irregular%20settings%20through%20a%20new%20banner%2C%20notifying%20you%20to%20review%20your%20Network%20Isolation%20configuration%20and%20avoid%20unintentionally%20blocking%20queries.%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22Network%20isolation%20blade.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F293745i0796575FC4071F83%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22Network%20isolation%20blade.png%22%20alt%3D%22Network%20isolation%20blade.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EAlerting%20on%20irregular%20settings%20-%20to%20help%20prevent%20mis-configuration%20and%20help%20prepare%2C%20a%20new%20banner%20will%20alert%20you%20if%20your%20resource%20configuration%20should%20be%20reviewed%3A%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22Banner.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F293743iF1524202CD776CF0%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22Banner.png%22%20alt%3D%22Banner.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH4%20id%3D%22toc-hId--1966981007%22%20id%3D%22toc-hId--1939421548%22%20id%3D%22toc-hId--1939421548%22%20id%3D%22toc-hId--1939421548%22%3EFeedback%3C%2FH4%3E%0A%3CP%3E%3CSPAN%3EWe%20appreciate%20your%20feedback!%20comment%20on%20this%20blog%20post%20and%20let%20us%20know%20what%20you%20think%20of%20the%20this%20feature.%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2519136%22%20slang%3D%22en-US%22%3E%3CP%3E***%20Update%3A%20The%20below%20update%20to%20Network%20Isolation%20settings%20enforcement%20and%20the%20addition%20of%20AMPLS%20flags%20will%20be%20release%20by%20end%20of%20August%2C%202021%20***%3C%2FP%3E%0A%3CP%3EStarting%20August%2016%2C%202021%2C%20Azure%20Monitor%20Private%20Links%20will%20allow%20you%20to%20select%20how%20it%20applied%20to%20your%20network%20-%20limit%20your%20traffic%20only%20to%20Private%20Link%20resources%20only%20or%20use%20an%20Open%20mode%2C%20to%20combine%20Private%20Link%20and%20public%20traffic.%20It%20will%20now%20default%20to%20the%20Open%20mode!%20Additionally%2C%20network%20isolation%20settings%20will%20apply%20more%20strictly%20after%20that%20date.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2779930%22%20slang%3D%22en-US%22%3ERe%3A%20Azure%20Monitor%20Private%20Links%20introduces%20new%20modes%20and%20enforces%20Network%20Isolation%20strictly%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2779930%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20MS%20Peeps%2C%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20am%20getting%20this%20message%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%22This%20resource%20has%20irregular%20settings%20that%20may%20prevent%20data%20ingestion%20and%20queries.%20You%20should%20review%20and%20edit%20its%20Network%20Isolation%20settings%22%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E..now%20I%20go%20to%20change%20the%20toggle%20to%20turn%20it%20all%20off%20(there%20are%20no%20privatelink%20scopes%20set)%20and%20its%20says%20it%20has%20done%20what%20I%20have%20asked%20and%20it%20just%20turns%20it%20back%20on.%26nbsp%3B%20%26nbsp%3BOnly%20on%20this%20one%20LAW.%26nbsp%3B%20%26nbsp%3BCan%20you%20advise%20of%20the%20settings%20to%20set%20to%20turn%20this%20to%20allow.%26nbsp%3B%20OR%20point%20me%20in%20the%20direction%20of%20the%20correct%20forum%20please.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3ENath%3C%2FP%3E%3C%2FLINGO-BODY%3E
Co-Authors
Version history
Last update:
‎Aug 26 2021 05:13 AM
Updated by: