Hybrid Modern auth Exchange On Prem only for external access

Hello, we would like to implement HMA to access Exchange On prem servers from internet. (Dynamics 365 access)

I want to be sure that internal users will not use HMA to minimize impact (password request, reauthentication,...)

We installed 2 Exchange servers in a new AD site  where we enabled only oauth for the virtual directories.

Oauth is configured but I still need to run 2 commands :

Set-AuthServer -Identity "EvoSts - d1c9beac-0655-48e7-9949-5e497af1d38d" -IsDefaultAuthorizationEndpoint $true
Set-OrganizationConfig -OAuth2ClientProfileEnabled $true

I'm afraid that after I run those commands all the internal users will also try to log on using HMA.

Can I disable HMA on the other internal servers? 

Rgds

Jean-Marc