Secure access client when PC is On-prem

We've been having similar issues, though I believe this may be by design. The Global Secure Access Client appears to not care whether you're on the LAN with the target or not, it always proxies the connection unless you pause the client. I was testing the client with RDP - it worked greate remotely. However, when I was on prem with the server I was RDPing in to with the client active, my round trip time was >100ms, with the client paused, it was <1ms.

I appreciate that this allows us to layer on modern auth and conditional access regardless of where the client is in relation to the target resource, but this needs to be a behavior that I as an administrator have control over because - in most cases - we'd rather the client not proxy at all if they don't need to, especially considering the performance implications we've witnessed.