Issue with Conditional access

I have a question regarding the conditional access.

So, the scenerio is Admin want the user who are using the Exchange Active Sync to continue using that, but if any user wants to use Outlook, user would require to enroll the device.

I have create a CA policy where I have UNCHECKED the exchange active sync client. So the policy should exclude that user who are using EAS. But as soon as the policy gets applied. The user who are using exchange active sync are also getting the prompt to enroll the device.

How we can achieve the goal. "Without enrollment user who are using EAS will get access" and user who wish to use Outlook would get a prompt to enroll device.