Admin locked out users from azure portal by mistake with Conditional Access

So an admin created a conditional access policy that I can only assume was set to all users/all apps and has locked us out of our admin portal. Is there a way to gain access to turn this policy off? ...