Microsoft 365 Apps: Outlook Cached Mode not working using Office Apps Policies

Has anybody ran into a problem setting up a new policy configuration in the 'Apps Admin Center' to turn on Cached Mode in Outlook? No GPOs, strickly cloud policy. If I open Outlook and look at the cached mode settings, the cloud policies are getting pushed to the client because I set the offline mail for 6 months. The box remains un-ticked, if I tick it and click apply/ok and close out Outlook and relaunch it, the check box is unticked again. I have tried everything in my power, I don't know if the latest Office has a bug or not.