Azure RMS templates not always applied.

Are these two templates scoped to specific users or groups? It's hard for me to tell from the screenshot but that's the first thing that comes to mind why you wouldn't be able to see them in Exchange Online (mail flow rules or Outlook on the web) but the specified users can see them in their Office apps. The other possibility is that your tenant isn't yet configured for Office 365 Message Encryption new capabilities, which also automatically makes these templates available to Exchange Online (see https://docs.microsoft.com/en-us/azure/information-protection/deploy-use/refresh-templates). To check, run Get-IRMConfiguration to confirm that AzureRMSLicensingEnabled is set to True.