Sharepoint followed sites mismatch

I have been slowly introducing our company to SharePoint online.

The most asked feature by my co-workers is saving files from office applications directly to a SharePoint site.

I've discovered the 'follow site' feature on SharePoint. By my understanding this should make the 'followed' SharePoint site visible in the 'followed' segment of the save (or open) dialog in an Office Application.

However the sites listed in my application do not match the followed SharePoint sites. I started following these many hours ago.

Am I missing something? I want to minimize the usage of the OneDrive sync function. To avoid excessive disk usage on our RDS hosts.