We use the https://docs.microsoft.com/en-us/windows-server/remote/remote-desktop-services/clients/remote-desktop-web-client-admin (Latest version 1.0.27) Normally it works really well, but then once ...
This is a massive PITA for us for the same reason but your solution is a lot cleaner than what had been previously suggested which involved clearing the local browser cache on the client.