Removing access to Office 365 group and sharepoint doesn't clean up local folders.

We use onedrive for business and sharepoint to manage access to documents. We regularly add/remove users from groups as needed. If a user has synced a sharepoint library and then is later removed from the group then the onedrive client throws an error that it can no longer sync the group and the user has to go into the onedrive client and remove the location from syncing and then more importantly the local folder is not cleaned up and any previously synced files are not deleted unless the user manually goes and deletes the folder.

What is the correct way to manage this as we have no confidence that files files aren't being left accidently left on devices even though we are managing access correctly.

thanks