Sensitivity labels still showing after user removed from policy

We use an Office 365 Group to scope a sensitivity label policy. There is only one policy in tenant that publishes labels to 'Office 365 Group'. We removed a user from the Group but even after waiting...