Sensitivity labels still showing after user removed from policy

We use an Office 365 Group to scope a sensitivity label policy. There is only one policy in tenant that publishes labels to 'Office 365 Group'. We removed a user from the Group but even after waiting 24 hours, labels are still showing for this user. Anyone know why that could be or anything we can do to check?