Removed useres can read chats of a team

So we removed a user from all of our teams and from the whole organization. Now, about a month later, the person in question admitted to still being able to read all of our chats. Only after logging ...