Cancel an invite when the Team is deleted

We have installed Microsoft Teams Free and tried to get a grip on how to use it. Unfortunately we used our "real" email addresses!

To make a long story short.

1. We created a Team

2. Invites were sent

3. Before some of the users has accepted the invite the Team was removed/deleted

So now when these users start Teams they get a message that they have an invite, but since the Team is not there anymore the Accept will return an error

Invitation redemption failed
AADB2B_0027 : Your invitation was revoked. Please ask your inviter to invite you again.

RequestId: 79626f93-cc0d-40b8-b896-775a5cebade2
Correlation Id:16611c5e-b6ac-459d-93a4-7d6472367552
Timestamp:2020-04-01 09:30:49Z

The really annoying thing is that it's impossible to start Teams without accepting the invite!

Is there someway to remove this invite?