Teams mobile app phone number alert

Hello,
We started to test 365 Business Voice and every time our test users open the Teams mobile app, they see the alert that they have a phone number. Is there a way to stop this from appearing every time the app opens?