Gateway Users getting You are not authorized to access this site. Please contact your administrator.

Windows Admin center is integrated with Azure to control access and few accounts are added to Gateway Users.

Accounts those are added to Gateway users, when they try to access Windows Admin Center they are getting below error

"You are not authorized to access this site. Please contact your administrator"