Teams pulls up main window after switching application windows during a meeting

I hope I can explain this properly, please let me know if it isn't clear.

OS: macOS Sonoma

Teams version: 24277.3502.3161.3007

When I am in a Teams call, I will often need to temporarily switch windows to Chrome or another application. When I tab back to the Teams call, the Main Teams window will pop up on top of the call, which requires me to minimize it in order to view the call window. I haven't been able to find a setting that addresses this specifically. 

Simplified steps:

1. Join a Teams call from the the primary Teams window or Outlook calendar
2. Switch applications to something else - Slack, Chrome, etc.
3. Click the Teams icon in the dock
4. The Teams call will take focus
5. The Teams main window automatically pops up overlays the call, hiding it

Thanks in advance for your help and please let me know if there is anything I can clarify.