Issue with Teams and USB connected audio devices

When I connect an audio device over USB to my laptop, Teams opens and then immediately disconnects the meeting. I can connect the same devices over Bluetooth and I do not get the issue.

I have tried this on two different Jabra speakers and a Sennheiser headset, so it doesn't seem to be related to the device manufacturer.

I am using a HP G5 Zbook 360x. All drivers and BIOS are up to date.