Blog Post

Microsoft Teams Blog
4 MIN READ

Follow conversations with ease using Spatial Audio in Microsoft Teams

hongsod's avatar
hongsod
Icon for Microsoft rankMicrosoft
Aug 01, 2023

Microsoft released spatial audio for Teams to improve communication and reduce meeting fatigue in audio and video conferences. Spatial audio aims to mimic an in-person conversation by spatially separating the voices of individual meeting participants, which results in a more natural listening experience.

 

Creating realistic and engaging audio and video experiences that simulate dynamic real-world scenarios comes with challenges. For example, we rely on binaural hearing (that is, we use both ears) to help identify and distinguish the sources of sounds in the physical world. However, most audio and video communication applications today provide monophonic audio where speech signals from different participants are transmitted in a single audio channel, thus stripping away valuable spatial context our minds may be anticipating.

 

Teams Spatial Audio aligns the perceived audio location of each participant with their video representation to make it easier for users to track who is speaking, to understand better when multiple speakers are speaking at the same time, and to lower meeting fatigue and cognitive load. The following demo showcases the difference spatial audio can make (a stereo headset provides the best experience):


If you’re curious about the science behind the benefits of binaural hearing, dive into the well-known study of the “Cocktail Party Effect” [1] that outlines the brain’s ability to focus auditory attention on a single speech stimulus while filtering other sources of sound. The TLDR version is that two ears (and separate channels) help the listener process speech significantly more efficiently compared to using a single channel. Subsequent studies have shown that separating participants spatially can reduce the effect of sounds “masking” each other and may ultimately improve listener comprehension and memory [2]. Recent research shows video conferences with participants listening via loudspeakers and attendees listening through headsets prefer different levels of spatial separation with attendees listening through loudspeakers preferring greater “horizonal separation” than users listening through headsets [3].

Teams Spatial Audio is generally available on desktop applications and can be enabled by going to settings -> Devices to turn on spatial audio. Please note that you will need a stereo-capable device such as wired headsets or stereo-capable laptops. Bluetooth devices are currently not supported due to protocol limitation. Next generation LE Audio with stereo-enabled Bluetooth devices will be supported.

 

Try it out during your next meeting (or cocktail party) and discover how much easier it is to track who is speaking and to follow the flow of the conversation. While we cannot guarantee it will turn your next meeting into a posh event with fancy beverages and riveting small talk, we think you will find that Spatial Audio feels more natural and engaging.

 

Feature limitations:

Device support:

  • Currently we support wired headsets for spatial audio. They can be wired USB headsets or headsets connected to the computer audio jack. Some wireless headsets connected to the computer via USB dongle known to support stereo playback during a call are also supported.
  • We also support stereo open speakers (built-in or external speakers)
  • Native Bluetooth devices do not support stereo during a call, therefore spatial audio is not available. New Bluetooth standard LE Audio capable devices may support stereo in calls. For these devices, spatial audio will be supported.

Infrastructure related:

  • When a conference call has more than 100 users, some users who were typically in listening mode will be moved to satellite server. Currently, spatial audio is not supported for users on satellite server. When such users speak, they are typically moved back to central media server, spatial audio may become available. In future releases, all users will be supported for spatial audio.

Music mode:

  • Users can turn on music mode while receiving spatial audio. In this case, they will send audio in music mode (32kHz sampling and 128kbps), however, they will not be able to receive music mode when spatial audio is enabled. In order to receive music mode, the user needs to turn off spatial audio. Future releases will support receiving music mode in spatial audio.

Impact to Live Interpretation users:

  • In Live Interpretation mode, when spatial audio is turned on, main floor audio and interpreter audio will be heard at the same volume from different directions depending on the video location of the main floor speaker and the interpreter. To go back to traditional main floor audio ducking, simply disable spatial audio. Future releases will enable spatial audio for live interpretation where volume control for main floor and interpreter audio will be available.

 

 

 

References:

[1]: Cherry, E. Colin. "Some experiments on the recognition of speech, with one and with two ears." The Journal of the acoustical society of America 25.5 (1953): 975-979.
[2]: . Litovsky, Ruth Y. "Spatial release from masking." Acoust. Today 8.2 (2012): 18-25
[3]: Jeremy Hyrkas et al., “Spatialized Audio and Hybrid Video Conferencing: Where Should Voices be Positioned for People in the Room and Remote Headset Users?”. CHI ’23, April 23–28, 2023, Hamburg, Germany

Updated Aug 02, 2023
Version 2.0
  • I love the development of those types of functionalities aiming to enhance people's experience every day.

     

  • Rico_Malvar's avatar
    Rico_Malvar
    Copper Contributor

    This is awesome, Hong. Congratulations on driving the implementation of spatial audio in Teams!

  • Thank you for the positive comment Dimitri_Pletschette! We received user feedbacks telling us how much easier spatial audio made it for them to follow the speakers with reduced meeting fatigue.  

  • Nice enhancement! But why is not Apple devices with Apple headsets, that support Spatial Audio, supported?

  • HI Jacob Andersson , thanks for the question! We support all wired headsets. The reason we can't support the current native Bluetooth headsets on the market is because the BT protocol does not support stereo playback when in a call (it only supports two channels, one for mic, the other for speaker). Spatial audio requires stereo playback support during a call. That's why we can't support any native BT devices at this time. The good news is that the new LE Audio standard includes stereo support for native BT devices. Once these new devices come out, you will be able to experience spatial audio with any new BT headsets that support the LE Audio stereo playback profile. We will post update here once that happens. Stay tuned!

  • Thank you Rico_Malvar! Your team's work on soundscape was a great inspiration for spatial audio applications. 

  • Chris_TenAV's avatar
    Chris_TenAV
    Copper Contributor

    Great feature, although it doesn't mention spatial audio in Teams Rooms specifically. I can enable this on my MTR via XML config file but I don't believe there are any Teams-certified stereo speakers that support it yet. Unless someone can confirm otherwise? 

     

  • Chris_TenAV's avatar
    Chris_TenAV
    Copper Contributor

    hongsod thank you. Do you know which manufacturers currently have the hardware that supports spatial audio? Also, how do we configure the left and right speakers, would this be via XML file, Teams UI, etc? I just need to understand how integrators would implement this solution. Thanks again.

  • Hi Chris_TenAV, please find the officially certified stereo speakers compatible with MTR on Windows spatial audio here Teams Rooms certified systems and peripherals - Microsoft Teams | Microsoft Learn. Currently, the Q-SYS bundle stands as the sole certified option, with additional speaker certifications slated for the future. The spatial audio feature should be turned ON automatically when an MTR on Windows device connects to any stereo-capable speakers AND an IT admin applies "True" to the XML setting. To ensure optimal sound quality, it's essential to note that while spatial audio is designed to activate automatically, the best results are achieved with certified speakers.
    This documentation includes additional details, especially on the XML setting. https://learn.microsoft.com/en-us/microsoftteams/rooms/manage-front-row#spatial-audio-on-front-row-. Regarding the left and right speaker configuration, please follow your speaker OEM's guidelines.