Forum Discussion
Is/will Copilot in Teams able to follow/process shared content in Teams Meetings?
My team frequently uses Teams meetings for code reviews and discussions to share screen and view each other's work. Is Copilot in Teams able to see/process shared content along with spoken audio to provide a wholistic summary of meeting content? This may also be useful in the case of shared files or live collaboration on M365 files like Word documents or PowerPoint presentations.
4 Replies
Based on latest announcement of Ai tool Copilot 365 in Teams is designed to process both shared content and spoken audio to provide a comprehensive summary of meeting content. This includes:
Screen sharing: Copilot can analyze content shared on screen, such as code, presentations, documents, and even websites.
Spoken audio: Copilot can transcribe and analyze spoken audio to understand the context of the conversation, identify key discussion points, and even attribute comments to specific speakers.
Shared files and live collaboration: Copilot can integrate information from shared files and live collaboration on M365 files like Word documents or PowerPoint presentations to provide a holistic view of the meeting content.
zaidhaqueMicrosoft
hi cyclingtrav925! We recently announced this capability in Ignite of last year. We're looking to get to GA sometime in Spring 2025. A big part of work was indeed around responsible AI and understanding images that are shared on screen. Our roadmap has a bit more information. https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=&searchterms=on-screen
Thanks for your interest in this feature!- cyclingtrav925
No, Copilot in Teams currently cannot directly see or process shared content within meetings, including screen shares or live collaboration on M365 files, to provide a holistic summary with spoken audio. There are two main reasons for this:
Privacy and Security: Granting Copilot access to the visual content of screen shares within Teams meetings raises privacy and security concerns. Microsoft prioritizes user privacy, and current APIs might not allow access to such visual data.
Focus on Text Data: Copilot is primarily designed to work with text-based information like emails, chats, and documents. Processing visual information like screen content is likely beyond its current capabilities.
