Does Microsoft 365 Copilot Agent Builder support OCR and image analysis for SharePoint?
Hello everyone, I am currently testing a Microsoft 365 Copilot Agent Builder agent that is grounded on SharePoint document libraries. During testing, I observed that the agent can successfully analyze and generate responses from text-based documents such as Word, Excel, PowerPoint, PDF, CSV, and TXT files. However, when folders contain image-based files (JPG/PNG), the agent sometimes reports incomplete analysis or is unable to extract information from those files. I would appreciate clarification on the following: Does Microsoft 365 Copilot Agent Builder officially support OCR (Optical Character Recognition) for JPG and PNG files stored in SharePoint? Can Agent Builder natively analyze image-based content, or is this capability only available through Copilot Studio with additional AI services? Are there any documented limitations regarding image processing compared to text-based document processing? Has anyone successfully implemented a SharePoint-grounded Agent Builder solution that can reliably analyze scanned images, photographs, or image-based documents? If OCR/image analysis is not currently supported, is there a recommended Microsoft solution or architecture for achieving this requirement?
Copilot OneDrive and Teams Integration useless for PDFs of scanned documents
Hi, I have this ubiquitous Copilot button everywhere in OneDrive, Teams, SharePoint, you name it. But Everytime I use the suggested „Summarise this file“ button of a PDF document that contains scanned pages Copilot complains that the images are very low resolution and nothing meaningful can be extracted. But when I let Copilot analyse the exact same file in the pure Copilot view everything works fine. After some lengthy conversations with Copilot it admits, that it only access the complete file when the Copilot view is used. In all other views using Copilot only works on the preview images that are created of the file when uploaded. That explains why the images to analyse are of a too low resolution to do OCR and why on some files only the first page gets processed. Why is Copilot integrated in that way? I expect Copilot to always work on the original file for any request I do. Especially when Copilot is promoted everywhere and I’m constantly nagged to get a summary or FAQ of a selected file. The way it currently works would be better removed or -better- just redirect with the selected file into Copilot view. Cheers
Spent hours trying to build an employee feedback workflow with Power Automate
Someone on our leadership team asked if we could set up a system where employees can give each other continuous feedback through Teams. I spent the last two days trying to build this with Power Automate + Forms + SharePoint and honestly its a mess. The form submissions dont tie back to employee profiles cleanly, theres no good way to aggregate feedback per person over time. Is there a more elegant way to handle continuous feedback within the M365 stack?Copilot and DLP policy behaviours
Hi Copilot Brain Trust, Looking for some real-world experiences with Microsoft 365 Copilot DLP enforcement. We've implemented a DLP policy targeting the Microsoft 365 Copilot location with the action to prevent Copilot from processing content that contains our sensitivity label (restricted). The implementation is based on the following Microsoft documentation: DLP for Microsoft 365 Copilot: https://learn.microsoft.com/en-us/purview/dlp-microsoft365-copilot-location-learn-about Create DLP policies for Microsoft 365 Copilot: https://learn.microsoft.com/en-us/purview/dlp-microsoft365-copilot Microsoft documentation states that when a DLP policy blocks Copilot processing, protected content should not be processed or used in Copilot-generated responses (although citations may still appear). However, during testing we're observing scenarios where Copilot appears to access/process provide restricted snippet with file names from content that should be protected by the DLP policy. A few questions for anyone who has implemented this in production: Have you successfully validated DLP policies preventing Copilot from summarising sensitivity-labelled content? Are there any known delays between policy deployment and enforcement? Have you observed differences between Copilot Chat and Copilot experiences within Word, Excel, or PowerPoint? Are there any prerequisites, limitations, or known issues not currently reflected in the public documentation? I'm interested to hear whether others have seen similar behaviour or have successfully validated this scenario end-to-end. Thanks in advance.
Feature Proposal: OS-level Intelligent Task Organizer (Windows + Copilot)
A Idea about Intelligent Tasks organizer, I have to remember a lot of things during the team meetings like what is been said (we'll schedule a call or follow up etc.,) and what has been communicated in the emails (I'll get back to you after 2 weeks, or call us after two weeks) , And notes that I took in the notepad, or notepad ++,or sticky notes, or word, or one note. I want to chronologically display tasks on the right hand side of the laptop screen just like sticky note and it shall display all tasks one by one, it shall remove tasks are already complete (email sent with confirmation). and arrange, adjust every few mins according to priority/time or user added priority. App shall display small icon (just like chat) upon clicking it shall display ordered list of tasks. and desktop apps like teams/note/word/notepad++,sticky notes can participate by default or other apps like notepad++ can be onboarded manually in to the app. You can use a local model which infers the meaning of “I’ll call you in two weeks” - who is “I”? you or them? “Let’s follow up later” - task or casual statement? “I sent it” - which task did this complete? You can use a local model such that Corporate Teams/Outlook access may allow by corporate policy. Need to put much emphasis on false positives if the app keeps inventing tasks. Do not need to bring big LLMs in to the picture for inference, because of corporate policies may not allow. Microsoft provides operating system,office 365, tools with copilot, the inference can be possible because of all apps/content can be accessible at os level. Problem: Users capture tasks across multiple tools: Teams meetings and chats Outlook emails Notes (OneNote, Notepad, Sticky Notes, Word) Tasks become fragmented, untracked, and often lost. Proposed Solution: A lightweight system-level task layer integrated with Windows + Copilot that: Core Features Automatic task extraction From Teams, Outlook, notes, and user text Example interpretations: “I’ll call you in 2 weeks” “Let’s follow up later” Context-aware inference (local model) Identify: Task owner (“I” vs “you”) Priority signals Deadlines Minimize false positives Chronological task timeline Tasks auto-organized by: Time Priority Recency Floating task panel (desktop UI) Docked widget (like Sticky Notes or chat bubble) Expand/collapse view Always visible option Automatic task lifecycle tracking Detect completion: “Email sent” “File shared” Remove or mark complete automatically Continuous re-prioritization Adjust every few minutes based on: New inputs Deadlines User behavior Privacy-first architecture Use local models (SLM) instead of large cloud LLMs Enterprise admin control for data access Why this matters: Millions of users manually track tasks across fragmented tools, losing productivity daily. This feature would unify task understanding across the OS and M365 ecosystem.Copilot missing in Word, Excel and PowerPoint desktop apps of some users
Hi Everyone, At my company we're setting up copilot. After allowing access through the Admin Centers we've encountered various oddities. Some users can use the sharepoint/onedrive search functionality. But most can't. Some users have the Copilot button in some of their apps. There is no consistency in which app they get it. Some have it in word, others in excel, some in multiple, some in none. A handful of users have Copilot in all apps. Things like transcribe work fine everywhere. We switched intune to push Office apps with Current Channel instead of Semi-Annual, to no avail. We use M365 Business premium with the Teams phone standard addon.Copilot + SharePoint Search: How AI Changes Information Discovery
Traditional SharePoint Search has always relied on keywords, filters, and user intuition. While it often assumes users know what they’re looking for and how it’s stored. With the introduction of Microsoft Copilot, SharePoint Search is undergoing a fundamental transformation from keyword-based retrieval to AI-driven information discovery. https://dellenny.com/copilot-sharepoint-search-how-ai-changes-information-discovery/
