SharePoint Capability to do OCR in PDF Documents

%3CLINGO-SUB%20id%3D%22lingo-sub-1045323%22%20slang%3D%22en-US%22%3ERe%3A%20SharePoint%20Capability%20to%20do%20OCR%20in%20PDF%20Documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1045323%22%20slang%3D%22en-US%22%3E%3CP%3EHi%20%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F10496%22%20target%3D%22_blank%22%3E%40Rizwan%20Ansari%3C%2FA%3E%26nbsp%3B%2C%3C%2FP%3E%3CP%3ESharePoint%20extracts%20content%20from%20pdf%2C%20images%20as%20text%2C%20so%20you%20can%20find%20using%20OOB%20Search.%20Btw%20you%20can't%20customize%20this%26nbsp%3Bbehavior%2C%20you%20need%20to%20use%20as%20it%20is.%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F159898i476DC009C69CCAA2%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22image-1.png%22%20title%3D%22image-1.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3Eif%20you%20need%20to%20customize%20your%20OCR%20experience%2C%20without%20using%20a%203P%20tools%2C%20you%20can%20think%20about%20a%20solution%20like%20%3CA%20href%3D%22https%3A%2F%2Fwww.federicoporceddu.com%2F2019%2F03%2F10%2Freact-ai-images-suggestion-a-spfx-sample-webpart-using-azure-cognitive-services%2F%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3Ethis%20one%3C%2FA%3E%20I%20described%20in%20my%20blog%2C%20using%20SharePoint%2C%20flow%20and%20Azure%20Cognitive%20Services.%3C%2FP%3E%3CP%3ECheers%2C%3C%2FP%3E%3CP%3EFederico%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1319305%22%20slang%3D%22en-US%22%3ERe%3A%20SharePoint%20Capability%20to%20do%20OCR%20in%20PDF%20Documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1319305%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F138334%22%20target%3D%22_blank%22%3E%40Federico%20Porceddu%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20saw%20your%20reply%20to%20his%20question%20on%20OCR%20so%20I%20wonder%20if%20you%20can%20help%20me.%20I%20have%20tens%20of%20thousands%20of%20PDFs%20and%20image%20files%20in%20my%20onedrive%20but%20I'm%20not%20sure%20if%20all%20of%20them%20are%20readable%20so%20when%20I%20do%20a%20keyword%20search%20on%20onedrive%20no%20files%20would%20escape%20my%20search.%20Do%20I%20need%20to%20identify%20pdf%20and%20image%20files%20that%20are%20not%20OCR%20enabled%20and%20convert%20them%20into%20OCR%3F%20if%20so%2C%20what%20would%20you%20recommend%3F%20finding%20and%20converting%20each%20file%20would%20take%20me%20years.%3C%2FP%3E%3CP%3EI%20thank%20you%20in%20advance%20for%20any%20help%20you%20can%20provide%20with%20this%20issue.%3C%2FP%3E%3CP%3ERegards%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1788919%22%20slang%3D%22en-US%22%3ERe%3A%20SharePoint%20Capability%20to%20do%20OCR%20in%20PDF%20Documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1788919%22%20slang%3D%22en-US%22%3E%3CP%3EWhat%20I'm%20reading%20from%20this%20diagram%2C%20though%2C%20is%20that%20the%20actual%20OCR%20for%20PDFs%20can%20only%20be%20accomplished%20by%20running%20the%20item%20through%20Power%20Automate%20and%20processing%20either%20with%20Cognitive%20Services%20or%20some%20other%20OCR%20engine%20like%20Muhimbi%20or%20Aquaforest.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EAm%20I%20correct%3F%20What%20about%20the%20run%20limitations%20in%20PowerAutomate%3F%20A%20user%20could%20potentially%20upload%20thousands%20of%20PDFs%20in%20a%20week%2C%20and%20I'd%20hate%20to%20hit%20the%20run%20limit...%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1868003%22%20slang%3D%22en-US%22%3ERe%3A%20SharePoint%20Capability%20to%20do%20OCR%20in%20PDF%20Documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1868003%22%20slang%3D%22en-US%22%3E%3CP%3EHi%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F29351%22%20target%3D%22_blank%22%3E%40Jason%20E.%20Heiser%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%3CP%3EFlow%20by%20Power%20Automate%20is%20a%20way%20to%20build%20personal%20flow%2C%20so%20your%20statement%20is%20correct%20%3A)%3C%2Fimg%3E%3C%2FP%3E%3CP%3EWhen%20designing%20the%20solution%2C%20you%20can%20consider%20using%20dedicated%20flows%20with%20a%20%22per-flow%22%20license%20or%20a%20Logic%20App%20on%20Azure.%3C%2FP%3E%3CP%3EIn%20this%20example%20I%20wanted%20to%20highlight%20the%20power%20of%20the%20low%20code%20solution%20-%20no%20code%2C%20but%20for%20personal%20use%2C%20not%20enterprise.%3C%2FP%3E%3CP%3EThanks%20for%20your%20comment%20%3A)%3C%2Fimg%3E%3C%2FP%3E%3CP%3ECheers%3C%2FP%3E%3CP%3EFederico%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-910507%22%20slang%3D%22en-US%22%3ESharePoint%20Capability%20to%20do%20OCR%20in%20PDF%20Documents%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-910507%22%20slang%3D%22en-US%22%3E%3CP%3EHi.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EWe%20have%20a%20requirement%20where%20all%20documents%20(PDF%2C%20Word%2C%20etc)%20with%20embedded%20images%20that%20are%20uploaded%20to%20SharePoint%20must%20be%20searchable.%20The%20text%20in%20the%20images%20must%20be%20searchable.%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EI%20did%20find%20one%20article%20which%20says%20that%20images%20uploaded%20in%20the%20library%20are%20automatically%20OCRed.%20Does%20SharePoint%20have%20similar%20feature%20for%20images%20embedded%20in%20PDF%20and%20word%20files%20or%20should%20we%20opt%20for%20some%20third%20party%20tool.%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EKindly%20assist.%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EThanks.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-910507%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EOCR%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ESharePoint%20DMS%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Occasional Contributor

Hi.

 

We have a requirement where all documents (PDF, Word, etc) with embedded images that are uploaded to SharePoint must be searchable. The text in the images must be searchable. 

 

I did find one article which says that images uploaded in the library are automatically OCRed. Does SharePoint have similar feature for images embedded in PDF and word files or should we opt for some third party tool. 

 

Kindly assist.

 

Thanks.

4 Replies

Hi @Rizwan Ansari ,

SharePoint extracts content from pdf, images as text, so you can find using OOB Search. Btw you can't customize this behavior, you need to use as it is.

image-1.png

if you need to customize your OCR experience, without using a 3P tools, you can think about a solution like this one I described in my blog, using SharePoint, flow and Azure Cognitive Services.

Cheers,

Federico

 

Hi @Federico Porceddu 

I saw your reply to his question on OCR so I wonder if you can help me. I have tens of thousands of PDFs and image files in my onedrive but I'm not sure if all of them are readable so when I do a keyword search on onedrive no files would escape my search. Do I need to identify pdf and image files that are not OCR enabled and convert them into OCR? if so, what would you recommend? finding and converting each file would take me years.

I thank you in advance for any help you can provide with this issue.

Regards

What I'm reading from this diagram, though, is that the actual OCR for PDFs can only be accomplished by running the item through Power Automate and processing either with Cognitive Services or some other OCR engine like Muhimbi or Aquaforest.

 

Am I correct? What about the run limitations in PowerAutomate? A user could potentially upload thousands of PDFs in a week, and I'd hate to hit the run limit...

Hi @Jason E. Heiser 

Flow by Power Automate is a way to build personal flow, so your statement is correct :)

When designing the solution, you can consider using dedicated flows with a "per-flow" license or a Logic App on Azure.

In this example I wanted to highlight the power of the low code solution - no code, but for personal use, not enterprise.

Thanks for your comment :)

Cheers

Federico