SOLVED

Face detection for a video

%3CLINGO-SUB%20id%3D%22lingo-sub-283342%22%20slang%3D%22en-US%22%3EFace%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-283342%22%20slang%3D%22en-US%22%3E%3CP%3EHi%2C%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20uploaded%20a%20video%20to%20Stream%20for%20a%20podcast%20session%20filmed%20at%20Ignite.%20Face%20detection%20doesn't%20work%20(or%20at%20least%2C%20the%20People%20tab%20doesn't%20show%20up%20for%20the%20video).%20Other%20videos%20have%20the%20People%20tab.%20Is%20there%20anything%20I%20can%20do%20to%20force%20face%20detection%20to%20appear%3F%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F59212i87D4603E0003461D%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20alt%3D%22StreamVideo.jpg%22%20title%3D%22StreamVideo.jpg%22%20%2F%3E%3CSPAN%20class%3D%22lia-inline-image-caption%22%20onclick%3D%22event.preventDefault()%3B%22%3EVideo%20with%20no%20face%20detection%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-289811%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-289811%22%20slang%3D%22en-US%22%3E%3CP%3ENope.%20I%20have%20uploaded%20many%20videos%20in%20exactly%20the%20same%20manner%20and%20they%20all%20work.%20I've%20given%20a%20copy%20of%20the%20video%20to%20Microsoft%20and%20they%20have%20reproduced%20the%20problem.%20I'm%20now%20waiting%20for%20the%20benefit%20of%20their%20insight.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-289806%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-289806%22%20slang%3D%22en-US%22%3E%3CP%3EI%20think%20the%20fact%20that%20you%20just%20uploaded%20a%20video%20is%20the%20reason%20why%20you%20cant%20see%20your%20contact%20picture.%20Contact%20Pictures%20(not%20face%20recognized)%20are%20only%20available%20when%20you%20record%20the%20meeting%20directly%20in%20Teams%2C%20Stream%20or%20Yammer.%20And%20even%20then%20you%20wouldnt%20see%20an%20audio%20streams%20per%20user%20who%20attendeed%20with%20their%20respective%20contact%20picture.%20If%20all%20people%20are%20sitting%20in%20the%20same%20room%20then%20there%20is%20no%20way%20to%20authenticate%20people.%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThis%20is%20something%20what%20Microsoft%20showcased%20at%20Ignite%20and%20Build%20in%20the%20meeting%20room%20of%20the%20future%20session.%20See%20here%3A%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fyoutu.be%2Fddb3ZgAp9TA%26nbsp%3B%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3Ehttps%3A%2F%2Fyoutu.be%2Fddb3ZgAp9TA%3C%2FA%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-288122%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-288122%22%20slang%3D%22en-US%22%3E%3CP%3EThanks.%20I'm%20glad%20it's%20not%20just%20me.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EI%20suspect%20that%20the%20problem%20is%20due%20to%20the%20ugliness%20of%20the%20people%20on-screen.%20No%20self-respecting%20algorithm%20could%20process%20such%20horrible%20mugs.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-288107%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-288107%22%20slang%3D%22en-US%22%3E%3CP%3ESeems%20to%20repro%20on%20my%20Stream%20tenant%20as%20well.%20I%20filed%20an%20ticket%20to%20have%20one%20of%20our%20on%20call%20engineers%20take%20a%20look%20when%20they%20have%20time.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-288095%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-288095%22%20slang%3D%22en-US%22%3E%3CP%3EGot%20it%20and%20seeing%20if%20I%20can%20reproduce%20your%20issue%20too.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-288015%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-288015%22%20slang%3D%22en-US%22%3E%3CP%3EOneDrive%20link%20sent.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-288013%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-288013%22%20slang%3D%22en-US%22%3E%3CP%3ELooks%20like%20some%20sort%20of%20bug%20on%20our%20end%20if%20other%20videos%20are%20working%20fine%20to%20generate%20the%20face%20%2F%20people%20timeline.%20Can%20you%20send%20me%20the%20actual%20MP4%20and%20we%20can%20run%20it%20through%20on%20our%20end%20and%20have%20an%20engineer%20debug%3F%20(Or%20you%20can%20open%20up%20a%20support%20case%20and%20go%20that%20route).%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284521%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284521%22%20slang%3D%22en-US%22%3E%3CP%3EYes.%20I%20uploaded%20the%20video%20again%20and%20no%20joy.%20Same%20result.%3C%2FP%3E%0A%3CBLOCKQUOTE%3E%3CHR%20%2F%3E%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F869%22%20target%3D%22_blank%22%3E%40Chris%20Webb%3C%2FA%3E%26nbsp%3Bwrote%3A%3CBR%20%2F%3EAssuming%20you%E2%80%99ve%20tried%20uploading%20the%20video%20again%20and%20it%20still%20not%20do%20it%3F%3CHR%20%2F%3E%3C%2FBLOCKQUOTE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284363%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284363%22%20slang%3D%22en-US%22%3EAssuming%20you%E2%80%99ve%20tried%20uploading%20the%20video%20again%20and%20it%20still%20not%20do%20it%3F%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284353%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284353%22%20slang%3D%22en-US%22%3E%3CP%3EDon't%20think%20so...%20I%20have%20had%20E5%20for%20the%20last%20two%20years.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284339%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284339%22%20slang%3D%22en-US%22%3E%3CP%3EI%20had%20E5%20earlier%20this%20year%20and%20it%20worked%20for%20me%20but%20now%20I%20am%20E3.%26nbsp%3B%20Perhaps%20something%20is%20happening%20during%20this%20transition%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284338%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284338%22%20slang%3D%22en-US%22%3E%3CP%3EI%20am%20licensed%20to%20the%20hilt.%20As%20I%20noted%20earlier%2C%20other%20videos%20have%20been%20processed%20for%20face%20detection.%20This%20one%20hasn't.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-284337%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-284337%22%20slang%3D%22en-US%22%3E%3CP%3ETo%20my%20knowledge%2C%20until%20this%20feature%20rolls%20out%20this%20month%20to%20everyone%2C%20only%20E5%20license%20holders%20can%20leverage%20Face%20and%20Search%20by%20Transcription.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-283449%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-283449%22%20slang%3D%22en-US%22%3E%3CP%3EMP4%20file%20uploaded%20from%20my%20PC.%20Always.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-283444%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-283444%22%20slang%3D%22en-US%22%3ESame%20video%20file%20format%3F%20Same%20source(upload%3F)%20that%20the%20others%20that%20do%20have%20this%20use%3F%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-283442%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-283442%22%20slang%3D%22en-US%22%3E%3CP%3EMy%20understanding%20is%20that%20if%20your%20account%20has%20an%20E5%20license%20(and%20soon%20any%20commercial%20Office%20365%20license)%2C%20the%20intelligent%20features%20including%20face%20detection%20are%20applied%20by%20Stream%20when%20you%20upload%20a%20video.%20At%20least%2C%20that's%20what%20has%20happened%20in%20the%20past.%20It's%20just%20this%20video%20that%20I%20am%20having%20a%20problem%20with%2C%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-283437%22%20slang%3D%22en-US%22%3ERe%3A%20Face%20detection%20for%20a%20video%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-283437%22%20slang%3D%22en-US%22%3EInteresting%2C%20didn't%20think%20that%20this%20used%20face%20detection%2C%20I%20always%20assumed%20it%20only%20worked%20on%20Team%20meeting%20recordings%20where%20it%20could%20tell%20who%20was%20talking%20and%20it%20tagged%20based%20on%20that.%20Curious%20to%20know%20what%20activates%20this%20myself.%3C%2FLINGO-BODY%3E
MVP

Hi,

 

I uploaded a video to Stream for a podcast session filmed at Ignite. Face detection doesn't work (or at least, the People tab doesn't show up for the video). Other videos have the People tab. Is there anything I can do to force face detection to appear?

 

Video with no face detectionVideo with no face detection

17 Replies
Interesting, didn't think that this used face detection, I always assumed it only worked on Team meeting recordings where it could tell who was talking and it tagged based on that. Curious to know what activates this myself.

My understanding is that if your account has an E5 license (and soon any commercial Office 365 license), the intelligent features including face detection are applied by Stream when you upload a video. At least, that's what has happened in the past. It's just this video that I am having a problem with,

Same video file format? Same source(upload?) that the others that do have this use?

MP4 file uploaded from my PC. Always.

To my knowledge, until this feature rolls out this month to everyone, only E5 license holders can leverage Face and Search by Transcription.

I am licensed to the hilt. As I noted earlier, other videos have been processed for face detection. This one hasn't.

I had E5 earlier this year and it worked for me but now I am E3.  Perhaps something is happening during this transition?

Don't think so... I have had E5 for the last two years.

Assuming you’ve tried uploading the video again and it still not do it?

Yes. I uploaded the video again and no joy. Same result.


@Chris Webb wrote:
Assuming you’ve tried uploading the video again and it still not do it?

 

Looks like some sort of bug on our end if other videos are working fine to generate the face / people timeline. Can you send me the actual MP4 and we can run it through on our end and have an engineer debug? (Or you can open up a support case and go that route).

OneDrive link sent.

Got it and seeing if I can reproduce your issue too.

Seems to repro on my Stream tenant as well. I filed an ticket to have one of our on call engineers take a look when they have time. 

Best Response confirmed by Marc Mroz (Microsoft)
Solution

Thanks. I'm glad it's not just me.

 

I suspect that the problem is due to the ugliness of the people on-screen. No self-respecting algorithm could process such horrible mugs.

I think the fact that you just uploaded a video is the reason why you cant see your contact picture. Contact Pictures (not face recognized) are only available when you record the meeting directly in Teams, Stream or Yammer. And even then you wouldnt see an audio streams per user who attendeed with their respective contact picture. If all people are sitting in the same room then there is no way to authenticate people. 

This is something what Microsoft showcased at Ignite and Build in the meeting room of the future session. See here: https://youtu.be/ddb3ZgAp9TA 

 

Modern meetings: On stage at Microsoft Build 2018, Teams marketing manager Raanah Amjadi explores how real-time AI services, Microsoft 365 and Cortana promot...

Nope. I have uploaded many videos in exactly the same manner and they all work. I've given a copy of the video to Microsoft and they have reproduced the problem. I'm now waiting for the benefit of their insight.