Get insights on application reliability and device restart frequency with Endpoint analytics

Published Mar 01 2021 09:00 AM 8,088 Views
Microsoft

Well-running apps are critical to a great endpoint experience. Users are never happy when an app crashes or a device restarts and their flow is broken. Worst case scenario, they may even lose the work that they just did. Service desks help solve these problems, but they only have visibility into the ones that people report, not the ones where someone just suffers in silence. What is needed is greater visibility into these issues across the entire organization. The two new Microsoft Endpoint Manager features in Endpoint analytics give IT admins the visibility and insights needed to help improve this experience.

 

Both of these features -- a new application reliability report and new data for reboot frequency in the existing startup performance report -- reflect our commitment to the user experience because users are happier when work isn’t slowed down and IT can focus on helping drive the business when there are fewer support calls.

 

The application reliability report, available in preview and rolling out over the next few days, gives IT visibility into which desktop applications are hampering the user experience, due to frequent crashes and because they are broadly deployed to users. The report also offers suggestions for improving app performance and alerts IT to issues that users may not have created tickets for yet despite growing frustration, which can help decrease the number of support tickets in the long run.

 

How to use the application reliability report

If your devices are Intune managed or co-managed, you don't need to do anything to see the application reliability report. It sits alongside the rest of the Endpoint analytics reports in the Microsoft Endpoint Manager admin center console. If you have devices enrolled through tenant attach, upgrade to Configuration Manger 2006 for this report to populate. On the Overview page is your app reliability score as well as a baseline score, which, by default, represents the median across all commercial organizations. This can help you determine issues unique to your environment—and potentially caused by poor configurations—versus more widespread issues.

 

Below that is a list of the apps most likely to have reduced user productivity during the previous 14 days. This considers not only crash frequency but also usage to help reduce noise, such as one-off applications crashing 100 times on a single device. On the right column are app reliability Insights and Recommendations prioritized by which are most likely to boost your score.

 

kuchinski_0-1614024603140.png

 

In the App performance tab is a list of all your organization’s apps, which can be sorted by app name, publisher, active devices, app reliability score, and mean time to failure, which is the average number of times the app can be used across the organization between crashes.

 

You can also see your organization’s application reliability performance by other pivots like model, and OS version deployed, as well as troubleshoot application reliability issues with individual devices. In device performance, each device is given a device app health score, based on how often applications crashed on that device during the previous 14 days. Clicking into each device gives you a timeline of app crash and app hang events so you know exactly when crashes occurred, which can help speed troubleshooting.

 

New insights into device restart frequency

To help improve the user experience even further, we have also enhanced the existing startup performance report. New insights on device restart frequency, also known as reboot frequency, will help you identify problematic devices because reboots break the user from their flow and should not be needed often.

 

To help you better understand the type of reboots that happens, we classify each them as either normal or abnormal. Normal restarts are those that go through the normal Windows shutdown process. These include: Windows update installations, which typically occur once a month; non-update shutdowns from users, typically to save battery power; and non-update restarts, which shouldn’t occur often beyond monthly patching.

 

In contrast, abnormal restarts are ones that haven’t gone through the normal Windows shutdown process and could suggest problems that need to be investigated further. There are also three categories for this type of restart.

 

  • Blue screens: This abnormal restart type is also called a stop error. Usually, less than two stop errors occur per device per year.
  • Long power button press: This restart happens when a user holds down the power button to force a restart. These shutdowns are typically even less frequent than blue screens.
  • Unknown: These are shutdowns that don’t fit either of the two other abnormal shutdown types. Microsoft will continue to research these to determine if additional categories should be added.
 

EA-RestartFrequency_v2.png

 

The restart frequency feature is now in preview and is rolling out to everyone over the next few days regardless of how you’ve configured the telemetry level or Windows Error Reporting in Windows Diagnostics.

 

Check out the rest of Endpoint analytics

There is so much more to Endpoint analytics than what we just covered. There are also reports on recommended software that help advise organizations on software that can help optimize OS and Microsoft versions for the best user experience. There is also the proactive remediations feature, giving you the power to automatically detect and remediate some of the top issues hampering users’ productivity — sometimes even before users realize something is wrong — while also helping reduce helpdesk call volume.

 

More information and feedback

For more information on getting started, visit the Endpoint analytics documentation, and check out the FAQ. Tweet your questions or feedback using the hashtag #MEMpowered and if you have an idea for a new feature, add it to UserVoice.

 

Please follow @MSIntune on Twitter

 

 

(This blog is co-authored with Zach Dvorak, Senior Program Manager, and Anthony Smith (A.J.) , Senior Product Manager)

 

1 Comment
%3CLINGO-SUB%20id%3D%22lingo-sub-2116083%22%20slang%3D%22en-US%22%3EGet%20insights%20on%20application%20reliability%20and%20device%20restart%20frequency%20with%20Endpoint%20analytics%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2116083%22%20slang%3D%22en-US%22%3E%3CP%3EWell-running%20apps%20are%20critical%20to%20a%20great%20endpoint%20experience.%20Users%20are%20never%20happy%20when%20an%20app%20crashes%20or%20a%20device%20restarts%20and%20their%20flow%20is%20broken.%20Worst%20case%20scenario%2C%20they%20may%20even%20lose%20the%20work%20that%20they%20just%20did.%20Service%20desks%20help%20solve%20these%20problems%2C%20but%20they%20only%20have%20visibility%20into%20the%20ones%20that%20people%20report%2C%20not%20the%20ones%20where%20someone%20just%20suffers%20in%20silence.%20What%20is%20needed%20is%20greater%20visibility%20into%20these%20issues%20across%20the%20entire%20organization.%20The%20two%20new%20Microsoft%20Endpoint%20Manager%20features%20in%20Endpoint%20analytics%20give%20IT%20admins%20the%20visibility%20and%20insights%20needed%20to%20help%20improve%20this%20experience.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBoth%20of%20these%20features%20--%20a%20new%20application%20reliability%20report%20and%20new%20data%20for%20reboot%20frequency%20in%20the%20existing%20startup%20performance%20report%20--%20reflect%20our%20commitment%20to%20the%20user%20experience%20because%20users%20are%20happier%20when%20work%20isn%E2%80%99t%20slowed%20down%20and%20IT%20can%20focus%20on%20helping%20drive%20the%20business%20when%20there%20are%20fewer%20support%20calls.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20application%20reliability%20report%2C%20available%20in%20preview%20and%20rolling%20out%20over%20the%20next%20few%20days%2C%20gives%20IT%20visibility%20into%20which%20desktop%20applications%20are%20hampering%20the%20user%20experience%2C%20due%20to%20frequent%20crashes%20and%20because%20they%20are%20broadly%20deployed%20to%20users.%20The%20report%20also%20offers%20suggestions%20for%20improving%20app%20performance%20and%20alerts%20IT%20to%20issues%20that%20users%20may%20not%20have%20created%20tickets%20for%20yet%20despite%20growing%20frustration%2C%20which%20can%20help%20decrease%20the%20number%20of%20support%20tickets%20in%20the%20long%20run.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EHow%20to%20use%20the%20application%20reliability%20report%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3EIf%20your%20devices%20are%20Intune%20managed%20or%20co-managed%2C%20you%20don't%20need%20to%20do%20anything%20to%20see%20the%20application%20reliability%20report.%20It%20sits%20alongside%20the%20rest%20of%20the%20Endpoint%20analytics%20reports%20in%20the%20Microsoft%20Endpoint%20Manager%20admin%20center%20console.%20If%20you%20have%20devices%20enrolled%20through%20tenant%20attach%2C%20upgrade%20to%20Configuration%20Manger%202006%20for%20this%20report%20to%20populate.%20On%20the%20%3CSTRONG%3EOverview%3C%2FSTRONG%3E%20page%20is%20your%20app%20reliability%20score%20as%20well%20as%20a%20baseline%20score%2C%20which%2C%20by%20default%2C%20represents%20the%20median%20across%20all%20commercial%20organizations.%20This%20can%20help%20you%20determine%20issues%20unique%20to%20your%20environment%E2%80%94and%20potentially%20caused%20by%20poor%20configurations%E2%80%94versus%20more%20widespread%20issues.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBelow%20that%20is%20a%20list%20of%20the%20apps%20most%20likely%20to%20have%20reduced%20user%20productivity%20during%20the%20previous%2014%20days.%20This%20considers%20not%20only%20crash%20frequency%20but%20also%20usage%20to%20help%20reduce%20noise%2C%20such%20as%20one-off%20applications%20crashing%20100%20times%20on%20a%20single%20device.%20On%20the%20right%20column%20are%20app%20reliability%20%3CSTRONG%3EInsights%20and%20Recommendations%3C%2FSTRONG%3E%20prioritized%20by%20which%20are%20most%20likely%20to%20boost%20your%20score.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22kuchinski_0-1614024603140.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F256786i48B7BC00268E9E8A%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22kuchinski_0-1614024603140.png%22%20alt%3D%22kuchinski_0-1614024603140.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20the%20%3CSTRONG%3EApp%20performance%20%3C%2FSTRONG%3Etab%20is%20a%20list%20of%20all%20your%20organization%E2%80%99s%20apps%2C%20which%20can%20be%20sorted%20by%20app%20name%2C%20publisher%2C%20active%20devices%2C%20app%20reliability%20score%2C%20and%20mean%20time%20to%20failure%2C%20which%20is%20the%20average%20number%20of%20times%20the%20app%20can%20be%20used%20across%20the%20organization%20between%20crashes.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EYou%20can%20also%20see%20your%20organization%E2%80%99s%20application%20reliability%20performance%20by%20other%20pivots%20like%20model%2C%20and%20OS%20version%20deployed%2C%20as%20well%20as%20troubleshoot%20application%20reliability%20issues%20with%20individual%20devices.%20In%20device%20performance%2C%20each%20device%20is%20given%20a%20device%20app%20health%20score%2C%20based%20on%20how%20often%20applications%20crashed%20on%20that%20device%20during%20the%20previous%2014%20days.%20Clicking%20into%20each%20device%20gives%20you%20a%20timeline%20of%20app%20crash%20and%20app%20hang%20events%20so%20you%20know%20exactly%20when%20crashes%20occurred%2C%20which%20can%20help%20speed%20troubleshooting.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3ENew%20insights%20into%20device%20restart%20frequency%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3ETo%20help%20improve%20the%20user%20experience%20even%20further%2C%20we%20have%20also%20enhanced%20the%20existing%20startup%20performance%20report.%20New%20insights%20on%20device%20restart%20frequency%2C%20also%20known%20as%20reboot%20frequency%2C%20will%20help%20you%20identify%20problematic%20devices%20because%20reboots%20break%20the%20user%20from%20their%20flow%20and%20should%20not%20be%20needed%20often.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ETo%20help%20you%20better%20understand%20the%20type%20of%20reboots%20that%20happens%2C%20we%20classify%20each%20them%20as%20either%20normal%20or%20abnormal.%20Normal%20restarts%20are%20those%20that%20go%20through%20the%20normal%20Windows%20shutdown%20process.%20These%20include%3A%20Windows%20update%20installations%2C%20which%20typically%20occur%20once%20a%20month%3B%20non-update%20shutdowns%20from%20users%2C%20typically%20to%20save%20battery%20power%3B%20and%20non-update%20restarts%2C%20which%20shouldn%E2%80%99t%20occur%20often%20beyond%20monthly%20patching.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20contrast%2C%20abnormal%20restarts%20are%20ones%20that%20haven%E2%80%99t%20gone%20through%20the%20normal%20Windows%20shutdown%20process%20and%20could%20suggest%20problems%20that%20need%20to%20be%20investigated%20further.%20There%20are%20also%20three%20categories%20for%20this%20type%20of%20restart.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EBlue%20screens%3A%20This%20abnormal%20restart%20type%20is%20also%20called%20a%20stop%20error.%20Usually%2C%20less%20than%20two%20stop%20errors%20occur%20per%20device%20per%20year.%3C%2FLI%3E%0A%3CLI%3ELong%20power%20button%20press%3A%20This%20restart%20happens%20when%20a%20user%20holds%20down%20the%20power%20button%20to%20force%20a%20restart.%20These%20shutdowns%20are%20typically%20even%20less%20frequent%20than%20blue%20screens.%3C%2FLI%3E%0A%3CLI%3EUnknown%3A%20These%20are%20shutdowns%20that%20don%E2%80%99t%20fit%20either%20of%20the%20two%20other%20abnormal%20shutdown%20types.%20Microsoft%20will%20continue%20to%20research%20these%20to%20determine%20if%20additional%20categories%20should%20be%20added.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CDIV%20id%3D%22tinyMceEditorkuchinski_2%22%20class%3D%22mceNonEditable%20lia-copypaste-placeholder%22%3E%26nbsp%3B%3C%2FDIV%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22EA-RestartFrequency_v2.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F256792i49754AE29222B30D%2Fimage-size%2Flarge%3Fv%3D1.0%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22EA-RestartFrequency_v2.png%22%20alt%3D%22EA-RestartFrequency_v2.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20restart%20frequency%20feature%20is%20now%20in%20preview%20and%20is%20rolling%20out%20to%20everyone%20over%20the%20next%20few%20days%20regardless%20of%20how%20you%E2%80%99ve%20configured%20the%20telemetry%20level%20or%20Windows%20Error%20Reporting%20in%20Windows%20Diagnostics.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3ECheck%20out%20the%20rest%20of%20Endpoint%20analytics%20%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3EThere%20is%20so%20much%20more%20to%20Endpoint%20analytics%20than%20what%20we%20just%20covered.%20There%20are%20also%20reports%20on%20recommended%20software%20that%20help%20advise%20organizations%20on%20software%20that%20can%20help%20optimize%20OS%20and%20Microsoft%20versions%20for%20the%20best%20user%20experience.%20There%20is%20also%20the%20proactive%20remediations%20feature%2C%20giving%20you%20the%20power%20to%20automatically%20detect%20and%20remediate%20some%20of%20the%20top%20issues%20hampering%20users%E2%80%99%20productivity%20%E2%80%94%20sometimes%20even%20before%20users%20realize%20something%20is%20wrong%20%E2%80%94%20while%20also%20helping%20reduce%20helpdesk%20call%20volume.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EMore%20information%20and%20feedback%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3EFor%20more%20information%20on%20getting%20started%2C%20visit%20the%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fmem%2Fanalytics%2Fapp-reliability%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3EEndpoint%20analytics%26nbsp%3Bdocumentation%3C%2FA%3E%2C%20and%20check%20out%20the%20%3CA%20href%3D%22https%3A%2F%2Faka.ms%2FEAFAQ%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EFAQ%3C%2FA%3E.%20Tweet%20your%20questions%20or%20feedback%20using%20the%20hashtag%20%23MEMpowered%20and%20if%20you%20have%20an%20idea%20for%20a%20new%20feature%2C%20add%20it%20to%20%3CA%20href%3D%22https%3A%2F%2Fmicrosoftintune.uservoice.com%2Fforums%2F291681-ideas%3Fcategory_id%3D395518%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EUserVoice.%3C%2FA%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EPlease%20follow%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fnam06.safelinks.protection.outlook.com%2F%3Furl%3Dhttps%253A%252F%252Fwww.twitter.com%252Fmsintune%26amp%3Bdata%3D04%257C01%257Cv-kualex%2540microsoft.com%257C13e8d6113d89445dfc7608d8d793b39f%257C72f988bf86f141af91ab2d7cd011db47%257C1%257C0%257C637496376657239795%257CUnknown%257CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%253D%257C1000%26amp%3Bsdata%3DJsaHt3Tfrq54ou3YQqybdE2LTFALxndf%252F%252FgqmocrdCE%253D%26amp%3Breserved%3D0%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3E%40MSIntune%3C%2FA%3E%20on%20Twitter%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3E%3CEM%3E(This%20blog%20is%20co-authored%20with%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Ftwitter.com%2FZachOnAnalytics%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EZach%20Dvorak%3C%2FA%3E%2C%20Senior%20Program%20Manager%2C%20and%20%3CA%20href%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fuser%2Fviewprofilepage%2Fuser-id%2F51275%22%20target%3D%22_self%22%3EAnthony%20Smith%20(A.J.)%3C%2FA%3E%26nbsp%3B%2C%20Senior%20Product%20Manager)%3C%2FEM%3E%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2116083%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%3EA%20newly%20available%20Endpoint%20analytics%20report%20and%20a%20new%20device%20restart%20frequency%20information%20can%20help%20IT%20determine%20if%20unreliable%20desktop%20applications%20or%20problematic%20devices%20are%20impacting%20user%20productivity.%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2116083%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EConfiguration%20Manager%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMicrosoft%20Endpoint%20Manager%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMicrosoft%20Intune%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-2185580%22%20slang%3D%22en-US%22%3ERe%3A%20Get%20insights%20on%20application%20reliability%20and%20device%20restart%20frequency%20with%20Endpoint%20analytics%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2185580%22%20slang%3D%22en-US%22%3E%3CP%3EThis%20is%20really%20great%2C%20useful%20information!%20Thank%20you!%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EOne%20way%20to%20increase%20the%20utility%20even%20much%20further%20would%20be%20to%20have%20comparison%20reliability%20metrics%20against%20the%20same%20applications%20and%20devices%20outside%20your%20org%2C%20especially%20if%20broken%20down%20by%20industry%20(since%20different%20industries%20often%20use%20the%20same%20applications%20very%20differently).%20Sometimes%20it's%20very%20hard%20to%20tell%20if%20an%20issue%20is%20specific%20to%20your%20environment%2C%20and%20comparison%20data%20can%20significantly%20reduce%20troubleshooting%20time.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Version history
Last update:
‎Mar 01 2021 10:13 AM
Updated by: