Updates to Office 365 Secure Score

We have received a lot of feedback from the Tech Community on how to make Secure Score better and it is greatly appreciated by the team.  When reviewing your feedback and feedback from other organizations, a few requests were coming up regularly.  Some of what we have heard is around the average score that you can compare yours against. In addition, we heard that determining what security controls had changed and influenced the score where hard to track down. Today we are happy to share that we are adding a couple of enhancements to Secure Score to help with this.

 

Many of you like the idea that you can compare your score to the average score of all Office 365 tenants. However, some have concerns about the relevance of this to your organization. Based on this feedback we have a new average for you to compare against. The average seat size score shows you a score based on organizations that have a similar number of Office 365 active seats. There are seven seat size groups that we put everyone in, 0-5, 6-99, 100-249, 250-999, 1,000-4,999, 5,000-19,999, and 20,000+. For example, if you have 1200 active seats of Office 365 we will show the average score of other tenants that have active seats between 1,000 and 4,999.

 

compare.png

 

Coming soon we will be introducing an industry average score, this will show you how your score compares to other organizations that have designated the same industry in Secure Score or the Service Assurance page of the Security and Compliance Center.

 

Another enhancement we are adding is around making it easier to find how your score changed between two dates and what the impact was. Previously you had to click on the line graph in the Score Analyzer tab to choose your date and then take a screenshot or try to remember what actions were completed as you clicked on another date in the line graph.  To make this comparison easier, we have added a “Compare scores” option to the Score Analyzer tab.

  

comparedates1.png 

Clicking this will allow you to select two dates that you would like to compare the scores on. Upon choosing the dates you will get a list of what controls changed between those dates, and whether the result caused an increase or decrease in the score.

 

comparedates2.png 

Along the lines of making things easier, we know that finding controls in the action list can be a challenge when the list is long. To help find controls faster we are introducing a search field for the action queue. By typing characters in this field, we will filter down the view list to help you navigate to the actions faster.

 

search.png

 

And finally the reporting actions have had an overhaul. The reports in Azure have under gone a significant optimization in terms of making them easier to consume and more relevant. Previously when using the Azure classic portal there was a direct report and corresponding Secure Score control for that report. Under the new Azure Portal these reports have been consolidated. This blog post explains how the new mapping works and what the previous reports now map to.

 

Secure Score has been updated accordingly allowing us to reduce the number of Azure report controls to two (whilst still allowing the same points total). These updated controls now take you to the updated Azure Portal.

 

If you want to check out all these new features, head over to https://securescore.office.com now. As always thanks for all the feedback and keep it coming!

 

12 Comments
Trusted Contributor

Thanks for sharing, this is a great set of updates.  I like the Compare Scores option, in particular, this makes it a lot easier to track changes,

 

I did notice though in my dev tenant it seems to indicate I have enabled controls, which I haven't (MFA) if that's what it's saying.

 

Office 365 Secure Score - Comapre Scores.png

Hi Cian,

 

Did someone happen to hit the 3rd party button for the MFA controls?  If not, can you PM me your dev tenant info and I will have the team take a look.

Hi @Anthony Smith (A.J.), great updates regarding the size group and industry ! Congrats !

Anonymous
Not applicable

Same here... the MFA scores for our users are saying they are turned on but aren't really turned on at all.  Overall I have found that the Secure Score gives us points for a number of things that it shouldn't.  Unfortunately I've resorted to having to track my score in a spreadsheet as we are being given 100 points that we shouldn't have.

Trusted Contributor

I just noticed that there is a category for Enable Advanced Security Management Console. That product was renamed to Office 365 Cloud App Security several months ago, Secure Score should be updated to reflect that name change and to avoid confusion (which is a never ending challenge :))

Hi Chris,

 

Please PM me you tenant name so I can have the team take a look.


 

 

 


Hi Dean,

 

Good catch.  I will let the team know so they can update the text.

Senior Member
Hi, I cannot see anywhere to change the seat size for the tenancy. If this done automatically based on the number of active users in Azure AD? If so, this doesn't work for my client. Regards, Lee

Hi Lee,

If you are talking about the seat size average, this is calculated automatically based on the number of active seats the tenant has in Office 365.  Unlike the industry average you can't make changes to this.  

Senior Member
Hi Anthony, Yes, that's exactly what I mean. However, this doesn't appear to be the case for our client. They're currently classed in the 250-999 seat category, but they only have 70 licenses in their portal?! Also, something is definitely wrong in this client's tenancy, as things are now worse than before. I cannot see any bars in the bar chart for "Compare your score" and that's across all browsers and on two separate machines (one of which has only been imaged this morning). I have submitted multiple tickets which then get pushed to this community. I love the idea of Secure Score, but it's not the value add we wished we could sell to our clients (as a feature/benefit of going to Office 365), which is frustrating and disappointing to be frank. Regards, Lee

Hi Lee,

 

The bar chart issue along with other graphics issues you might be seeing is a bug we discovered in some tenants and should have that fixed today.  For the seat category issue, please send me the ticket info and any the name of the support people you have talked to.  They should be providing you support.  Please also share the tenant name for your customer and we will investigate.

 

Sorry for all the issues.

Senior Member
Hi Anthony, The bug does seem to have been rolled out, so thanks for getting that resolved. Here's a list of the Secure Score tickets that I have opened for this client: Ticket #10702271 Secure Score: "Compare you score" doesn't seem to work for the section "Please Select Industry Type" Ticket #10798321 Cannot adjust seat size for secure score Ticket #10640111 My secure score seems to be wrong Ticket #10575989 Update PowerShell scripts that Secure Score quotes for mailbox auditing in GitHub repository.