06-07-2017 09:54 AM - last edited on 06-07-2017 09:56 AM by Michael Holste
we'd love to learn about how you are using the content pack, especially if you're using the data to drive more targeted end user training and communication. Or do you use it for example to show Office 365 value to your leadership team or to identify power users?
Any insights around scenarios you use the data for would be great so that we can make sure we continue to evolve it in the right direction.
06-07-2017 10:01 AM
06-07-2017 10:02 AM - edited 06-07-2017 10:04 AM
Internally we'd like to make sure that we are using our subscriptions properly. And monitor which users are signed up. In the first week of viewing the reports, we have cancelled 6 users who have left the company, but still had active accounts. Then secondly as an MS partner, our plan is to drive the deployment of the content packs at as many of our clients as possible to track their adoption of O365.
06-07-2017 10:04 AM
06-07-2017 10:12 AM
06-07-2017 10:14 AM
We are using content pack and it helps to find the usage metrics on our environment like how many mails,read,send and how many users active like that. But we found that data is incosistent and liked to know how us age calculated..
1. In exchange usage it does not show the external mail counts sent and received and also the value of email sent and received shows different in each column.
2. In outlook , it does not show the product version and it just shows pro plus.
3. in skype and one drive it does show the active users and it is gettin changed even after the month completed. How we can depend on this data.
06-08-2017 12:50 PM
please take a look at the followin support documentation to udnrstand how data is being calculated and how we define an active user:
Definition of active user: https://support.office.com/en-us/article/Active-user-in-Office-365-usage-reports-093a6d0d-890b-489e-...
Please open a support ticket if you still see inconsistency in the data.
Is it possible that data still changes after the month has ended as the content pack will refresh weekly. Customers can choose to modify the refresh schedule if their use of this data demands a different update rhythm such as daily.
The back-end Office 365 service will refresh data on a daily basis and provides data that is between 36-72 hours latent from the current date.
The Content date column in each dataset represents the freshness date of the data in the content pack.
Hope this helps!
06-08-2017 03:05 PM
I am cautious about using too much of it because I don't always trust the data and the graphics are sometimes deceptive. It would be good to have a way to drill down to the detail for a chart to see if the data is in error or to find out what is really happening. For example, one chart shows "Skype for Business: Average (min) per activity". May shows 5 times higher than any previous month and yet the user count and amount of activity are not significantly different. I can't tell if the data is wrong or if something has changed in the way people are using SFB.
My pet peeve is that the SharePoint information is completely useless without including project sites.
Having said that, I used several of the charts in a management meeting today to point out some of the ways our people are using Office 365 and some of the ways that usage is changing over time. I think they helped make the point that we are getting real value from Office 365 and that it is becoming more accepted for day to day working.
The Content Pack is certainly a step in the right direction.
06-09-2017 09:56 AM
From general perspective, this is very good
For large international company 10k, 20k, ... 40k users, there is some intermediate level missing (drill down on usage & adoption per Country, City, Department/BU, on some table with have user identity, so we can cross the information with AAD profile to build these indicators.
But some other table are already agregated and user (upn) information is already remove that making some global stat "unbreakable" into a lower level of vision.
It is require for large company to
* be able to make change & adoption comparision from 1 geography to another geography
* and/or when you have a merger project get visibility between legacy employees you have and employee who are merging and the adoption gap
At this stage, we are exploring what we could do by using .PBIT file and/or by using O365 reporting api in beta to get a maximum of raw data to rebluid this (because it missing)
06-09-2017 10:09 AM
Thanks for your feedback. Great to hear that you're already getting value out of the content pack.
The majority of the reports display data for the previous 12 months. These reports show data that is aggregated at the tenant level.
Reports that show user level details - and thus also the reports where we can combine the data with AD attributes - show data for the previous complete month. The reason why we're bringing user level information in only for the last month are scale limitations in Power BI as our goal with this content pack was to make sure that it works with the free Power BI service. We're currently exploring how to make more granular information available to customers.
Please take a look at the data model support documenation for more information: https://support.office.com/en-us/article/Office-365-adoption-content-pack-data-model-08c5307c-4a6b-4...
To access user level details for a longer timeframe, please use the usage reports in the admin center at this point.
06-09-2017 10:14 AM
Thanks for feedback and this is exactly what we are doing to cover the gap and/or build (not all) but important intermediate kpi that are missing from our perspective.
We understand it is complicated to make 1 T-Shirt that fit any size from XXXS to XXXXXL, we just wanted to share this feedback to let you know
06-09-2017 10:24 AM
Thanks! We really appreciate your feedback. We're working on options that might fit your need better and will share more information in the coming months. Your feedback is helping us already to shape this.
06-09-2017 10:44 AM
thank you very much for your feedback. It's great to hear that the day helps you to show the value that you're getting out of Office 365.
Regarding to your feedback on the data, it is of course always be good to be cautious about data in general BUT we put a lot of work and effort into making sure that the data in the usage reports and the content pack is accurate. So, if you are seeing anomalies that can definitely not be explained by user behavior, we'd definitely love to learn more.
For SharePoint, please use the data as a starting point to understand how your users use SharePoint. We're working on improving the data in the future to include all site types.
06-12-2017 12:55 AM
This adoption pack is great - a big step forward on the usage data that used to be presented in the admin center.
I used it last week to present to our leadership team how the take up of different products was going, and to demonstrate growth in adoption of ODB for example.
06-12-2017 05:13 AM
06-19-2017 07:27 AM
1.Do you have any option to sepearate the traffic between incoming and outgoing mails in the content back.
2. Please let us know if there is any option to capture the security related traffic in the content pack like DLP.
3. In outlook it shows office pro plus and we know our environment configured with mixed versions and liked to know how we can capture this data in the content pack
06-19-2017 08:40 AM
happy to help with your questions:
1. you can see email activity broken down to emails sent and emails received.
2. The content pack focuses on helping customers understand how their users are using and adoption Office 365 so that they can drive better targeted training and communication to increase usage. Security related insights do not fall into this scope.
3. Can you please clarify what versions you are referring to?
06-21-2017 04:33 PM
I am trying to use the content pack however at Regional level to measure regional success rather than Tenancy level however the tables for the data are not linked to each other for me to narrow down by userstate making the reports not that useful . Is it possible to link the data or atleast able to export the data set for our teams to be able to link that ?
06-21-2017 06:09 PM
@Anne Michels- We especially use the content pack with our ePMO and IT Service Desk. We find it very useful
06-21-2017 06:52 PM
Hi Joseph, would love to learn more. Can you share a little bit more details about how you're using it?
06-21-2017 07:00 PM
the content pack allows you to analyze usage by location. It combines the usage data of users with their information in Azure Active Directory (AAD), so you can pivot the reports by AAD attributes like location, department or organization information. Please note that this is only possible for the reports that include user level information and report on the last month only. The tenant datasets are precomputed monthly aggregate data sets that do not offer the ability to drill in by user metadata.
06-28-2017 05:02 PM
Thanks for your reply , is there a way to filter the user date by location if the report page doesnt have the data since at the back end the location data would already be pooulated ?
Sorry but it would be really helpful to narrow it down since we only care at regional level what the changes are and the whole report wouldnt really help use determine that .
06-29-2017 02:48 AM - edited 06-29-2017 02:53 AM
I'm still unable to use the Apotion pack since Power BI does not find it when I open it as my Global Admin from the O365 portal. I get 404 error and is offered to open the AppSource where I can't find it. Can't find a way to get my tenant fixed so that I can access the data.
06-29-2017 10:32 AM
have you followed the steps described here: https://support.office.com/en-us/article/Enable-the-Power-BI-adoption-content-pack-for-Office-365-9d...
If you're still running into problems, please open a Support ticket with Power BI.
06-30-2017 12:14 PM
please take a look at the support documenation about customization of the reports: https://support.office.com/en-us/article/Customize-the-Office-365-Adoption-Content-Pack-9b76065f-29b...
In general, you can only filter by location in the activity reports that contain user level data. These reports contain information for the last month only.
The tenant datasets are precomputed monthly aggregate data sets that do not offer the ability to drill in by user metadata. In order to filter by user metadata you can go against the user activity dataset which has data for the last complete month and allows you to see what departments/companies regions use various O365 services.
Please also take a look at the documentation about the data model: https://support.office.com/en-us/article/Office-365-adoption-content-pack-data-model-08c5307c-4a6b-4...
06-30-2017 12:43 PM
We have scheduled content pack to schedule everyday and it was failing everyday. If there is any issue we need to be aware
06-30-2017 12:45 PM
Can you please clarify what versions you are referring to?
In the outlook it shows office pro plus and in our environment many users configured with outlook different versions like 2007,2010 and 2013,2016. How we can identify the difference in the content pack
06-30-2017 12:53 PM
There is no curent issue that should be affecting this functionality. Please open a support ticket with Power BI.
06-30-2017 12:59 PM
the information about which version of Office your end users are on is not available in the usage repots or in the content pack. We don't have access to this information. We can only report on Office 365 Pro Plus activation with Pro Plus usage coming soon.
07-12-2017 04:23 AM
From our side, The Office 365 adoption CP was implemented by one of the Tenant admins and shared with Internal Stream leaders (quite One per big products).
But the vision of that CP is really high level which is not enough for those users and they complained about the details they can look.
The best case is for Yammer, the details is only from a technical level (number of hits/messages/views/..), but the Yammer Owner need to know the details around the Yamgroups, the best shared, liked messages, ...
So, i like this CP, but it seems to be interesting only from an helicopter view for O365 technical manager, not for Top manager (or only if we rework on the informations) and not for the O365 product leader (who needs more business details).
I hope it will help you.
07-12-2017 04:31 AM
thanks for your feedback. We continue to update the usage reports to provide you with a complete picture of how your organization is using Office 365. We're currently working on a new Yammer Groups activity report that will help you understand how your users leverage Yammer groups to communicate and collaborate in your organization. We're exploring the possibility to bring this informaiton to the content pack in the future.
07-12-2017 04:40 AM
Is there any reason why you prefer to integrate all the details into this global adoption CP or create a dedicated content pack for Yammer ?
I think the adoption could be interesting with the current level of information from a technical adoption point of view. But it would be really great to have dedicated details for Yammer only we can delegate to the Yamanager, this manager does not care about nothing related to Skype/Office Proplus/messaging/...
07-12-2017 04:43 AM
Thanks, Fab. The goal of the current adoption content pack is to help organizations understand how their end users are using Office 365 across all services. We're exploring the option of having product or scenario specific content packs in the future.
07-17-2017 11:49 AM
I have opened support ticket for the data not refreshed more than 10 days. After multiple followup they have just grapped the log. I think support is not enough to support this product. Please let us know whether support can be improved for this product. Still data not refreshed
07-18-2017 02:22 AM
Hi, I just sent you a private message so that we can look into your experience.
07-19-2017 08:39 AM
Hi, let's do the following then. Can you please send me the support ticket number via email to anne.michels(@)microsoft.com? We can then look into your experience to see what happened.
07-20-2017 12:32 PM
Yes . We have send the information. we also want to know if there is anyway intergerate the other applications like Team,Planner,Flow usage and statistics in power bi content pack
07-24-2017 02:20 AM
Hi, we're currently looking into the possibility to bring additional services into the cotent pack. Please follow roadmap.office and the Office 365 blog here in the TechCommunity for updates.
07-29-2017 02:34 AM
Dear @Anne Michels I would like to report you an improvment idea in the content pack.
Current situation : We have KPI on Skype Usage, these KPI have measure/metrics related to Skype PSTN Conferencing and PSTN Calling, but the breakdown analysis take into accoutn end user have SKype (Skype Online Plan 1 or Plan 2) but we can't sort out the end user have PSTN Conferencing Service Plan or PSTN Calling Service Plan.
Improvement Proposal :
Get Service Plan Data on User information to known if the end user have PSTN Calling or PSTN COnferencing : these services plan are included in some bundle, but could be also purchase separatly (ie. O365 E1 + PSTN Conferencing).
Within Skype Reporting, make specific stat related to PSTN COnferencing and PSTN Calling Service Plan
Typical usage at company level are the following : get metrics on Skype Conferencing and User having PSTN Conferencing option (do we assigned option to people who need it ? does people using it ?
Same story on PSTN Calling that could be purchase to replace standard IPT, in general company making a double run at the beginning keep legacy IPT and provide PSTN Calling to end user to allow them to take new habit, having more detail metrics on PSTN Calling usage help to check how end user are transitionning/habit to PSTN Calling, based on these metrics we could adjust change and adoption plan.
07-30-2017 02:06 PM
thanks for your feedback. I've shared it with our engineering team and they are considering it for future enhancemetns.
08-01-2017 01:01 PM
We've built a new Office 365 add-in (Inky Phish Fence, runs in Outlook). We have a dashboard for the IT admins. because we do collect data on email safety analysis. Would integrating our data into Power BI help us with sales?
11-03-2017 02:37 AM
11-03-2017 02:37 AM
While trying to figure out how to view the trend graphs of the Content Pack in more detail level, such as country, company, etc.., I come across this post. I would like to know if there is any new progress regarding this requirement since June? Base on your suggestion I also tried to look at the usage reports in the Admin Center, again, it seems the trend report is on aggregated level, while the "per user lists" are only aggregated at a predefined time frame "7 Days", "30 Days", "180 Days". So we still can not get detailed trend info base on the csv output of the detail report. Is that right? Is there any other work around at this moment? Thank you!
11-03-2017 03:21 PM
11-03-2017 03:21 PM
the longest timeframe for which we provide data is currently 180 days. A workaround would be to pull the data through the APIs and store it locally, thus, you could build up a longer timeframe.
12-13-2017 11:28 PM
Dear @Anne Michels, please relay our thanks to the team and shilpi regarding
* the release of 1st beta Microsoft Graph Reporting api on #Microsoft Teams earlier this week, even the detail is limited at this stage (no data on team conversation per team space, the fact we have some 1st api on Microsoft Teams usage per User is a 1st good steps to understand usage of service).
* the release of other Microsoft Graph Reporting api into GA / v1.0 :) it will help us to "stabilize" the code vs API on which we got some signature and interface contract change on last month
All of this will help us on custom BI report we did and based on detailled data we harvesting and storing into a SQL Azure database to "keep" some detailled history.
12-13-2017 11:49 PM
I use it to drive discussions with management: to demonstrate how usage is growing, how usage is growing unevenly among the workloads (subsequently how we must target usage areas where we want change / want to derive more value and how we can never stop with adoption efforts)
WISH / REQUEST / SUGGESTION: those reports that show the year of history are not quite as useful as they could be becuase they show current month and 11 months backwards. For example, now we see usage so far in December 2017 and as far back as Jan 2017. People always want to see year over year change so it would be awesome if you would PULL ONE MORE MONTH so we can compare full month results vs last year's values.
01-29-2018 08:10 PM - edited 01-29-2018 08:11 PM
We have multiple verified domains (by specific industries), how possible to filter / drill down by verified domains in this content pack to have more targeted insights?
02-16-2018 06:27 AM - edited 02-16-2018 06:29 AM
I am loving the data presented in the Content Pack! I am preparing to use it to demonstrate adoption across our divisions for each product. This will also help to gauge our maturity. I would like to also show data across geographical regions but, although I can see our "location countries" as:
CN, DK, IS, NO, PH, PL, SE
when I look at the "Adoption by region" map I *only* see Poland for some strange reason - and only 1 user. How can I correct this?
otherwise it all looks great!
07-08-2018 11:12 PM
@Stephen Velasco You may want to check your filters on the report and see if they have limited the results to "DK"