Blog Post

Security, Compliance, and Identity Blog
2 MIN READ

Time-based scheduler for Microsoft Purview Data Estate Insights App is now generally available

Sunetra's avatar
Sunetra
Icon for Microsoft rankMicrosoft
Feb 01, 2023

Data Estate Insights is an app built on Microsoft Purview’s platform that serves the office of the Chief Data Officer (CDO), catering to their needs for governance and curation analytics and insights. The app offers a range of out-of-the-box dashboards, that use the rich knowledge of the DataMap to create meaningful aggregates for high-level business understanding, and detailed views into the metadata, for deeper dives by Data Stewards and Data Custodians.

 

So far Data Estate Insights dashboards were refreshed based on events in the DataMap that would check for any updates, no more than once a week.

 

The pain of this approach is felt by the Data Stewards and Data Officers, as they were looking at stale data, and many of them wanted to control their analytics refreshes.

 

With the introduction of the Time-Based Scheduler, the Stewards can set up a schedule based on their organization’s business needs and options-  Daily, Weekly, and Monthly schedules are available.

 

 

 

How the new “Time-Based Scheduler” is different from the past “Event-Based Scheduler”?

“Event-Based Scheduler” was system controlled and was scheduled to looks for any DataMap changes only once a week. This resulted in Data Stewards looking at a week older reports while the DataMap was updated more frequently.

Today, the “Time-Based Scheduler” is customer-controlled that takes away the concern of looking at old and stale reports, making it a better analytics experience overall.

 

What is the default setting of Data Estate Insights Refreshes?

We have set it up to refresh weekly.

 

Does the “Time-Based Scheduler” allow admins to control reports that need to be refreshed at a different cadence?

No, the scheduler refreshes the entire dataset that feeds all the reports. Control of refresh at the report level is not available today.

 

Where can I see when the Insights reports were last refreshed?

As an Insights Reader, you can view the last refresh date and time on the top right corner of the dashboards and reports.

 

 

Learn more about the Data estate insights app here.

Learn more about the Time-Based Scheduler here.

Updated Feb 01, 2023
Version 2.0
  • rglezmatl_cr's avatar
    rglezmatl_cr
    Copper Contributor

    This is great news Sunetra. Thanks for sharing a good update on the plan to build a more robust data estate insights module. I have, however a couple of questions:

     

    1) Does the change in the frequency changes the cost of using MS Purview (i.e., the more frequent refresh, the higher will be the cost)?

    2) What does the report (during the scheduling) considers during the update of the metrics? Are the asset changes or ingestions the reason to add/remove assets in the report or does the scan considers 100% of the assets?

     

    Thanks 

  • Hi rglezmatl_cr thanks for your questions:

    1. Insights refresh is charged on a per refresh basis. We default the refresh to "weekly", which means customers should be charged for about 4 refreshes in a month. If customers pick "Monthly" refresh cycle, then they would be charged for 1 refresh in a month.

    2. Data Estate Insights looks for any changes in the Datamap since the last refresh. This could be the addition of more assets and sources or annotations on your assets. All insights refreshes are on incremental changes only.

    In the last few months we have been diligently working to reduce customer's spend on deriving insights out of their DataMap. Please read the following blog to learn how we have passed performance and cost benefits to customers!

    Do more with less using Microsoft Purview Data Estate Insights - Microsoft Community Hub