Forum Discussion
Unified Catalog and connection to AWS and GCP
Hi,
I recently came across an article by Keshav Singh (on Medium), which discusses the use of Microsoft Fabric to unlock the Unified Catalog Governance and Data Management features when connecting to Amazon S3.
Is this additional layer of Fabric necessary, or can the same features be accessed directly through Purview’s connection to S3?
TIA
Paul
Hello PaulCurrivan,
It depends, Google BigQuery and Snowflake doesn't have Fabric dependency for DQ in Unified Catalog.
But Amazon S3, Dataverse and Google Cloud Storage are supported via Fabric shortcut.
With respect to roadmap, some improvements are expected in Q2 CY25.Keep an eye on the below for more details,
What's new in Microsoft Purview | Microsoft Learn
MS-Purview-Data-Governance-Roadmap-detailed.pdf
Hope that helps!
Prathista
Please mark as solution, if you find the answer helpful. This will assist others in the community who encounter a similar issue, enabling them to quickly find the solution and benefit from the guidance provided.
5 Replies
Thank you!
Prathista IlangoMicrosoft
Hello PaulCurrivan,
It depends, Google BigQuery and Snowflake doesn't have Fabric dependency for DQ in Unified Catalog.
But Amazon S3, Dataverse and Google Cloud Storage are supported via Fabric shortcut.
With respect to roadmap, some improvements are expected in Q2 CY25.Keep an eye on the below for more details,
What's new in Microsoft Purview | Microsoft Learn
MS-Purview-Data-Governance-Roadmap-detailed.pdf
Hope that helps!
Prathista
Please mark as solution, if you find the answer helpful. This will assist others in the community who encounter a similar issue, enabling them to quickly find the solution and benefit from the guidance provided.
- Prathista Ilango
Hello PaulCurrivan ,
It depends on what features you would like to make use of. If you want to scan your unstructured data currently stored in Amazon S3 standard buckets, and discover what types of sensitive information exist in your data, then configuring Multicloud Scanning Connector for Microsoft Purview in DataMap would do. Refer to the below articles,
Amazon S3 multicloud scanning connector for Microsoft Purview | Microsoft Learn
Discover and govern your data in AWS Simple Storage Service (S3) with Azure Purview | Microsoft Community HubBut if you are looking for Data Quality Assessments, then Fabric is required as it is achieved through Fabric shortcut as data source. Refer to:
Data Quality for Fabric Shortcut Databases in Unified Catalog | Microsoft Learn
Hope that helps!
Regards,
Prathista
Please mark as solution, if you find the answer helpful. This will assist others in the community who encounter a similar issue, enabling them to quickly find the solution and benefit from the guidance provided.
Thank you for the reply and links to deep dives.
Im happy to open another thread for a follow on question, i will post it here and you can advise.
Is the dependency on Fabric to unlock the health and DQ features likely to expand to all data sources external to Azure?
PaulHi Prathista,
Thank you for the clarification and the links for further information.
I can open another thread if its more inline with the forum, but my next question is..
Is the "Supported via Fabric shortcut" likely to be more common for non Azure Data sources?
Paul
