Forum Discussion

MK2022's avatar
MK2022
Copper Contributor
Nov 03, 2022

Can we register only selected tables from a registered source for a subcollection ?

Hello All,

 

what I want to achieve is as below. Lets say I have ADLS Gen 2 as main source of data for Purview. 

ADLS Gen 2 contains data of three subject areas Sales, Marketing, Finance. 

I want to create three sub collections Sales, Marketing and Finance in Purview and register only Sales related tables from ADLS Gen 2 under 'Sales'. Similarly I want to register only Marketing  tables from same ADLS Gen 2 under 'Marketing'. 

 

Currently Purview allows to register a source only once. So same ADLS Gen 2 source would not be allowed to register with more than one source. 

 

Also second question : Currently Purview only registers data at the source level and does not give options to choose tables (or a subset of data) to be registered with a collection or sub collection.

 

How do we achieve this ?

1 Reply

  • ZGabTanase's avatar
    ZGabTanase
    Copper Contributor
    Nov 18, 2022
    Scans reside at collection level. Scans utilize existing sources, however there is no limitation as to how many scans can be created based on one and the same source.
    Hence one source can be used by 3 scans, each scan living in one separate sub-collection,
    A scan can be selective as to which tables are included in it.

    See section "Design Recommendations" in Scanning Best Practices (https://learn.microsoft.com/en-us/azure/purview/concept-best-practices-scanning😞
    "If the metadata of the same data source is consumed by multiple teams, you can register and manage the data source at a parent collection. Then you can create corresponding scans under each subcollection. In this way, relevant assets appear under each child collection."