Dec 14 2022 01:03 AM
To better understand costum lineage, I made following very simple model:
#create a simple custom table, which only inherits from DataSet
custom_type_table = EntityTypeDef(
name="costum_table",
superTypes=["DataSet"], #inherit from DataSet
serviceType="Test Model", #the bigger group
)
#create a simple custom process, which only inherits from process
custom_type_process = EntityTypeDef(
name="costum_process",
superTypes=["Process"], #nherit from Process
serviceType="Test Model", #the bigger group
)
#upload the entity defenitions
client.upload_typedefs(
entityDefs=[custom_type_table, custom_type_process],
force_update=True
)
ae = AtlasEntity("Table", "DataSet","companyname://server/Table", guid=-1)
ae_costum = AtlasEntity("CostumTable", "costum_table","companyname://server/CostumTable", guid=-2)
aptf = AtlasProcess("Table_Measures",
"Process",
"companyname://server/Table_Measures",
[ae],
[ae],
guid = -3
)
aptf_costum = AtlasProcess("CostumTable_Measures",
"costum_process",
"companyname://server/CostumTable_Measures",
[ae_costum],
[ae_costum],
guid = -4
)
res = client.collections.upload_entities( [ae, ae_costum, aptf, aptf_costum], "tttttt")
Lineage for the costum case doesn’t show up, for the normal case it does.
Even without the processes, if we just look at the table, the DataSet one has a lineage tab, whereas the inherited DataSet entytype has none.
Something I find very strange. Do you have an explanation for this? How can lineage with costum types be acchieved?
Thanks in advance