Forum Discussion

jamesgiop's avatar
jamesgiop
Brass Contributor
Jan 19, 2025

Failed to ingest relationship with type dataset_process_inputs (Snowflake)

Hi All,


Having the above issue when scanning snowflake but

A - Only recently (perhaps since the start of the year)

B - Only for around 5/2000 objects within snowflake.


From the database side, it appears as if Purview is not using the database name within the query for a small subset of relationships between objects (a mix of tables, views and SP's) in two different databases.

 

Any ideas why this could be happening? I've removed some detail from the query below such as our snowflake instance but this is the output in Purview's error logs: 

 

Failed to ingest relationship with type dataset_process_inputs between the following two assets due to invalid data payload to data map: 
asset with type snowflake_table and qualified name 'snowflake://******eu-west-1.snowflakecomputing.com/databases/STAGE/schemas/FULFIL/tables/SUBSCRIPTION', 
and asset with type snowflake_view_query and qualified name 'snowflake://******.eu-west-1.snowflakecomputing.com/databases/STAGE/schemas/FULFIL/views/ACTIVE_SUBSCRIPTION_PRODUCT_VW/query'. 
Please contact support for help.

1 Reply

  • AS1522's avatar
    AS1522
    Icon for Microsoft rankMicrosoft
    Apr 23, 2025

    Hey,

     

    Are you still facing similar issue: 

     

    • Check that the scanning configuration is set up to dynamically insert table names.
    • Verify that the account used for scanning has the required permissions.
    • Review the logs for additional error messages and manually adjust the query if needed as many as times required

    To fix this problem, manually adjust the query to include the correct table name. For example, if your table name is TEST_TABLE, the query should look like this:SELECT T.TABLE_CATALOG, T.TABLE_SCHEMA, T.TABLE_NAME, T.TABLE_TYPE, T.COMMENT, V.IS_SECURE, T.LAST_ALTERED

    FROM INFORMATION_SCHEMA.TABLES T

    LEFT OUTER JOIN INFORMATION_SCHEMA.VIEWS V

    ON (T.TABLE_CATALOG=V.TABLE_CATALOG AND T.TABLE_SCHEMA=V.TABLE_SCHEMA AND T.TABLE_NAME=V.TABLE_NAME)

    WHERE T.TABLE_TYPE IN ('BASE TABLE') AND T.TABLE_NAME = 'TEST_TABLE' AND T.TABLE_SCHEMA = 'TEST';

    ``` [2](https://learn.microsoft.com/en-us/answers/questions/2125438/invalidoperation-getmetadata-error-while-scanning)