Linda_Wang Thanks for the helpful blog.
For transformations in the middle of source and sink, you say this happens on the ADF managed Azure Integration Runtime. Is this using the ADF Snowflake connector documented https://docs.microsoft.com/en-us/azure/data-factory/connector-snowflake#mapping-data-flow-properties? Is this connector capable of pushing the transformation down so that it is executed on Snowflake, rather than pulling out the data and executing on a spark cluster?
Essentially, I would like to know: is it possible to perform transformations inside Snowflake using the Mapping Data Flow?
I would prefer not to have to create Azure functions to execute Snowflake stored procedures, but otherwise this seems like the best alternative.
Thank you