Hi Shankar,
I have been doing some POC for the copy activities. The following is what I have done
- I have successfully create ADF managed private endpoint to snowflake
- I have successfully create ADF managed private endpoint to my blob ( my blob is not accesible from public but able to run copy activities from ADF )
- I have Copy Activities that
- source is linked to Snowflake and I am able to preview data
- sink is linked to my blob storage
Once this is all set and done, I run the copy activities the error I am getting is as follow :
ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [42501] Failed to access remote file: access denied. Please check your credentials,Source=Microsoft.DataTransfer.Runtime.GenericOdbcConnectors,''Type=System.Data.Odbc.OdbcException,Message=ERROR [42501] Failed to access remote file: access denied. Please check your credentials,Source=SnowflakeODBC_sb64.dll,
So I went and check in snowflake's activities/query history to find that it's failing to write to my blob and I wondering if snowflake is writing to my blob via public URL.
COPY INTO 'azure://<my-blob-name-xxxx>.blob.core.windows.net/<container-xxxx>/<id-xxxx>/SnowflakeExportCopyCommand/' FROM (<select-statement-xxxx>) CREDENTIALS = (AZURE_SAS_TOKEN = '☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺☺') FILE_FORMAT = (type = CSV COMPRESSION = NONE RECORD_DELIMITER = '
' FIELD_OPTIONALLY_ENCLOSED_BY = '"' ESCAPE = '\\' NULL_IF = '') HEADER = TRUE SINGLE = FALSE OVERWRITE = TRUE
Am I missing anything here? Appreciate if you can share any step I might have missed.