Forum Discussion
Need help with ADF pipeline
I am new to Azure Data Factory (ADF) and have an urgent client requirement to create a pipeline. The data source is SharePoint, which contains multiple folders and subfolders. Since there is no direct SharePoint connector in ADF, what would be the best approach to read these files
1 Reply
- petevernBrass Contributor
Here you can find some documentation related to this. You need to use Web Activity in combination with an access token. Second part of this doc explains a file copy where you can copy these files to blob storage and the read the content from there.
Copy data from SharePoint Online List - Azure Data Factory & Azure Synapse | Microsoft LearnAnother option is to use an Azure Logic App to copy the data to blob using a trigger each time new file is added or changed on SharePoint and then read them using an ADF pipeline.