Forum Discussion

dim94's avatar
dim94
Copper Contributor
Feb 18, 2025

Need help with ADF pipeline

I am new to Azure Data Factory (ADF) and have an urgent client requirement to create a pipeline. The data source is SharePoint, which contains multiple folders and subfolders. Since there is no direct SharePoint connector in ADF, what would be the best approach to read these files

azure data factory

1 Reply

  • petevern's avatar
    petevern
    Brass Contributor
    Feb 19, 2025

    Here you can find some documentation related to this.  You need to use Web Activity in combination with an access token. Second part of this doc explains a file copy where you can copy these files to blob storage and the read the content from there.
    https://learn.microsoft.com/en-us/azure/data-factory/connector-sharepoint-online-list?tabs=data-factory

    Another option is to use an Azure Logic App to copy the data to blob using a trigger each time new file is added or changed on SharePoint and then read them using an ADF pipeline.

Resources