Forum Discussion

helspaul's avatar
helspaul
Copper Contributor
Sep 20, 2023

xml on ftp to SQL Server

Hi,

 

I need to extract weather data from a public, anonymous ftp server and load it into Azure SQL Server. This is one of the files. I'm looking to get the lowest level, the forecast-period and elements into columns

 

ftp://ftp.bom.gov.au/anon/gen/fwo/IDN11060.xml

 

I'm still quite new to ADF.

  • I tried creating a Data Flow and flattening the XML but Data Flow won't source from ftp. This XML file also seems more complex than any example i've followed
  • Then I tried setting up a pipeline that copies the data to a blob container so Data Flow can use it. A pipeline will source the ftp data but won't write XML to blob
  • I tried Power Automate to do the copy. It will copy the files as files but I don't have premium to write them to blob. Besides, it feels like ADF should be able to do this

Any ideas whether ADF can do this and how I go about it?

 

Thanks

No RepliesBe the first to reply

Resources