Aug 12 2021 08:31 AM
Hi All
Wondering if its possible to automatically create a sql table from an imported CSV in Data Factory? To make things a little more complicated not all csv's will have the same headings and differing number of headings.
If so, can anyone point me in the direction of a how to guide?
Case
I've been ingesting csv's using a HTTP connector in ADF then storing CSV data into a SQL table (manually created) and then transforming and cleaning said data into a Datastore SQL table that is also manually created.
I know I'm a little slow to the party but I've been looking at using parameters and was wondering if I pulled the csv's into blob storage and then transformed from there. Then I'd only need to create one SQL table and if I could automate the entire process in ADF that would save future me a lot of time.
I have another issue but I'll post that separate as its a slightly different topic.
Thanks for Reading
Hope someone can point me in the right direction.
John
Aug 16 2021 09:42 AM
Solution
Well that was easier than I thought, see link.
Aug 16 2021 09:42 AM
Solution
Well that was easier than I thought, see link.