Forum Discussion
John Dorrian
Jan 28, 2021Brass Contributor
Select text from split function
Hi hope someone can help, (I also hope I can explain this issue) I created a pipeline to bring in a CSV, stick it in blob storage and then modify it and stick it in a sql database. But while ...
- Feb 02, 2021
Hey John Dorrian , tried the expression builder and here you go.
Hope this is what you were looking for and I might have resolved your issue.
If so, kindly mark this reply as an answer or upvote here!
Thanks and regards,
Sunaina Lalwani
SLalwani
Feb 01, 2021Copper Contributor
John Dorrian, Can you share some sample records for this field from the source and the final targeted fields that define how do you want the data to be inserted in destination fields?
- John DorrianFeb 01, 2021Brass Contributor
Its an open data set and the link I'm using is https://data.food.gov.uk/codes/reference-number/authority?_format=csv&_view=with_metadata
To note datafactory doesn't like the "@id" title so to get round this I created sql table and then deleted first row.
I was going to create another field called Name, and NameCY to put the content of the arrays but this is where I'm having issues.
Thanks for offering to look
John.
- SLalwaniFeb 01, 2021Copper Contributor
John Dorrian , I can see various values in the specified field as follows ,
'Asiantaeth Safonau Bwyd'@cy|'Food Standards Agency'@en , 'Adur District Council'@en, ...
Please confirm that you need to just filter out the substring which is depicting the language @en. , i.e.,
'Food Standards Agency' 'Adur District Council' ...
For your NOTE: datafactory doesn't like headers starting with '@' , rather than creating a SQL table, you can just enable 'skip n rows' to 1 from blob dataset settings.
Regards,
Sunaina- John DorrianFeb 01, 2021Brass ContributorIf that's an easier workround to get started then yes if its a case of filtering by @en. I have to say I'm just dipping in and out of Data Factory as the need arises but I really need to commit a lot more time on this.
I could then duplicate the original column and create another filter for @cy when required.