Forum Discussion
John Dorrian
Aug 19, 2021Brass Contributor
Dataflow Source Settings error that doesn't replicate when I test connection
Hope someone can help. I get the following error when run in a dataflow, however when I run the test connection it works fine.
Can someone tell me why a connection will work as part of a test but not in a dataflow? I've obviously made a mistake somewhere but I don't know where.
Error code: InvalidTemplate
Failure type: User configuration issue
Details: The template function 'dataset' is not defined or not valid
Source: Pipeline: codes_Output_Concat
Data flow: CodesDataFlow_Concatinate
Monitor: Data flow activity codes_Output_Concat
What is the dataflow suppose to do?
Source is suppose to allow a user to select a file using a parameter (the name of the file) The parameter has been called TransferFile.
the select section then takes the CSV's headers and removes some invalid charicters before moving onto the derived columns that uses byName function to pick out the columns I want to keep and cleans them up a bit. The Sink is then suppose to create a sql table to put the cleaned data into.
Here are the parameters I've added to the dataflow.
The dataflow does work when I add specific datasets with the names of the source data but not when I use the parameters for this.
The parameters work well on the other copy data pipeline I created for the first part of this process. I've left that out of this altogether as I didn't want to confuse things.
Thanks for reading
Hope someone can point me in the right direction
John.
No RepliesBe the first to reply