Blog Post

Azure Data Factory Blog
1 MIN READ

ADF Mapping Data Flows adds ScriptLines and Link Service parameter support

Mark Kromer's avatar
Mark Kromer
Icon for Microsoft rankMicrosoft
Mar 08, 2022

2 important new updates are landing this week in Azure Data Factory's Mapping Data Flows:

 

1. To make it much easier to detect which parts of the underlying data flow script have changed in your mapping data flows, ADF has added support for ScriptLines in your data flow JSON definition. Now you can easily see where changes were made in Git when looking at diffs.

 

2.  Support for parameterized Linked Services has been added to ADF Mapping Data Flows, making for much more flexible and generic handling of generic connections.

Updated Mar 08, 2022
Version 1.0

5 Comments

  • markweatherill's avatar
    markweatherill
    Copper Contributor

    I used the following Powershell to convert my existing dataflows:

     

    foreach ($file in Get-ChildItem -Path $Path) {
        $json = Get-Content $file.FullName | ConvertFrom-Json
    
        $script = $json.properties.typeProperties.script
        $script = $script -replace "\t", "     "
        $scriptLines = $script -split "\n"
    
        Add-Member -InputObject $json.properties.typeProperties -NotePropertyName 'scriptLines' -NotePropertyValue $scriptLines
        $json.properties.typeProperties.PSObject.Properties.Remove('script')
    
        $json | ConvertTo-Json -Depth 32 | Set-Content $file.FullName
    }
  • Yes, this feature applies to new data flows only. It is not planned for Copy.

  • Jon_Christian's avatar
    Jon_Christian
    Copper Contributor

    Will this come to copy data flows as well?

     

    Really miss this feature there

  • #1 seems to only apply to new data flows.

    Any plans on how to migrate or apply it to existing data flows?

  • ToddMcDermid's avatar
    ToddMcDermid
    Copper Contributor

    For #1 - it does not appear that ADF will use "scriptlines" instead of "script" when using the ADF UI. Is this improvement on the roadmap? Or is it complete, but will take some time to roll out across regions?