Blog Post

Azure Data Factory Blog
1 MIN READ

Transform Data at Scale Easily with ADF Data Flows: Getting Started

Mark Kromer's avatar
Mark Kromer
Icon for Microsoft rankMicrosoft
Nov 06, 2019

3 new ADF videos in a series, each less than 15 minutes, walking you through how to get started transforming data with zero-code, at scale, in the cloud, using Spark.

 

Part 1: Getting started with data flows in ADF

 

Part 2: Analytics in Data Factory with aggregates, debug and data preview in data flows

 

 

Part 3: Put it all together in an operational pipeline and add derived column calculation formulas

 

Published Nov 06, 2019
Version 1.0
azure data factory
Azure ETL
Mapping Data Flows

2 Comments

  • Mark Kromer's avatar
    Mark Kromer
    Icon for Microsoft rankMicrosoft
    Jan 15, 2020

    We recently added the row limit in debug settings to also include stats, so you are correct. However, if you do not change the row limit, you will see stats across your entire dataset.

  • DTL-minion's avatar
    DTL-minion
    Copper Contributor
    Jan 15, 2020

    In your video you say the statistics are run on the whole file regardless of how many records are shown in the preview screen, but this does not seem the case as it seems the stats are restricted to the number of records defined in the Debug Settings (which is by default 1000).