Transform Data at Scale Easily with ADF Data Flows: Getting Started

[Mark Kromer]

3 new ADF videos in a series, each less than 15 minutes, walking you through how to get started transforming data with zero-code, at scale, in the cloud, using Spark.

Part 1: Getting started with data flows in ADF

Part 2: Analytics in Data Factory with aggregates, debug and data preview in data flows

Part 3: Put it all together in an operational pipeline and add derived column calculation formulas

[DTL-minion]

In your video you say the statistics are run on the whole file regardless of how many records are shown in the preview screen, but this does not seem the case as it seems the stats are restricted to the number of records defined in the Debug Settings (which is by default 1000).

[Mark Kromer]

We recently added the row limit in debug settings to also include stats, so you are correct. However, if you do not change the row limit, you will see stats across your entire dataset.