Continuous integration and continuous delivery (CI/CD)
Exclude pipeline triggers that did not change in deployments – now generally available
We’ve improved the CI/CD process by only requiring the triggers that are changed or updated to be stopped and started during deployments using the updated PowerShell. It will help reduce overall deployment time and the need to stop all triggers during deployment.
When designing a mapping data flow, users can view their data at each step using Data preview. Currently, the Data preview pane is limited to a view containing 100 rows, but by using the Export CSV option, users will be able to view up to 1000 rows from the transformation results.
SQL CDC in Mapping Data Flows now available (Public Preview)
Azure Data Factory has expanded its native change data capture capabilities to include SQL Server, Azure SQL Database, and Azure SQL Managed Instance (MI) connectors. Changed data in SQL stores can be automatically detected and extracted by ADF mapping data flows.
Unlock advanced analytics with Microsoft 365 Mapping Data Flow Connector (Preview)
We have launched a limited public preview for a new M365 Mapping Data Flows Connector in Azure Data Factory and Azure Synapse Analytics. With this connector, you will be able to quickly clean, normalize, and flatten your data from parquet to multiple data sinks, reducing costs and accelerating analytics. A new pipeline template is also available to simplify the configuration experience, saving time and effort.
SAP Change Data Capture (CDC) connector now generally available
The SAP CDC connector is now generally available in Azure Data Factory and Azure Synapse Analytics, providing a simple, integrated experience to extract and transform the raw change data coming from a variety of SAP source systems, including SAP ECC, SAP S/4HANA, SAP BW, and SAP BW/4HANA.
Learning Center now available in the Azure Data Factory Studio
We've launched the Azure Data Factory (ADF) Learning Center, a new central location where users can find learning resources like the latest features updates, getting started tutorials, best practice videos, training modules, product links, and more. With the Learning Center, we aim to reduce the learning curve and empower each user to achieve success with self-directed learning that is integrated into the ADF studio.
New design in Azure portal – easily discover how to launch ADF Studio
Based on user feedback, we have re-designed the user interface (UI) for launching of the ADF Studio to make it easier for users to discover how to launch the ADF studio from the Azure portal. Users will also be able to locate training content and access quick starts and tutorials before jumping into the studio.
Updated quick-start experience - one-click to try Azure Data Factory
We’ve updated our new quick start experience to make it easier to try Azure Data Factory. Now, users can get started quickly with one-click and create a new data factory and pipeline with sample data to explore.
Granular billing view available for ADF – see detailed billing information by pipeline (Public Preview)
To provide more clarity and transparency, a granular billing view is now available for Azure Data Factory pipelines. With the built-in per pipeline detailed billing view, users can see exactly how much each pipeline costs to operate.By opting into the feature, a separate line item will be shown for each pipeline and charges associated with a pipeline will be grouped together under the pipeline name, giving a clear view of the cost of operations. Aggregate views for factories are also available, as charges can be filtered by factory name in the Azure billing report.
Script activity execution timeout now configurable
You can now configure the wait time for a script block execution operation to complete before the it times out. Previously this was set to 2 hours, but now, it can be personalized to a value that you set.