Microsoft
Tech Community
Home
Community Hubs
Community Hubs
Community Hubs Home
Products
Special Topics
Video Hub
Close
Products
(50)
Special Topics
(27)
Video Hub
(462)
Most Active Hubs
Microsoft 365
Microsoft Teams
Windows
Security, Compliance and Identity
Outlook
Planner
Windows Server
Azure
Exchange
Intune and Configuration Manager
Content Management
SQL Server
Microsoft Viva
Connect and learn from experts and peers
Microsoft FastTrack
Best practices and the latest news on Microsoft FastTrack
Microsoft Copilot for Sales
A role-based copilot designed for sellers
Most Active Hubs
Education Sector
AI and Machine Learning
ITOps Talk
Microsoft Partner Community
Microsoft Mechanics
Healthcare and Life Sciences
Public Sector
Internet of Things (IoT)
Driving Adoption
Small and Medium Business
Startups at Microsoft
Azure Partner Community
Expand your Azure partner-to-partner network
Microsoft Tech Talks
Bringing IT Pros together through In-Person & Virtual events
MVP Award Program
Find out more about the Microsoft MVP Award Program.
Video Hub
Azure
Exchange
Microsoft 365
Microsoft 365 Business
Microsoft 365 Enterprise
Microsoft Edge
Microsoft Outlook
Microsoft Teams
Security
SharePoint
Windows
Blogs
Blogs
Events
Events
Events Home
Microsoft Ignite
Microsoft Build
Community Events
Microsoft Learn
Microsoft Learn
Home
Community
Blog
Azure
Dynamics 365
Microsoft 365
Security, Compliance & Identity
Power Platform
Github
Teams
.NET
Lounge
Lounge
1.4M
Members
11.9K
Online
328K
Discussions
Search
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
Show
only
|
Search instead for
Did you mean:
Sign In
Sign In
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for
Show
only
|
Search instead for
Did you mean:
Azure Data Factory Blog
Filter by label
Filter by label
ADF
ADF CDC
ADF Monthly Blog
Alerts
Apache
Apache Airflow
Authoring
Azure Databricks
Azure Data Factory
Azure Data Factory CDC
Azure Data Integration
Azure Data Lake Storage
Azure Data Preparation
Azure ETL
Azure Function
Azure Government
Azure Integration Runtime
Azure Purview
Azure Synapse
Azure Synapse Analtyics
Azure Synapse Analyics
Azure Synapse Analytics
azure synapse data flows
Big Data
Big Data Analytics
Billing
CDC
Change Data Capture
Change Data Capture in ADF
CICD
continuous integration
Copy Activity
Cosmos DB
Databricks
Data Flows
Data Prep
Data Preparation
Data Security
Dataverse
Data Wrangling
development
event driven architecture
Finance
GitHub
JSON
Logical Execution
Logical Expression
Managed Airflow
Mapping Data Flow
Mapping Data Flows
Mapping Data Flows Cloud ETL
metadata driven architecture
Microsoft Build 2022
Microsoft Ignite 2022
Microsoft Teams
monitoring
Notifications
operation
Orchestration
Orchestration Analytics
PostgreSQL
Power Query
Public Preview
SAP
sla
Snowflake
Synapse
Synapse Analytics
Synapse Link
Templates
trigger
Variable
Wrangling Data Flows
Follow
RSS
X
URL
Copy
Options
Author
Add author
Searching
invalid author
# of articles
25
50
100
200
Labels
Select Label
(
0
)
Clear selected
ADF
ADF CDC
ADF Monthly Blog
Alerts
Apache
Apache Airflow
Authoring
Azure Databricks
Azure Data Factory
Azure Data Factory CDC
Azure Data Integration
Azure Data Lake Storage
Azure Data Preparation
Azure ETL
Azure Function
Azure Government
Azure Integration Runtime
Azure Purview
Azure Synapse
Azure Synapse Analtyics
Azure Synapse Analyics
Azure Synapse Analytics
azure synapse data flows
Big Data
Big Data Analytics
Billing
CDC
Change Data Capture
Change Data Capture in ADF
CICD
continuous integration
Copy Activity
Cosmos DB
Databricks
Data Flows
Data Prep
Data Preparation
Data Security
Dataverse
Data Wrangling
development
event driven architecture
Finance
GitHub
JSON
Logical Execution
Logical Expression
Managed Airflow
Mapping Data Flow
Mapping Data Flows
Mapping Data Flows Cloud ETL
metadata driven architecture
Microsoft Build 2022
Microsoft Ignite 2022
Microsoft Teams
monitoring
Notifications
operation
Orchestration
Orchestration Analytics
PostgreSQL
Power Query
Public Preview
SAP
sla
Snowflake
Synapse
Synapse Analytics
Synapse Link
Templates
trigger
Variable
Wrangling Data Flows
Clear
Home
Home
Azure Data
Azure Data Factory Blog
Options
Mark all as New
Mark all as Read
Pin this item to the top
Subscribe
Bookmark
Subscribe to RSS Feed
2,550
Data Factory Increases Maximum Activities Per Pipeline to 80
Noelle_Li
on
Mar 29 2024 10:00 AM
This week we have doubled the limit on number of activities you may define in a pipeline, from 40 to 80. With more freed...
1,240
Action Required: Switch from Memory Optimized Data Flows in Azure Data Factory to General Purpose
Noelle_Li
on
Mar 25 2024 04:57 PM
Azure Data Factory Memory Optimized Data Flows will be fully retired on April 1, 2027. Going forward, all ADF Data Flows...
1,482
Continued region expansion: Azure Data Factory is generally available in two more regions
Chunhua
on
Jan 17 2024 10:00 AM
Azure Data Factory is now available in two new regions.
2,341
Continued region expansion: Azure Data Factory is generally available in Poland Central
Chunhua
on
Oct 27 2023 12:00 PM
Azure Data Factory is now available in Poland Central
3,562
General Availability of Time to Live (TTL) for Managed Virtual Network in Azure Data Factory
lrtoyou1223
on
Oct 10 2023 09:00 PM
We are excited to announce the general availability of Azure Data Factory Managed Virtual Network Time to Live (TTL).
13.5K
Metadata Driven Pipelines for Dynamic Full and Incremental Processing in Azure SQL
Marc_Bushong
on
Sep 28 2023 07:35 AM
With Azure SQL or Synapse, you can facilitate a dynamic ETL for incremental processing (dynamic SQL delete and insert) a...
4,883
Integer Type Available for Pipeline Variables
ChenyeCharlieZhu
on
Aug 17 2023 02:10 PM
We are excited to announce that integer type has been added to pipeline variables. This will significantly simplify your...
4,222
Documentation search now embedded in Azure Data Factory
Mark Kromer
on
Jul 13 2023 02:40 PM
Azure Data Factory has added documentation search to the embedded search bar
9,066
Comment Out Part of Pipeline
ChenyeCharlieZhu
on
Jul 07 2023 01:46 PM
To kick start the second half of 2023, ADF team has brought you major improvements in pipeline development and authoring...
3,720
Continued region expansion: Azure Data Factory just became generally available in Sweden Central
Chunhua
on
Jun 29 2023 10:37 PM
Azure Data Factory is now available in Sweden Central.
7,154
Securing outbound traffic with Azure Data Factory's outbound network rules
Abhishek Narain
on
Jun 12 2023 12:00 PM
The Outbound Rules feature in Azure Data Factory allows organizations to exercise granular control over outbound traffic...
6,098
Introducing optional Source settings for DelimitedText and JSON sources for top-level CDC resource
Krishnakumar_Rukmangathan
on
Jun 02 2023 06:00 AM
We are excited to introduce optional source configurations for Delimited source and JSON sources in top-level CDC resour...
8,372
Unroll multiple arrays in a single Flatten step in ADF
Mark Kromer
on
Apr 21 2023 12:48 PM
You can now easily unroll multiple arrays inside a single Flatten transformation in Azure Data Factory and Azure Synapse...
4,399
ADF private DNS zone overrides ARM DNS resolution causing ‘Not found’ error.
Sachin215
on
Apr 18 2023 04:47 PM
#Issue: ADF private DNS zone overrides ARM DNS resolution causing ‘Not found’ error #Solution Steps: Note: If the custom...
4,973
Trigger ADF pipeline using Storage event trigger over private network.
Sachin215
on
Apr 18 2023 12:31 PM
Project Technology: Azure function, ADF, Azure Synapse, ADLS Issue description: Customer has a strict regulatory complia...
7,086
Pipeline Logic 3: Error Handling and Try Catch
ChenyeCharlieZhu
on
Apr 05 2023 10:20 AM
In this series on Orchestration, we will dive deep to understand conditional executions in ADF, and build complex logic ...
6,274
Capture Changed Data From your Cosmos DB analytical store (Preview)
Mark Kromer
on
Mar 30 2023 09:33 AM
Making it super-easy to create efficient and fast ETL processing the cloud, Azure Data Factory has invested heavily in c...
7,319
Azure Data Factory February 2023 Monthly Update
Noelle_Li
on
Mar 09 2023 04:20 PM
Welcome to Azure Data Factory’s February monthly update! Here we’ll share the latest updates on what’s new in Azure Data...
19.7K
Process your data in seconds with new ADF real-time CDC
Mark Kromer
on
Mar 03 2023 01:50 PM
In January, we announced that we've elevated our Change Data Capture features front-and-center in ADF. Up until just tod...
18.1K
Introducing Dark Mode for ADF Studio
Noelle_Li
on
Mar 02 2023 01:57 PM
Today, we are excited to share that Dark Mode is now available in the Azure Data Factory Studio!
8,611
Best practices for Azure Data Factory Integration Runtime
lrtoyou1223
on
Feb 17 2023 01:07 PM
Integration runtime is a core component of Azure Data Factory. Users can use the integration runtime created by default ...
20.5K
You can now customize the return value from your pipeline!
Mark Kromer
on
Feb 16 2023 10:25 AM
When building complex workflows in the cloud with Azure Data Factory and Azure Synapse Pipelines, a very common pattern ...
6,251
Azure Data Factory January 2023 Monthly Update
Noelle_Li
on
Feb 07 2023 02:00 PM
Welcome to Azure Data Factory’s January monthly update! Here we’ll share the latest updates on what’s new in Azure Data ...
4,639
Directly Launch Pipeline Template Gallery through the Azure Portal
Penny_Zhou
on
Feb 07 2023 11:22 AM
We are excited to announce an easier way to access pipeline template gallery - launch the Pipeline Template Gallery dire...
54.8K
Introducing 'Workflow Orchestration Manager' powered by Apache Airflow in Azure Data Factory
Abhishek Narain
on
Feb 01 2023 12:03 PM
Today, we are excited to announce the capability to run Apache Airflow DAGs (Directed Acyclic Graph) within Azure Data F...
10.2K
Orchestrate and operationalize Synapse Notebooks and Spark Job Definitions from Azure Data Factory
Abhishek Narain
on
Jan 25 2023 11:18 AM
Today, we are introducing support for orchestrating Synapse notebooks and Synapse spark job definitions (SJD) natively f...
6,226
Pipeline Logic 2: OR (at least 1 activity succeeded or failed)
ChenyeCharlieZhu
on
Jan 24 2023 01:58 PM
In this series on Orchestration, we will dive deep to understand conditional executions in ADF, and build complex logic ...
27.3K
Announcing the Public Preview of a new top-level CDC resource in ADF
Noelle_Li
on
Jan 23 2023 12:37 PM
Azure Data Factory (ADF) has recently added many new CDC-enabled connectors to process change data from SQL, Storage, Co...
10K
Pipeline Logic 1: Error Handling and Best Effort Step
ChenyeCharlieZhu
on
Jan 13 2023 03:45 PM
In this series on Orchestration, we will dive deep to better understand conditional executions in ADF, and build complex...
8,978
Connecting to Snowflake using Key-Pair Authentication in Azure Data Factory
sgsshankar
on
Jan 05 2023 11:08 AM
In this article, Shankar Narayanan describes a workaround method for connecting to Snowflake from Azure Data Factory usi...
«
Previous
Next
»
Latest Comments
haochen
in
Data Factory Increases Maximum Activities Per Pipeline to 80
on
Apr 23 2024 10:51 AM
We discovered an issue in this fix, additional change is needed to fully fix this. New ETA is end of next week.
0 Likes
haochen
in
Data Factory Increases Maximum Activities Per Pipeline to 80
on
Apr 22 2024 09:30 AM
@NithinVithayathil need one more day, the last tier will be deployed today.
1 Likes
NithinVithayathil
in
Data Factory Increases Maximum Activities Per Pipeline to 80
on
Apr 22 2024 08:37 AM
@haochen Just checking if the fix was deployed
0 Likes
haochen
in
Data Factory Increases Maximum Activities Per Pipeline to 80
on
Apr 16 2024 12:31 AM
@NithinVithayathil , we are deploying the fix this week.
2 Likes
NithinVithayathil
in
Data Factory Increases Maximum Activities Per Pipeline to 80
on
Apr 15 2024 11:31 PM
@haochen Do we have any solution for the npm validation? I am also running into the same issue while using npm validation in ADF CI/CD
0 Likes
Browse
Latest Comments