Recent Blog ArticlesNewest TopicsMost LikesTagged:TagInteger Type Available for Pipeline Variables We are excited to announce that integer type has been added to pipeline variables. This will significantly simplify your workflow, if you are using iterators along with an Until or ForEach loop. Comment Out Part of Pipeline To kick start the second half of 2023, ADF team has brought you major improvements in pipeline development and authoring experience. We now allow you to comment out part of your pipeline, without del...Pipeline Logic 3: Error Handling and Try Catch In this series on Orchestration, we will dive deep to understand conditional executions in ADF, and build complex logic such as how to execute a shared error handling step of any failures in t...Pipeline Logic 2: OR (at least 1 activity succeeded or failed) In this series on Orchestration, we will dive deep to understand conditional executions in ADF, and build complex logic such as how to execute a shared error handling step of any failures in the ...Pipeline Logic 1: Error Handling and Best Effort Step In this series on Orchestration, we will dive deep to better understand conditional executions in ADF, and build complex logic such as: how to execute a shared error handling step of any failures...Granular Billing for Azure Data Factory In this blog, Charlie Zhu walks you through the new granular billing option for Azure Data Factory and helps you better understand pipeline costs. We are bringing clarity and transparency ...AND logic - Many Pre-processing Jobs - Part 1 In an ETL pipeline, you may have multiple pre-processing activities before a downstream job can start. This articles will deep dive on how to express these dependencies in ADF pipelines. Operationalize and Provide SLA for Data Pipelines Avoid long running pipelines. Define Elapsed Time Metric for pipelines to monitor long running pipelines, notify engineers to intervene, and send out service emails. Event Driven Architecture with Custom Event Trigger and Advanced Filtering Implement Event Driven Architecture (EDA) and run pipelines in response to incoming events posted to Event Grid. Understanding Pipeline Failures and Error Handling 2 Elegantly handle error conditions without failing the pipeline. Mark DO-IF-ELSE handling logic as SUCCESS with a dummy UponSkipped activity, and DO-IF-SKIP-ELSE logic
