Exclude pipeline triggers that did not change in deployments
We’ve improved the CI/CD process by only requiring the triggers that are changed or updated that will be stopped and started during deployments using the updated PowerShell. This will help reduce overall deployment time and the need to stop all triggers during deployment!
Cast transformation added – visually convert data types
It is very common to transform data types into data integration workloads. For example, you might need to convert strings to dates. Previously to do this in mapping data flows, you had to use Expression Builder and remember the correct syntax or keywords to convert data types in mapping data flows.
For example, the syntax to convert a string ‘Jul-01-2022’ to date 2022-07-01 is toDate(‘Jul-01-2022’, ‘MMM-dd-yyyy’, ‘en-US’).
Now, you can use the cast transformation to quickly transform data types visually!
New UI for inline datasets - categories added to easily find data sources
We’ve updated our data flow source UI to make it easier to find your inline dataset type. Previously, you would have to scroll through the list or filter to find your inline dataset type. Now, we have categories that group your dataset types, making it easier to find what you’re looking for.
Default activity time-out changed from 7 days to 12 hours
We heard your feedback, and it was clear that the default pipeline activity timeout of 7 days was too long! While you can still customize the timeout, the default activity time out for Azure Data Factory and Azure Synapse Analytics is now 12 hours.
Service principal authentication type added for Blob storage
Now, users can use the Service Principal authentication type for Azure Blob Storage! This allows you to use Azure role-based access control (Azure RBAC) to grant permissions to a security principal, which may be a user, group, or application service principal, who can then authenticate with Azure AD to authorize a request.
New data factory creation experience - 1 click to have your factory ready within seconds
A new user experience is ready in the landing page of adf.azure.comor the "Switch Data Factory" tab of Data Factory Studio portal to enable users to create a Data Factory with only one click! All you need is a factory name, location, and subscription and the Data Factory created will be available for use within seconds. The new creation experience will not only empower new users to quickly use and learn more about Data Factory, but also let experienced users easily create a new factory for testing.