Introduction: Setting up alerts for pipeline failures on a Teams channel/outlook mail enhances communication, collaboration, and problem-solving within your team. It creates a streamlined workflow for addressing issues, reduces downtime, and promotes a culture of continuous improvement in managing your data pipelines.
In this blog, I'll showcase a method for sending notifications to both Teams channels/groups and Outlook emails. Microsoft Fabric now includes Teams activity as a recent addition.
1.Basic knowledge of Data Factory pipelines.
2.Workspace in Microsoft Fabric.
3. Teams channel & outlook account (you can do only one of them).
Create Pipeline in Fabric Data Factory, click on create pipeline.
In your pipeline, click on Copy Data
create a basic copy activity - Fill all the details and make sure that it will fail this is the use case that we want to be notified on. PS: connect to the teams and the outlook activities on fail in the copy activity like so:
Steps for adding Teams Activity: 1. Add Teams activity by navigating to the Activities tab and dragging the Teams activity onto the canvas. Then, within the Settings tab, log in to your Teams account.
you should get loading screen (it will create a team's connection) and after it fill the relevant information, in my case:
I chose to send a message to a teams channel called "test teams channel" In message tab, i attached the output of the copy activity.
Steps for adding Outlook Activity 1. In activities tab, drag outlook activity 2. connect our copy activity on fail to the outlook activity 3.Same as in teams' activity, in settings tab sign into your outlook account 4. fill relevant information about the failure, in advanced tab, i choose to be sensitivity to be confidential
@concat('Copy activity in Notification pipeline failed, details:',activity('Copy data').output)
5. Output for the Outlook activity:
You can see in the output that it was classified as important and confidential as i listed in the activity settings.
In Summary, setting up alerts for pipeline failures and sending notifications to a Teams channel can be highly beneficial for the reasons mentioned above, consider notifying your teams/channels/mail to keep up with the production environment.