ADF Monitoring Improvements

Published Apr 26 2022 02:30 PM 4,602 Views
Microsoft

The Azure Data Factory team is happy to announce several new improvements to the monitoring experience. These improvements and new features are based off community feedback and votes, social media feedback, and survey results.

 

1. First up is the ability to export the data you see to a CSV file. This will be whatever data is on the screen so will obey any filters you have in place!

JoshuhaOwen_0-1650997869419.png

 

 


2. You can now clear all filters with an easy button press, this will make it easier to get back to your default filter state.

JoshuhaOwen_1-1650996829445.png

 


3. You now have the ability to open the activity run details in a new tab. This will make it easier to look at multiple runs without losing context of where you were. There are two different ways to perform this action.

a) First, you select one or more pipeline runs and click the “open new tabs” button at the top. Please note you may need to allow popup windows if you are unable to open more than 1 tab at a time.

JoshuhaOwen_2-1650996844740.png

 


b) The second method is for a single pipeline run you can right-click to get a context menu that allow you to open in a new tab, window, or copy a link to the pipeline run.

JoshuhaOwen_3-1650996856685.png

 


4. Any column changes you make via “Edit columns” will be preserved for that browser profile. So, if you add or remove columns your column list should be remembered!
5. Similarly, if you navigate from the pipeline runs into the activity details of an individual run and navigate back via either the browser back button or via the breadcrumb your previous state should be still there. No more waiting on the monitoring data to refresh when you go back!

 

We hope these bundle of monitoring improvements helps to make your monitoring experience smoother, quicker and more productive. We are always open for feedback on what’s next for monitoring in ADF and you can provide suggestions or vote via our Ideas forum Data factory · Community (azure.com).

7 Comments
%3CLINGO-SUB%20id%3D%22lingo-sub-3295531%22%20slang%3D%22en-US%22%3EADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3295531%22%20slang%3D%22en-US%22%3E%3CP%3EThe%20Azure%20Data%20Factory%20team%20is%20happy%20to%20announce%20several%20new%20improvements%20to%20the%20monitoring%20experience.%20These%20improvements%20and%20new%20features%20are%20based%20off%20community%20feedback%20and%20votes%2C%20social%20media%20feedback%2C%20and%20survey%20results.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E1.%20First%20up%20is%20the%20ability%20to%20export%20the%20data%20you%20see%20to%20a%20CSV%20file.%20This%20will%20be%20whatever%20data%20is%20on%20the%20screen%20so%20will%20obey%20any%20filters%20you%20have%20in%20place!%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22JoshuhaOwen_0-1650997869419.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F367000iDAC43A89D48F74DF%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22JoshuhaOwen_0-1650997869419.png%22%20alt%3D%22JoshuhaOwen_0-1650997869419.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3E2.%20You%20can%20now%20clear%20all%20filters%20with%20an%20easy%20button%20press%2C%20this%20will%20make%20it%20easier%20to%20get%20back%20to%20your%20default%20filter%20state.%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22JoshuhaOwen_1-1650996829445.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F366995iE38A7E2980779BFF%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22JoshuhaOwen_1-1650996829445.png%22%20alt%3D%22JoshuhaOwen_1-1650996829445.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3E3.%20You%20now%20have%20the%20ability%20to%20open%20the%20activity%20run%20details%20in%20a%20new%20tab.%20This%20will%20make%20it%20easier%20to%20look%20at%20multiple%20runs%20without%20losing%20context%20of%20where%20you%20were.%20There%20are%20two%20different%20ways%20to%20perform%20this%20action.%3C%2FP%3E%0A%3CP%20style%3D%22%20padding-left%20%3A%2030px%3B%20%22%3Ea)%20First%2C%20you%20select%20one%20or%20more%20pipeline%20runs%20and%20click%20the%20%E2%80%9Copen%20new%20tabs%E2%80%9D%20button%20at%20the%20top.%20Please%20note%20you%20may%20need%20to%20allow%20popup%20windows%20if%20you%20are%20unable%20to%20open%20more%20than%201%20tab%20at%20a%20time.%3C%2FP%3E%0A%3CP%20style%3D%22%20padding-left%20%3A%2030px%3B%20%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22JoshuhaOwen_2-1650996844740.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F366996iCACEB8A4FF41F8F8%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22JoshuhaOwen_2-1650996844740.png%22%20alt%3D%22JoshuhaOwen_2-1650996844740.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%20style%3D%22%20padding-left%20%3A%2030px%3B%20%22%3E%3CBR%20%2F%3Eb)%20The%20second%20method%20is%20for%20a%20single%20pipeline%20run%20you%20can%20right-click%20to%20get%20a%20context%20menu%20that%20allow%20you%20to%20open%20in%20a%20new%20tab%2C%20window%2C%20or%20copy%20a%20link%20to%20the%20pipeline%20run.%3C%2FP%3E%0A%3CP%20style%3D%22%20padding-left%20%3A%2030px%3B%20%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22JoshuhaOwen_3-1650996856685.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F366997i79C53F46F4C098DA%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22JoshuhaOwen_3-1650996856685.png%22%20alt%3D%22JoshuhaOwen_3-1650996856685.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CBR%20%2F%3E4.%20Any%20column%20changes%20you%20make%20via%20%E2%80%9CEdit%20columns%E2%80%9D%20will%20be%20preserved%20for%20that%20browser%20profile.%20So%2C%20if%20you%20add%20or%20remove%20columns%20your%20column%20list%20should%20be%20remembered!%3CBR%20%2F%3E5.%20Similarly%2C%20if%20you%20navigate%20from%20the%20pipeline%20runs%20into%20the%20activity%20details%20of%20an%20individual%20run%20and%20navigate%20back%20via%20either%20the%20browser%20back%20button%20or%20via%20the%20breadcrumb%20your%20previous%20state%20should%20be%20still%20there.%20No%20more%20waiting%20on%20the%20monitoring%20data%20to%20refresh%20when%20you%20go%20back!%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EWe%20hope%20these%20bundle%20of%20monitoring%20improvements%20helps%20to%20make%20your%20monitoring%20experience%20smoother%2C%20quicker%20and%20more%20productive.%20We%20are%20always%20open%20for%20feedback%20on%20what%E2%80%99s%20next%20for%20monitoring%20in%20ADF%20and%20you%20can%20provide%20suggestions%20or%20vote%20via%20our%20Ideas%20forum%20%3CA%20href%3D%22https%3A%2F%2Ffeedback.azure.com%2Fd365community%2Fforum%2F1219ec2d-6c26-ec11-b6e6-000d3a4f032c%22%20target%3D%22_self%22%20rel%3D%22nofollow%20noopener%20noreferrer%22%3EData%20factory%20%C2%B7%20Community%20(azure.com)%3C%2FA%3E.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-3295531%22%20slang%3D%22en-US%22%3E%3CP%3EADF%20is%20releasing%20several%20new%20improvements%20to%20the%20monitoring%20experience.%20This%20includes%20the%20ability%20to%20export%20results%20to%20a%20CSV%2C%20clear%20all%20filters%2C%20open%20a%20run%20in%20a%20new%20tab%2C%20and%20improved%20caching%20of%20columns%20and%20results.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-3295531%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Data%20Integration%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20ETL%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EBig%20Data%20Analytics%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3296674%22%20slang%3D%22de-DE%22%3ESubject%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3296674%22%20slang%3D%22de-DE%22%3E%3CP%3EThank%20you%20for%20sharing%20this%20Update.%20Happy%20to%20see%20the%20one%20click%20button!%3C%2FP%3E%3CP%3ECheers%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3296862%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3296862%22%20slang%3D%22en-US%22%3E%3CBLOCKQUOTE%3E%3CP%3E%3CSPAN%3ENo%20more%20waiting%20on%20the%20monitoring%20data%20to%20refresh%20when%20you%20go%20back!%3C%2FSPAN%3E%3C%2FP%3E%3C%2FBLOCKQUOTE%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%3EThis%20will%20be%20awesome.%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3297163%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3297163%22%20slang%3D%22en-US%22%3E%3CP%3EAtlast%20some%20useful%20features.%20Our%20Ops%20engineer%20spend%20most%20of%20the%20time%20in%20navigating%20back%20and%20forth%20in%20the%20pipeline%20run%20view.%20Opening%20the%20pipeline%20run%20in%20new%20tab%20is%20what%20we%20usually%20do%20%3A)%3C%2Fimg%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3298135%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3298135%22%20slang%3D%22en-US%22%3E%3CP%3EA%20few%20more%20improvements%20on%20the%20metrics%20page%20that%20would%20be%20of%20BIG%20HELP%20(truly!!)%20are%3A%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3Ea.%20Have%20the%20'Export%20to%20CSV'%20export%20the%20data%20that%20is%20on%20all%20the%20pages%20of%20the%20view%20..................not%20just%20the%20one%20that%20is%20visible%20currently.%26nbsp%3B%3C%2FP%3E%3CP%3Eb.%20Including%20some%20more%20performance%20metrics%20of%20the%20pipeline%20in%20the%20main%20view%20itself.%26nbsp%3B%20This%20like%20Data%20Movement%20Activities%2C%20External%20Activities%2C%20Pipeline%20Activities%20and%20Pipeline%20Orchestration%20Activity%20Runs.%26nbsp%3B%20Right%20now%20to%20get%20this%20information%20-%20we%20have%20to%20go%20into%20each%20pipeline%20and%20pull%20the%20details.%26nbsp%3B%20This%20is%20very%20painful.%26nbsp%3B%20Please%20see%20the%20diagram%20below%3A%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22pipeline%20metrics.JPG%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F367786iC27C3F7AE1CAEB73%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22pipeline%20metrics.JPG%22%20alt%3D%22pipeline%20metrics.JPG%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3EIf%20these%20details%20are%20available%20as%20part%20of%20the%20main%20background%20view%20columns%20-%20that%20would%20be%20extremely%20helpful%20for%20us%20to%20export%20the%20details%20into%20a%20csv%20-%20for%20analysis%20purposes.%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3300717%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3300717%22%20slang%3D%22en-US%22%3E%3CP%3EThat%20s%20a%20very%20good%20feature%2C%20now%20we%20finished%20with%20the%20back%20and%20forth%20in%20the%20run%20view%20of%20the%20pipeline%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3301975%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3301975%22%20slang%3D%22en-US%22%3E%3CP%3ECSV%20export%20is%20greatly%20helpful.%20However%2C%20can%20you%20shed%20some%20light%20on%20the%20Duration%20field%20in%20CSV%20file%3F%20It%20is%20a%20numeric%20value%20while%20on%20web%20it%20shows%20'hh%3Amm%3Ass'%20format.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3302141%22%20slang%3D%22en-US%22%3ERe%3A%20ADF%20Monitoring%20Improvements%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3302141%22%20slang%3D%22en-US%22%3E%3CP%3EWhat%20does%20the%20column%20%22Run%20Dimension%22%20do%3F%3C%2FP%3E%3C%2FLINGO-BODY%3E
Co-Authors
Version history
Last update:
‎Apr 26 2022 01:33 PM
Updated by: