Data Flow activity can now run on cross-region integration runtimes

Published Jun 12 2020 01:18 PM 2,113 Views
Microsoft

Data Flows can now be run on integration runtimes (IR) in regions other than Auto-resolve. Now you can choose which data center the Spark compute is executed in. In some cases, this allows for data flows to be ran in locations closer to the source and destination data stores. 

daperlov_0-1591992849563.png

 

In terms of user experience, nothing is different in the data flow activity. You simply will no longer face a validation error when specifying a new region. 

 

Running a data flow in a different region can also be used as a recovery mechanism if there is any geographically isolated issue or outage.

 

For more information, see the data flow activity documentation.

2 Comments
%3CLINGO-SUB%20id%3D%22lingo-sub-1459783%22%20slang%3D%22en-US%22%3EData%20Flow%20activity%20can%20now%20run%20on%20cross-region%20integration%20runtimes%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1459783%22%20slang%3D%22en-US%22%3E%3CP%3EData%20Flows%20can%20now%20be%20run%20on%20integration%20runtimes%20(IR)%20in%20regions%20other%20than%20Auto-resolve.%20Now%20you%20can%20choose%20which%20data%20center%20the%20Spark%20compute%20is%20executed%20in.%20In%20some%20cases%2C%20this%20allows%20for%20data%20flows%20to%20be%20ran%20in%20locations%20closer%20to%20the%20source%20and%20destination%20data%20stores.%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22daperlov_0-1591992849563.png%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Fgxcuf89792.i.lithium.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F198457i6A6C9F33F678536F%2Fimage-size%2Fmedium%3Fv%3D1.0%26amp%3Bpx%3D400%22%20title%3D%22daperlov_0-1591992849563.png%22%20alt%3D%22daperlov_0-1591992849563.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EIn%20terms%20of%20user%20experience%2C%20nothing%20is%20different%20in%20the%20data%20flow%20activity.%20You%20simply%20will%20no%20longer%20face%20a%20validation%20error%20when%20specifying%20a%20new%20region.%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ERunning%20a%20data%20flow%20in%20a%20different%20region%20can%20also%20be%20used%20as%20a%20recovery%20mechanism%20if%20there%20is%20any%20geographically%20isolated%20issue%20or%20outage.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EFor%20more%20information%2C%20see%20the%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fdata-factory%2Fcontrol-flow-execute-data-flow-activity%22%20target%3D%22_self%22%20rel%3D%22noopener%20noreferrer%22%3Edata%20flow%20activity%20documentation%3C%2FA%3E.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-1459783%22%20slang%3D%22en-US%22%3E%3CP%3EAzure%20Data%20Factory%20now%20allows%20for%20data%20flow%20jobs%20to%20run%20in%20the%20data%20center%20of%20your%20choice!%20Integration%20runtimes%20of%20different%20regions%20can%20be%20chosen%20as%20the%20compute%20for%20your%20data%20flow%20activities.%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-1459783%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20Data%20Factory%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Integration%20Runtime%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMapping%20Data%20Flows%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1466718%22%20slang%3D%22en-US%22%3ERe%3A%20Data%20Flow%20activity%20can%20now%20run%20on%20cross-region%20integration%20runtimes%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1466718%22%20slang%3D%22en-US%22%3E%3CP%3EWould%20like%20to%20hear%20a%20feature%20of%20running%20dataflow%20on%20managed%20databricks%20%2F%20SHIR.%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-1525268%22%20slang%3D%22en-US%22%3ERe%3A%20Data%20Flow%20activity%20can%20now%20run%20on%20cross-region%20integration%20runtimes%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-1525268%22%20slang%3D%22en-US%22%3E%3CP%3EYes%20without%20us%20being%20able%20to%20use%20Self%20hosted%20IR%20%2C%26nbsp%3B%20data%20flows%20is%20basically%20useless.%20As%20some%20companies%20like%20ours%20where%20they%20have%20more%20security%20restrictions%20that%20they%20should%20only%20use%20Self%20hosted%20IRs.%20Hope%20this%20will%20get%20fixed%20soon%20by%20MSFT.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Version history
Last update:
‎Jun 12 2020 01:18 PM
Updated by: