Introducing 'Workflow Orchestration Manager' powered by Apache Airflow in Azure Data Factory
Today, we are excited to announce the capability to run Apache Airflow DAGs (Directed Acyclic Graph) within Azure Data Factory, adding a key Open-Source integration that provides extensibility for orchestrating python-based workflows at scale on Azure.Microsoft Azure Data Bricks–Collaborative Apache Spark Analytics Platform
First published on MSDN on Apr 19, 2018 I was having a conversation with some colleagues about a institutions which wanted to understand some ways of integrating Azure’s data science services in their curriculum for the new semester So one of the suggestions we came up was the usage of Microsoft Azure DSVMs, HDInsight clusters, DataBricks & Notebooks.Microsoft Machine Learning for Apache Spark
First published on MSDN on Aug 08, 2017 MMLSparkMMLSpark provides a number of deep learning and data science tools for Apache Spark, including seamless integration of Spark Machine Learning pipelines with Microsoft Cognitive Toolkit (CNTK) and OpenCV, enabling you to quickly create powerful, highly-scalable predictive and analytical models for large image and text datasets.
