Azure HDInsight: New Spark UI extensions for better job performance analysis | Azure Friday

Maxim Lukiyanov and Scott Hanselman discuss intricate ways in which Apache Spark jobs can fail in production and how new diagnostics tools, now available in Azure HDInsight, visualize these problems in a new intuitive way and help discover and understand them from the first glance.

 

 

For more information:

• Spark Debugging and Diagnostics Toolset for Azure HDInsight (blog post)
• Apache Spark for Azure HDInsight overview
• Create a free account (Azure)