HDInsight tools for VS Code now supports argparse and Spark 2.2

Community Manager

We are happy to announce that HDInsight Tools for VSCode now supports argparse and accepts parameter based Pyspark Job submission. We also enabled the tools to support Spark 2.2 for PySpark author and job submission.

 

The argparse feature grants you great flexibility for your PySpark code author, test and job submission for both batch and interactive query. You can fully enjoy the advantage of PySpark argparse, and simply keep your configuration and your job-related arguments in the Json based configuration file.

 

246025d7-a507-450e-9fa3-204ef40b6ddd.png

 

Read more about it in the Azure blog.

0 Replies