11 ways to deploy R Server on HDInsight Cluster

Published Mar 23 2019 03:56 PM 172 Views
Microsoft
First published on MSDN on Mar 21, 2017
In this article, we will discuss 11 possible ways to deploy R Server on HDInsight Cluster. Some of these ways will help in automating the cluster creation (using scripts). Majority of them are related to deployment using Azure Resource Manager Templates . ARM Templates are very useful and can be deployed in several ways. Here are the 11 ways :

  1. Azure Portal

  2. .NET SDK

  3. ARM Template + Azure Portal

  4. ARM Template + Powershell

  5. ARM Template + Azure CLI 1.0

  6. ARM Template + Azure CLI 2.0

  7. ARM Template + Ruby

  8. ARM Template + C#

  9. ARM Template + Visual Studio

  10. ARM Template + REST API

  11. AzureSMR package


Let us discuss the above ways. I am not going into detailed description of all the ways - have provided guidance links and required code snippet wherever possible.

Azure Portal


Basic way is to use Azure Portal . Here is an extensive guide : Create the cluster

.NET SDK


Using the Nuget Package Microsoft.Azure.Management.HDInsight . The C# program is provided below. Replace with appropriate values for variables and run it. This program will create a Resource Group, a Storage Account and R Server on HDInsight Cluster.


ARM Template


We will be using the following template.json and parameters.json for #3 to #10. Save the following 2 json files in your local disk. Replace values in parameters.json with your own values.




ARM Template + Azure Portal


Using Template Deployment .  More information here : Deploy resources with Resource Manager templates and Azure portal .

ARM Template + Powershell


Save the following powershell code in the same location as template.json and parameters.json. Run the powershell script as administrator.


ARM Template + Azure CLI 1.0


Install the Azure CLI 1.0

Save the following bash script in the same location as template.json and parameters.json and run the bash script.


ARM Template + Azure CLI 2.0


Install the Azure CLI 2.0

Save the following bash script in the same location as template.json and parameters.json and run the bash script.


ARM Template + Ruby


Using the Microsoft Azure Resource Management Client Library for Ruby . Save the following ruby script in the same location as template.json and parameters.json and run the ruby script. More information : azure_mgmt_resources .


ARM Template + C#


Using the Nuget Package Microsoft.Azure.Management.ResourceManager


ARM Template + Visual Studio


Using Azure Resource Group Project . Visual Studio gives you a nice UI experience to invoke the script and provide some parameter values. More help here : Azure Resource Group for Visual Studio

ARM Template + REST API


Use this guide : Deploy with the REST API

AzureSMR package


This method lets you deploy a R Server HDInsight Cluster from your R session.

Using AzureSMR package, you can either deploy the above provided ARM templates using azureDeployTemplate () function (OR) create HDI cluster directly using azureCreateHDI() function.

More details here: Introducing the AzureSMR package: Manage Azure services from your R session .

Here is the code using azureCreateHDI() function :





I will update this document as when I find more new ways to create R Server on HDInsight Cluster. Please use the comments section to report any issues (OR) provide feedback on the above ways.

Version history
Last update:
‎Mar 23 2019 03:56 PM
Updated by: