Forum Discussion
Hadoop on Azure labs
Hello- I'm working on installing Hadoop on the Azure lab environment. I have followed these steps:https://kontext.tech/column/hadoop/377/latest-hadoop-321-installation-on-windows-10-step-by-step-gui...
nicolehaugen I got it to work! If any schools need to install Hadoop on the Azure lab environment and are having trouble, I wrote down my steps and would be glad to help. It's a pain but it is working now!
Hi gina_cooper, any advise would be appreciated on how you resolved this issue, thanks.
nicolehaugenMicrosoft
Hi-
I haven't had a chance to validate these steps myself, but here are steps that were previously shared with me by gina_cooper that may be helpful here:
-anaconda
-chrome
-java
-7zip
-visual c++ redistributable 2008, 2010
-mongodb
-mysql
-hadoop following: https://www.datasciencecentral.com/profiles/blogs/how-to-install-and-run-hadoop-on-windows-for-beginners and https://towardsdatascience.com/installing-hadoop-3-2-1-single-node-cluster-on-windows-10-ac258dd48aef
-set JAVA_HOME and HADOOP_HOME in environment variables. JAVA_HOME should go to the jdk and HADOOP_HOME to Hadoop directory (not bin)
-set path environment variable to %JAVA_HOME%\bin and %HADOOP_HOME%\bin
-Create data/namenode and data/datanode and then change the 4 xml files per the second link using the full directory path to namenode and datanode.
-run powershell command as administrator: hdfs namenode –format
-if you get an error replace the .jar file: Download hadoop-hdfs-3.2.1.jar file from the following link: https://github.com/FahaoTang/big-data/blob/master/hadoop-hdfs-3.2.1.jar
-In powershell then type in %HADOOP_HOME%\sbin\start-dfs.cmd and it works!
Please let us know if this helps.
Thanks,
Nicole