windows下安装hadoop
·
windows下安装hadoop
下载hadoop压缩包,并解压
winutils可以在此出下载:https://github.com/cdarlint/winutils
将对应版本的hadoop.dll和winutils.exe文件放入bin目录下
配置JAVA_HOME与HADOOP_HOME环境


core-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
mapred-site.xml
mapred-site.xml原先如果没有,就复制mapred-site.xml.template并改名
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>hdfs://localhost:9001</value>
</property>
</configuration>
hdfs-site.xml
<configuration>
<!-- 这个参数设置为1,因为是单机版hadoop -->
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.data.dir</name>
<value>/F:/hadoop-2.7.5/workplace/data</value>
</property>
<property>
<name>dfs.name.dir</name>
<value>/F:/hadoop-2.7.5/workplace/name</value>
</property>
</configuration>
yarn.site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
</configuration>
hadoop-env.cmd
配置JAVA_HOME地址
运行
hadoop namenode -format
在进入sbin目录下启动start-all.cmd
更多推荐
所有评论(0)