Ubuntu12.04 Hadoop2.7.3伪分布式配置

时间:2022-08-31 08:54:52

下载地址:http://mirror.bit.edu.cn/apache/hadoop/common/

HDFS的配置

1. etc/hadoop/core-site.xml

<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://localhost:9000</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/software/hadoop-2.7.3/data</value>
</property>
</configuration>

2.etc/hadoop/hdfs-site.xml:

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>

MapReduce的配置

1.etc/hadoop/mapred-site.xml

<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>

2. etc/hadoop/yarn-site.xml

<configuration>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
</property>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>

关闭从节点上的namenode

$sbin/hadoop-daemon.sh stop datanode