hadoop集群安装

环境准备

  1. CentOS release 6.10
  2. hadoop2.8.0
  3. java-1.8.0-openjdk-devel-1.8.0.232.b09-1.el6_10.x86_64

节点部署图:

配置环境变量

/etc/profile

1
2
3
4
5
6
7
export HADOOP_HOME=/home/hadoop/hadoop-2.8.0
export PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin
export HADOOP_MAPRED_HOME=${HADOOP_HOME}
export HADOOP_HDFS_HOME=${HADOOP_HOME}
export YARN_HOME=${HADOOP_HOME}
export HADOOP_COMMON_LIB_NATIVE_DIR=${HADOOP_HOME}/lib/native
export HADOOP_OPTS="-Djava.library.path=${HADOOP_HOME}/lib:${HADOOP_HOME}/lib/native"

安装jdk

修改主机名,关闭防火墙

配置免密登陆

spark集群安装

hadoop分布式集群搭建