cdh5.14.2-安装文档

cdh5.14.2-安装⽂档
cdh5.14.2-安装⽂档
⼀、版本信息：
CM/CDH: 5.14.2-1
Linux: Centos7.4
⼆、准备原料，vmware虚拟机环境：
cm150 10.0.1.150
cdh151 10.0.1.151
cdh152 10.0.1.152
cdh153 10.0.1.153
三、软件列表
编号类别名称
01jdk jdk-6u31-linux-amd64.rpm
02jdk oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
03driver mysql-connector-java.jar
04database MySQL-5.7.21-SETUP.zip
05cm cloudera-manager-centos7-cm5.14.2_x86_64.tar.gz
06cdh CDH-5.14.2-1.cdh5.14.2.p0.3-el7.parcel
07cdh CDH-5.14.2-1.cdh5.14.2.p0.3-el7.parcel.sha
08cdh manifest.json
09rpm MySQL-python-1.2.5-1.el7.x86_64.rpm
10rpm mariadb-libs-5.5.56-2.el7.x86_64.rpm
如图：
四、更新系统，安装组件，重启系统(CM/CDH执⾏)：
yum install -y epel-release && yum install -y python-httplib2.noarch python-devel libxslt httpd mod_ssl unzip p7zip lsof telnet jemalloc jemalloc-devel bind-utils psmisc cyrus-sasl-plain cyrus-sasl-gssapi fuse portmap fuse-libs openssl-devel python-psycopg2 MySQL-python redhat-lsb-core.x86_64 && yum update -y && reboot
五、防⽕墙设置(CM/CDH执⾏)：
systemctl disable firewalld.service && systemctl stop firewalld.service
六、修改系统安全项(CM/CDH执⾏)：
1，替换⽂件内容
sed -i 's/ SELINUX=enforcing/ SELINUX=disabled/' /etc/selinux/config
2，执⾏命令1
setenforce 0
3,执⾏命令2
echo "10" > /proc/sys/vm/swappiness
echo "never" > /sys/kernel/mm/transparent_hugepage/defrag
echo "never" > /sys/kernel/mm/transparent_hugepage/enabled
七、配置主机名(CM/CDH执⾏)：
echo -e "10.0.1.150 cm150\n10.0.1.151 cdh151\n10.0.1.152 cdh152\n10.0.1.153 cdh153\n " >> /etc/hosts
⼋、配置SSH⽆密码访问(CM/CDH执⾏)：
ssh-keygen -t rsa
ssh-copy-id -i /root/.ssh/id_rsa.pub cm150
ssh-copy-id -i /root/.ssh/id_rsa.pub cdh151
ssh-copy-id -i /root/.ssh/id_rsa.pub cdh152
ssh-copy-id -i /root/.ssh/id_rsa.pub cdh153
九、创建⽤户(CM/CDH执⾏)：
useradd cloudera-scm -s /sbin/nologin
⼗、上传软件(CM执⾏)
过程略
⼗⼀、解压软件(CM执⾏)
tar xf cloudera-manager-centos7-cm5.14.2_x86_64.tar.gz
⼗⼆、移动⽂件(CM执⾏)
mv cloudera /opt/
mv cm-5.14.2/ /opt/
mv CDH-5.14.2-1.cdh5.14.2.p0.3-el7.parcel* /opt/cloudera/parcel-repo/
mv manifest.json /opt/cloudera/parcel-repo/
⼗三、修改配置⽂件(CM执⾏)：
sed -i 's/server_host=localhost/server_host=cm150/' /opt/cm-5.14.2/etc/cloudera-scm-agent/config.ini
⼗四、复制驱动⽂件(CM执⾏):
cp mysql-connector-java.jar /opt/cm-5.14.2/share/cmf/lib/
⼗五、创建⽂件夹(CM/CDH执⾏)：
mkdir -p /usr/share/java
⼗六、复制驱动⽂件(CM执⾏):
cp /root/mysql-connector-java.jar /usr/share/java/
⼗七、复制⽂件(CDH执⾏)
scp -r root@cm150:/opt/* /opt/
scp -r root@cm150:/root/*.rpm /root
scp root@cm150:/usr/share/java/mysql-connector-java.jar /usr/share/java
⼗⼋、安装JDK(CM/CDH执⾏)：
rpm -ivh *.rpm
⼗九、配置环境变量(CM/CDH执⾏)：
echo -e "export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera\nexport JAVA_BIN=/usr/java/jdk1.7.0_67-cloudera/bin\nexport PATH=$PATH:$JAVA_HOME/bin\nexport CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar\nexport JAVA_HOME JAVA_BIN PATH CLASSPATH" >> /etc/profile && source /etc/profile
⼆⼗、数据库安装(可安装在CM节点，也可单独安装)
安装过程略
⼆⼗⼀、创建数据库(数据库执⾏):
CREATE DATABASE IF NOT EXISTS hue DEFAULT CHARSET gbk COLLATE gbk_bin;
CREATE DATABASE IF NOT EXISTS oozie DEFAULT CHARSET gbk COLLATE gbk_bin;
CREATE DATABASE IF NOT EXISTS hive DEFAULT CHARSET gbk COLLATE gbk_bin;
CREATE DATABASE IF NOT EXISTS scm DEFAULT CHARSET gbk COLLATE gbk_bin;
⼆⼗⼆、⽤户授权(数据库执⾏):
grant all on *.* to 'cdhuser'@'%' identified by 'cdhpass';
flush privileges;
⼆⼗三、若数据库开启了GTID事务，那么需将其关闭(数据库执⾏):
如图：
重启数据库服务，service mysqld restart
⼆⼗四、初始化数据库(CM执⾏)：
/opt/cm-5.14.2/share/cmf/schema/scm_prepare_database.sh mysql scm -h cm6 cdhuser cdhpass --scm-host cm6 scm scm scm ⼆⼗五、启动CM服务(CM执⾏)：
/opt/cm-5.14.2/etc/init.d/cloudera-scm-server start
查看⽇志
tail -f /opt/cm-5.14.2/log/cloudera-scm-server/cloudera-scm-server.log
⼆⼗六、启动CM-Agent端（CDH执⾏）：
/opt/cm-5.14.2/etc/init.d/cloudera-scm-agent start
查看⽇志
tail -f /opt/cm-5.14.2/log/cloudera-scm-agent/cloudera-scm-agent.log。