CentOSLinux系统中Ansible自动化运维的安装以及利用Ansible部署JDK和Hadoop

时间：2023-12-11 20:19:56

Ansible 安装和配置

Ansible 说明

安装

配置基本概念

Ansible 基本配置文件顺序

  • Ansible 执行的时候会按照以下顺序查找配置项，所以修改的时候要特别注意改的是哪个文件
ANSIBLE_CONFIG (环境变量)

ansible.cfg (脚本所在当前目录下)

~/.ansible.cfg (用户家目录下，默认没有)

/etc/ansible/ansible.cfg（安装后会自动生成）

配置远程主机地址 (Ansible 称这些地址为 Inventory)

给这三台机子设置免密登录的情况（一般推荐方式）
  • 编辑 Ansible 配置文件：vim /etc/ansible/hosts
  • 添加如下内容
[hadoop-host]

192.168.0.223

192.168.0.70

192.168.0.103
  • 其中 [hadoop-host] 表示这些主机代表的一个组名
如果不设置免密，直接采用账号密码（容易泄露信息）
  • 编辑 Ansible 配置文件：vim /etc/ansible/hosts
  • 添加如下内容
[hadoop-host]

hadoop-master ansible_host=192.168.0.223 ansible_user=root ansible_ssh_pass=123456

hadoop-node1  ansible_host=192.168.0.70 ansible_user=root ansible_ssh_pass=123456

hadoop-node2  ansible_host=192.168.0.103 ansible_user=root ansible_ssh_pass=123456

简单使用（ad hoc方式）

运行 Ansible
  • 运行 Ansible 的 ping 命令，看看配置正确时输出如下：
sudo ansible --private-key ~/.ssh/id_rsa all -m ping
  • 让远程所有主机都执行 ps 命令，输出如下
ansible all -a 'ps'
  • 让远程所有 hadoop-host 组的主机都执行 ps 命令，输出如下
ansible hadoop-host -a 'ps'

Playbook 脚本方式

简单脚本

  • 下面脚本让所有远程主机执行 whoami 命令，并把结果（当前用户名）输出到 /opt/whoami.txt 文件
  • 创建脚本文件：vim /opt/simple-playbook.yml 
- hosts: all

  tasks:

    - name: whoami

      shell: 'whoami > /opt/whoami.txt'
  • 执行命令：ansible-playbook /opt/simple-playbook.yml，结果如下，并且 opt 下也有文件生成
PLAY [all] **************************************************************************************************************************

TASK [Gathering Facts] **************************************************************************************************************

ok: [192.168.0.223]

ok: [192.168.0.103]

ok: [192.168.0.70]

TASK [whoami] ***********************************************************************************************************************

changed: [192.168.0.103]

changed: [192.168.0.223]

changed: [192.168.0.70]

PLAY RECAP **************************************************************************************************************************

192.168.0.103              : ok=2    changed=1    unreachable=0    failed=0

192.168.0.223              : ok=2    changed=1    unreachable=0    failed=0

192.168.0.70               : ok=2    changed=1    unreachable=0    failed=0

平时用来测试

  • 创建脚本文件：vim /opt/test-playbook.yml 
- hosts: hadoop-test

  remote_user: root

  vars:

    java_install_folder: /usr/local

  tasks:

    # 按行的方式写入

    - name: Set JAVA_HOME 1

      lineinfile:

        dest=/etc/profile

        line="JAVA_HOME={{ java_install_folder }}/jdk1.8.0_181"

    # 按块的方式写入，#{mark} 会被自动替换成：begin 和 end 字符来包裹整块内容（我这里自己定义了词语）

    - name: Set JAVA_HOME 2

      blockinfile:

        path: /etc/profile

        marker: "#{mark} JDK ENV"

        marker_begin: "开始"

        marker_end: "结束"

        block: |

          export JAVA_HOME={{ java_install_folder }}/jdk1.8.0_181

          export PATH=$PATH:$JAVA_HOME/bin
  • 执行命令：ansible-playbook /opt/test-playbook.yml

更多 playbook 实战

禁用防火墙（CentOS 7.x）

  • 创建脚本文件：vim /opt/disable-firewalld-playbook.yml 
- hosts: all

  remote_user: root

  tasks:

    - name: Disable SELinux at next reboot

      selinux:

        state: disabled

    - name: disable firewalld

      command: "{{ item }}"

      with_items:

         - systemctl stop firewalld

         - systemctl disable firewalld

         - setenforce 0

基础环境（CentOS 7.x）

  • 创建脚本文件：vim /opt/install-basic-playbook.yml 
- hosts: all

  remote_user: root

  tasks:

    - name: Disable SELinux at next reboot

      selinux:

        state: disabled

    - name: disable firewalld

      command: "{{ item }}"

      with_items:

         - systemctl stop firewalld

         - systemctl disable firewalld

         - setenforce 0

    - name: install-basic

      command: "{{ item }}"

      with_items:

         - yum install -y zip unzip lrzsz git epel-release wget htop deltarpm

    - name: install-vim

      shell: "{{ item }}"

      with_items:

         - yum install -y vim

         - curl https://raw.githubusercontent.com/wklken/vim-for-server/master/vimrc > ~/.vimrc

    - name: install-docker

      shell: "{{ item }}"

      with_items:

         - yum install -y yum-utils device-mapper-persistent-data lvm2

         - yum-config-manager --add-repo https://download.docker.com/linux/centos/docker-ce.repo

         - yum makecache fast

         - yum install -y docker-ce

         - systemctl start docker.service

         - docker run hello-world

    - name: install-docker-compose

      shell: "{{ item }}"

      with_items:

         - curl -L https://github.com/docker/compose/releases/download/1.18.0/docker-compose-`uname -s`-`uname -m` -o /usr/local/bin/docker-compose

         - chmod +x /usr/local/bin/docker-compose

         - docker-compose --version

         - systemctl restart docker.service

         - systemctl enable docker.service
  • 执行命令：ansible-playbook /opt/install-basic-playbook.yml

修改 hosts

  • 创建脚本文件：vim /opt/hosts-playbook.yml 
- hosts: all

  remote_user: root

  tasks:

    - name: update hosts

      blockinfile:

        path: /etc/hosts

        block: |

          192.168.0.223     linux01

          192.168.0.223     linux02

          192.168.0.223     linux03

          192.168.0.223     linux04

          192.168.0.223     linux05
  • 执行命令：ansible-playbook /opt/hosts-playbook.yml

部署 JDK

  • 创建脚本文件：vim /opt/jdk8-playbook.yml 
- hosts: hadoop-host

  remote_user: root

  vars:

    java_install_folder: /usr/local

  tasks:

    - name: copy jdk

      copy: src=/opt/jdk-8u181-linux-x64.tar.gz dest={{ java_install_folder }}

    - name: tar jdk

      shell: chdir={{ java_install_folder }} tar zxf jdk-8u181-linux-x64.tar.gz

    - name: set JAVA_HOME

      blockinfile:

        path: /etc/profile

        marker: "#{mark} JDK ENV"

        block: |

          JAVA_HOME={{ java_install_folder }}/jdk1.8.0_181

          JRE_HOME=$JAVA_HOME/jre

          PATH=$PATH:$JAVA_HOME/bin

          CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

          export JAVA_HOME

          export JRE_HOME

          export PATH

          export CLASSPATH

    - name: source profile

      shell: source /etc/profile
  • 执行命令：ansible-playbook /opt/jdk8-playbook.yml

部署 Hadoop 集群

  • 创建脚本文件：vim /opt/hadoop-playbook.yml
  • 刚学 Ansible，不好动配置文件，所以就只保留环境部分的设置，其他部分自行手工~
- hosts: hadoop-host

  remote_user: root

  tasks:

    - name: Creates directory

      file:

        path: /data/hadoop/hdfs/name

        state: directory

    - name: Creates directory

      file:

        path: /data/hadoop/hdfs/data

        state: directory

    - name: Creates directory

      file:

        path: /data/hadoop/hdfs/tmp

        state: directory

    - name: set HADOOP_HOME

      blockinfile:

        path: /etc/profile

        marker: "#{mark} HADOOP ENV"

        block: |

          HADOOP_HOME=/usr/local/hadoop

          PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin

          export HADOOP_HOME

          export PATH

    - name: source profile

      shell: source /etc/profile
  • 执行命令：ansible-playbook /opt/hadoop-playbook.yml

相关文章