Elastic Stack之ElasticSearch分布式集群二进制方式部署
作者：尹正杰
版权声明：原创作品，谢绝转载！否则将追究法律责任。
想必大家都知道ELK其实就是Elasticsearch+Logstash+Kibanna。其中的Logstash由于收集日志很占用资源，官方引入了一个新的组建叫做Beats。它以后可能会渠道Logstash，因为Beats是比Logstash更轻量级的日志收集工具。于此同时，该公司还引入了X-pack插件（需要单独安装），可以在安全审计，权限控制，机器学习，实时监控，数据导出（用于离线分享，支持PDF，CSV等格式）以及图形分析等功能。当然，如果可以的话，你可以使用Elastic Cloud公有云的或者自建Elastic Cloud Enterpriose私有云版本。因此ELK是一个比较古老的名字，该公司将ELK更名为“Elastic Stack”。
一.官方网址介绍
1>.Elasticsearch官方地址（https://www.elastic.co/cn/）
2>.下载Elstic公司的相关产品（https://www.elastic.co/cn/downloads）
二.下载相应的软件
1>.下载Elasticsearch（下载地址：https://www.elastic.co/downloads/elasticsearch）
2>.下载Kibana（下载地址：https://www.elastic.co/downloads/kibana）
3>.下载X-Pack软件
默认情况下，安装Elasticsearch时会安装X-Pack。官方介绍了通过命令行安装X-Pack插件，地址链接：https://www.elastic.co/downloads/x-pack。
我们从上图可以看出，X-Pack的版本是6.2.4版本对吧，如果你非要拿到X-pack这个软件包的话，官方也提供了相应的链接地址：https://www.elastic.co/guide/en/elasticsearch/reference/6.2/installing-xpack-es.html。如下图所示：
三.安装ElasticSearch
1>.安装JDK
我们知道ES是使用java语言编写的，因此我们需要安装对应的jdk。推荐安装jdk1.8及以上版本（1.7版本官方以及不支持维护了，推荐使用openjdk，官方版本的jdk是收费的！）安装步骤可以参考我之前部署jdk版本的方式：https://www.cnblogs.com/yinzhengjie/p/10226567.html。
[root@node101 bin]# -openjdk.x86_64 Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.tuna.tsinghua.edu.cn * extras: mirrors.tuna.tsinghua.edu.cn * updates: mirrors.tuna.tsinghua.edu.cn Resolving Dependencies --> Running transaction check ---> Package java--openjdk.x86_64 :.el7_6 will be installed --> Processing Dependency: java--openjdk-headless(x86-) = :.el7_6 :java--openjdk-.el7_6.x86_64 --> Processing Dependency: xorg-x11-fonts-Type1 :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libpng15.so.(PNG15_0)(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjvm.so(SUNWprivate_1.)(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjpeg.so.(LIBJPEG_6.)(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjava.so(SUNWprivate_1.)(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: fontconfig(x86-) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libpng15.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjvm.so()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjpeg.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libjava.so()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libgif.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libXtst.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libXrender.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libXi.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libXext.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libXcomposite.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Processing Dependency: libX11.so.()(64bit) :java--openjdk-.el7_6.x86_64 --> Running transaction check ---> Package fontconfig.x86_64 :-4.3.el7 will be installed --> Processing Dependency: freetype >= -4.3.el7.x86_64 --> Processing Dependency: fontpackages-filesystem -4.3.el7.x86_64 --> Processing Dependency: dejavu-sans-fonts -4.3.el7.x86_64 ---> Package giflib.x86_64 :-.el7 will be installed --> Processing Dependency: libSM.so.()(64bit) -.el7.x86_64 --> Processing Dependency: libICE.so.()(64bit) -.el7.x86_64 ---> Package java--openjdk-headless.x86_64 :.el7_6 will be installed --> Processing Dependency: tzdata-java >= 2015d :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: nss-softokn(x86-) >= :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: nss(x86-) >= :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: copy-jdk-configs >= :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: chkconfig >= :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: chkconfig >= :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: lksctp-tools(x86-) :java--openjdk-headless-.el7_6.x86_64 --> Processing Dependency: jpackage-utils :java--openjdk-headless-.el7_6.x86_64 ---> Package libX11.x86_64 :-.el7 will be installed --> Processing Dependency: libX11-common >= -.el7 -.el7.x86_64 --> Processing Dependency: libxcb.so.()(64bit) -.el7.x86_64 ---> Package libXcomposite.x86_64 :-4.1.el7 will be installed ---> Package libXext.x86_64 :-.el7 will be installed ---> Package libXi.x86_64 :-.el7 will be installed ---> Package libXrender.x86_64 :-.el7 will be installed ---> Package libXtst.x86_64 :-.el7 will be installed ---> Package libjpeg-turbo.x86_64 :-.el7 will be installed ---> Package libpng.x86_64 :-.el7_2 will be installed ---> Package xorg-x11-fonts-Type1.noarch :.el7 will be installed --> Processing Dependency: ttmkfdir .el7.noarch --> Processing Dependency: ttmkfdir .el7.noarch --> Processing Dependency: mkfontdir .el7.noarch --> Processing Dependency: mkfontdir .el7.noarch --> Running transaction check ---> Package chkconfig.x86_64 :-.el7 will be updated ---> Package chkconfig.x86_64 :-.el7 will be an update ---> Package copy-jdk-configs.noarch :.el7_5 will be installed ---> Package dejavu-sans-fonts.noarch :.el7 will be installed --> Processing Dependency: dejavu-fonts-common = .el7 .el7.noarch ---> Package fontpackages-filesystem.noarch :.el7 will be installed ---> Package freetype.x86_64 :-.el7 will be updated ---> Package freetype.x86_64 :.el7 will be an update ---> Package javapackages-tools.noarch :-.el7 will be installed --> Processing Dependency: python-javapackages = -.el7 -.el7.noarch --> Processing Dependency: libxslt -.el7.noarch ---> Package libICE.x86_64 :-.el7 will be installed ---> Package libSM.x86_64 :-.el7 will be installed ---> Package libX11-common.noarch :-.el7 will be installed ---> Package libxcb.x86_64 :.el7 will be installed --> Processing Dependency: libXau.so.()(64bit) .el7.x86_64 ---> Package lksctp-tools.x86_64 :-.el7 will be installed ---> Package nss.x86_64 :-.el7 will be updated --> Processing Dependency: nss = -.el7 -.el7.x86_64 --> Processing Dependency: nss(x86-) = -.el7 -.el7.x86_64 ---> Package nss.x86_64 :-.el7_5 will be an update --> Processing Dependency: nss-util >= - -.el7_5.x86_64 --> Processing Dependency: nspr >= -.el7_5.x86_64 --> Processing Dependency: nss-pem(x86-) -.el7_5.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.)(64bit) -.el7_5.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.)(64bit) -.el7_5.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.)(64bit) -.el7_5.x86_64 ---> Package nss-softokn.x86_64 :.el7_1 will be updated ---> Package nss-softokn.x86_64 :-.el7_5 will be an update --> Processing Dependency: nss-softokn-freebl(x86-) >= -.el7_5 -.el7_5.x86_64 ---> Package ttmkfdir.x86_64 :-.el7 will be installed ---> Package tzdata-java.noarch :2018i-.el7 will be installed ---> Package xorg-x11-font-utils.x86_64 :.el7 will be installed --> Processing Dependency: libfontenc.so.()(64bit) :xorg-x11-font-utils-.el7.x86_64 --> Running transaction check ---> Package dejavu-fonts-common.noarch :.el7 will be installed ---> Package libXau.x86_64 :-2.1.el7 will be installed ---> Package libfontenc.x86_64 :-.el7 will be installed ---> Package libxslt.x86_64 :-.el7 will be installed ---> Package nspr.x86_64 :-.el7_1 will be updated ---> Package nspr.x86_64 :-.el7_5 will be an update ---> Package nss-pem.x86_64 :-.el7 will be installed ---> Package nss-softokn-freebl.x86_64 :.el7_1 will be updated ---> Package nss-softokn-freebl.x86_64 :-.el7_5 will be an update ---> Package nss-sysinit.x86_64 :-.el7 will be updated ---> Package nss-sysinit.x86_64 :-.el7_5 will be an update ---> Package nss-tools.x86_64 :-.el7 will be updated ---> Package nss-tools.x86_64 :-.el7_5 will be an update ---> Package nss-util.x86_64 :-.el7_1 will be updated ---> Package nss-util.x86_64 :-.el7_5 will be an update ---> Package python-javapackages.noarch :-.el7 will be installed --> Processing Dependency: python-lxml -.el7.noarch --> Running transaction check ---> Package python-lxml.x86_64 :-.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved ============================================================================================================================================================================= Package Arch Version Repository Size ============================================================================================================================================================================= Installing: java--openjdk x86_64 :.el7_6 updates k Installing for dependencies: copy-jdk-configs noarch .el7_5 base k dejavu-fonts-common noarch .el7 base k dejavu-sans-fonts noarch .el7 base 1.4 M fontconfig x86_64 - k fontpackages-filesystem noarch .el7 base 9.9 k giflib x86_64 -.el7 base k java--openjdk-headless x86_64 :.el7_6 updates M javapackages-tools noarch -.el7 base k libICE x86_64 -.el7 base k libSM x86_64 -.el7 base k libX11 x86_64 -.el7 base k libX11-common noarch -.el7 base k libXau x86_64 - k libXcomposite x86_64 - k libXext x86_64 -.el7 base k libXi x86_64 -.el7 base k libXrender x86_64 -.el7 base k libXtst x86_64 -.el7 base k libfontenc x86_64 -.el7 base k libjpeg-turbo x86_64 -.el7 base k libpng x86_64 :-.el7_2 base k libxcb x86_64 .el7 base k libxslt x86_64 -.el7 base k lksctp-tools x86_64 -.el7 base k nss-pem x86_64 -.el7 base k python-javapackages noarch -.el7 base k python-lxml x86_64 -.el7 base k ttmkfdir x86_64 -.el7 base k tzdata-java noarch 2018i-.el7 updates k xorg-x11-font-utils x86_64 :.el7 base k xorg-x11-fonts-Type1 noarch .el7 base k Updating for dependencies: chkconfig x86_64 -.el7 base k freetype x86_64 .el7 base k nspr x86_64 -.el7_5 base k nss x86_64 -.el7_5 base k nss-softokn x86_64 -.el7_5 base k nss-softokn-freebl x86_64 -.el7_5 base k nss-sysinit x86_64 -.el7_5 base k nss-tools x86_64 -.el7_5 base k nss-util x86_64 -.el7_5 base k Transaction Summary ============================================================================================================================================================================= Install Package (+ Dependent packages) Upgrade ( Dependent packages) Total download size: M Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. (/): dejavu-fonts-common-.el7.noarch.rpm | kB :: (/): fontpackages-filesystem-.el7.noarch.rpm | :: (/): copy-jdk-configs-.el7_5.noarch.rpm | kB :: (/): freetype-.el7.x86_64.rpm | kB :: (/): java--openjdk-.el7_6.x86_64.rpm | kB :: (/): chkconfig--.el7.x86_64.rpm | kB :: (/): giflib--.el7.x86_64.rpm | kB :: (/): javapackages-tools--.el7.noarch.rpm | kB :: (/): libSM--.el7.x86_64.rpm | kB :: (/): libX11--.el7.x86_64.rpm | kB :: (/): dejavu-sans-fonts-.el7.noarch.rpm | :: (/): libX11-common--.el7.noarch.rpm | kB :: (/): libXau-- kB :: (/): fontconfig-- kB :: (/): libXi--.el7.x86_64.rpm | kB :: (/): libXcomposite-- kB :: (/): libXtst--.el7.x86_64.rpm | kB :: (/): libXrender--.el7.x86_64.rpm | kB :: (/): libICE--.el7.x86_64.rpm | kB :: (/): libpng--.el7_2.x86_64.rpm | kB :: (/): libfontenc--.el7.x86_64.rpm | kB :: (/): libxcb-.el7.x86_64.rpm | kB :: (/): libjpeg-turbo--.el7.x86_64.rpm | kB :: (/): lksctp-tools--.el7.x86_64.rpm | kB :: (/): nspr--.el7_5.x86_64.rpm | kB :: (/): libxslt--.el7.x86_64.rpm | kB :: (/): nss--.el7_5.x86_64.rpm | kB :: (/): nss-softokn-freebl--.el7_5.x86_64.rpm | kB :: (/): nss-sysinit--.el7_5.x86_64.rpm | kB :: (/): nss-pem--.el7.x86_64.rpm | kB :: (/): libXext--.el7.x86_64.rpm | kB :: (/): python-javapackages--.el7.noarch.rpm | kB :: (/): nss-tools--.el7_5.x86_64.rpm | kB :: (/): nss-softokn--.el7_5.x86_64.rpm | kB :: (/): ttmkfdir--.el7.x86_64.rpm | kB :: (/): tzdata-java-2018i-.el7.noarch.rpm | kB :: (/): xorg-x11-font-utils-.el7.x86_64.rpm | kB :: (/): nss-util--.el7_5.x86_64.rpm | kB :: (/): python-lxml--.el7.x86_64.rpm | kB :: (/): xorg-x11-fonts-Type1-.el7.noarch.rpm | kB :: (/): java--openjdk-headless-.el7_6.x86_64.rpm | MB :: ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total MB :: Running transaction check Running transaction test Transaction test succeeded Running transaction Updating : nspr--.el7_5.x86_64 / Updating : nss-util--.el7_5.x86_64 / Updating : chkconfig--.el7.x86_64 / Installing : libxslt--.el7.x86_64 / Installing : libjpeg-turbo--.el7.x86_64 / Installing : fontpackages-filesystem-.el7.noarch / Installing : libICE--.el7.x86_64 / Installing : :libpng--.el7_2.x86_64 / Updating : freetype-.el7.x86_64 / Installing : ttmkfdir--.el7.x86_64 / Installing : libSM--.el7.x86_64 / Installing : dejavu-fonts-common-.el7.noarch / Installing : dejavu-sans-fonts-.el7.noarch / Installing : fontconfig--/ Installing : python-lxml--.el7.x86_64 / Installing : python-javapackages--.el7.noarch / Installing : javapackages-tools--.el7.noarch / Updating : nss-softokn-freebl--.el7_5.x86_64 / Updating : nss-softokn--.el7_5.x86_64 / Installing : nss-pem--.el7.x86_64 / Updating : nss-sysinit--.el7_5.x86_64 / Updating : nss--.el7_5.x86_64 / Installing : libfontenc--.el7.x86_64 / Installing : :xorg-x11-font-utils-.el7.x86_64 / Installing : xorg-x11-fonts-Type1-.el7.noarch / Installing : libX11-common--.el7.noarch / Installing : libXau--/ Installing : libxcb-.el7.x86_64 / Installing : libX11--.el7.x86_64 / Installing : libXext--.el7.x86_64 / Installing : libXi--.el7.x86_64 / Installing : libXtst--.el7.x86_64 / Installing : giflib--.el7.x86_64 / Installing : libXrender--.el7.x86_64 / Installing : libXcomposite--/ Installing : lksctp-tools--.el7.x86_64 / Installing : copy-jdk-configs-.el7_5.noarch / Installing : tzdata-java-2018i-.el7.noarch / Installing : :java--openjdk-headless-.el7_6.x86_64 / Installing : :java--openjdk-.el7_6.x86_64 / Updating : nss-tools--.el7_5.x86_64 / Cleanup : nss-tools--.el7.x86_64 / Cleanup : nss-sysinit--.el7.x86_64 / Cleanup : nss--.el7.x86_64 / Cleanup : nss-softokn-.el7_1.x86_64 / Cleanup : nss-util--.el7_1.x86_64 / Cleanup : nspr--.el7_1.x86_64 / Cleanup : nss-softokn-freebl-.el7_1.x86_64 / Cleanup : chkconfig--.el7.x86_64 / Cleanup : freetype--.el7.x86_64 / Verifying : libXext--.el7.x86_64 / Verifying : libXi--.el7.x86_64 / Verifying : fontconfig--/ Verifying : :libpng--.el7_2.x86_64 / Verifying : giflib--.el7.x86_64 / Verifying : libXrender--.el7.x86_64 / Verifying : python-lxml--.el7.x86_64 / Verifying : tzdata-java-2018i-.el7.noarch / Verifying : libICE--.el7.x86_64 / Verifying : nss--.el7_5.x86_64 / Verifying : fontpackages-filesystem-.el7.noarch / Verifying : ttmkfdir--.el7.x86_64 / Verifying : freetype-.el7.x86_64 / Verifying : nss-util--.el7_5.x86_64 / Verifying : copy-jdk-configs-.el7_5.noarch / Verifying : python-javapackages--.el7.noarch / Verifying : nss-pem--.el7.x86_64 / Verifying : dejavu-fonts-common-.el7.noarch / Verifying : libXcomposite--/ Verifying : libXtst--.el7.x86_64 / Verifying : libxcb-.el7.x86_64 / Verifying : libjpeg-turbo--.el7.x86_64 / Verifying : lksctp-tools--.el7.x86_64 / Verifying : xorg-x11-fonts-Type1-.el7.noarch / Verifying : libxslt--.el7.x86_64 / Verifying : libX11--.el7.x86_64 / Verifying : :java--openjdk-.el7_6.x86_64 / Verifying : dejavu-sans-fonts-.el7.noarch / Verifying : nss-tools--.el7_5.x86_64 / Verifying : javapackages-tools--.el7.noarch / Verifying : :java--openjdk-headless-.el7_6.x86_64 / Verifying : nss-sysinit--.el7_5.x86_64 / Verifying : libXau--/ Verifying : nss-softokn-freebl--.el7_5.x86_64 / Verifying : libSM--.el7.x86_64 / Verifying : nspr--.el7_5.x86_64 / Verifying : libX11-common--.el7.noarch / Verifying : :xorg-x11-font-utils-.el7.x86_64 / Verifying : chkconfig--.el7.x86_64 / Verifying : libfontenc--.el7.x86_64 / Verifying : nss-softokn--.el7_5.x86_64 / Verifying : freetype--.el7.x86_64 / Verifying : nss-tools--.el7.x86_64 / Verifying : nss-softokn-.el7_1.x86_64 / Verifying : nss--.el7.x86_64 / Verifying : nss-sysinit--.el7.x86_64 / Verifying : chkconfig--.el7.x86_64 / Verifying : nss-softokn-freebl-.el7_1.x86_64 / Verifying : nspr--.el7_1.x86_64 / Verifying : nss-util--.el7_1.x86_64 / Installed: java--openjdk.x86_64 :.el7_6 Dependency Installed: copy-jdk-configs.noarch :.el7_5 dejavu-fonts-common.noarch :.el7 dejavu-sans-fonts.noarch :.el7 fontconfig.x86_64 :-:.el7 giflib.x86_64 :-.el7 java--openjdk-headless.x86_64 :.el7_6 javapackages-tools.noarch :-.el7 libICE.x86_64 :-.el7 libSM.x86_64 :-.el7 libX11.x86_64 :-.el7 libX11-common.noarch :-.el7 libXau.x86_64 :-:-:-.el7 libXi.x86_64 :-.el7 libXrender.x86_64 :-.el7 libXtst.x86_64 :-.el7 libfontenc.x86_64 :-.el7 libjpeg-turbo.x86_64 :-.el7 libpng.x86_64 :-.el7_2 libxcb.x86_64 :.el7 libxslt.x86_64 :-.el7 lksctp-tools.x86_64 :-.el7 nss-pem.x86_64 :-.el7 python-javapackages.noarch :-.el7 python-lxml.x86_64 :-.el7 ttmkfdir.x86_64 :-.el7 tzdata-java.noarch :2018i-.el7 xorg-x11-font-utils.x86_64 :.el7 xorg-x11-fonts-Type1.noarch :.el7 Dependency Updated: chkconfig.x86_64 :-.el7 freetype.x86_64 :.el7 nspr.x86_64 :-.el7_5 nss.x86_64 :-.el7_5 nss-softokn.x86_64 :-.el7_5 nss-softokn-freebl.x86_64 :-.el7_5 nss-sysinit.x86_64 :-.el7_5 nss-tools.x86_64 :-.el7_5 nss-util.x86_64 :-.el7_5 Complete! [root@node101 bin]#
安装JRE环境（[root@node101 bin]# yum -y install java-1.8.0-openjdk.x86_64）
[root@node101 bin]# -openjdk-devel.x86_64 Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.tuna.tsinghua.edu.cn * extras: mirrors.tuna.tsinghua.edu.cn * updates: mirrors.tuna.tsinghua.edu.cn Resolving Dependencies --> Running transaction check ---> Package java--openjdk-devel.x86_64 :.el7_6 will be installed --> Finished Dependency Resolution Dependencies Resolved ============================================================================================================================================================================= Package Arch Version Repository Size ============================================================================================================================================================================= Installing: java--openjdk-devel x86_64 :.el7_6 updates 9.8 M Transaction Summary ============================================================================================================================================================================= Install Package Total download size: 9.8 M Installed size: M Downloading packages: java--openjdk-devel-.el7_6.x86_64.rpm | :: Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : :java--openjdk-devel-.el7_6.x86_64 / Verifying : :java--openjdk-devel-.el7_6.x86_64 / Installed: java--openjdk-devel.x86_64 :.el7_6 Complete! [root@node101 bin]#
安装devel开发环境（[root@node101 bin]# yum -y install java-1.8.0-openjdk-devel.x86_64 ）
2>.创建下载目录和存放软件的目录
[root@node101 ~]# mkdir -pv /yinzhengjie/download #用于存放下载文件的目录 mkdir: created directory ‘/yinzhengjie’ mkdir: created directory ‘/yinzhengjie/download’ [root@node101 ~]# [root@node101 ~]# mkdir -pv /yinzhengjie/softwares #用于安装软件的目录 mkdir: created directory ‘/yinzhengjie/softwares’ [root@node101 ~]# [root@node101 ~]#
2>.下载ElasticSearch软件
[root@node101 ~]# cd /yinzhengjie/download/ [root@node101 download]# [root@node101 download]# wget https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.5.4.tar.gz [root@node101 download]# [root@node101 download]# ll -h total 109M -rw-r--r--. root root 109M Jan : elasticsearch-.tar.gz [root@node101 download]#
3>.解压tar包到制定存放软件到路径（目录结构说明）
[root@node101 download]# .tar.gz -C /yinzhengjie/softwares/ [root@node101 download]# [root@node101 download]# ll /yinzhengjie/softwares/elasticsearch-/ total drwxr-xr-x. root root Jan : bin drwxr-xr-x. root root Dec : config #存放ES配置文件，包括JVM参数配置也放在这里，大家可以使用ls名称查看，根据文件名称估计大家也明白了的十之八九了。 drwxr-xr-x. root root Dec : lib #这里是存放依赖库文件，基本上都是一些jar包 -rw-r--r--. root root Dec : LICENSE.txt drwxr-xr-x. root root Dec : logs #存放日志的目录 drwxr-xr-x. root root Dec : modules #ES的一些核心功能都是以模块的形式存放 -rw-r--r--. root root Dec : NOTICE.txt drwxr-xr-x. root root Dec : plugins #这里是存放ES第三方的一些插件信息 -rw-r--r--. root root Dec : README.textile [root@node101 download]# [root@node101 download]#
4>.修改ES到配置文件（下面的配置基本我使用的是主机名，因此我们需要提前在“/etc/hosts”作相应的解析操作）
[root@node101 ~]# /config/elasticsearch.yml /yinzhengjie/softwares/elasticsearch-/config/elasticsearch.yml.`date +%F ` [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml #cluster.name: my-application [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml cluster.name: yinzhengjie-elasticsearch [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml #node.name: node- [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml node.name: node101.yinzhengjie.org.cn [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml #network.host: 192.168.0.1 [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml [root@node101 ~]# [root@node101 ~]# /config/elasticsearch.yml network.host: node101.yinzhengjie.org.cn [root@node101 ~]# [root@node101 ~]#
以上修改，只是单机部署所需要修改上面配置的参数即可，如果有集群的话，应该还需要修改一个参数，具体修改内容如下：
[root@node101 ~]# /config/elasticsearch.yml | egrep -v "^#|^$" cluster.name: yinzhengjie-elasticsearch #自定义当前节点所属集群的名称。 node.name: node101.yinzhengjie.org.cn #自定义节点的名称。 path.data: /yinzhengjie/softwares/elasticsearch-/data #自定义存放数据的目录。 path.logs: /yinzhengjie/softwares/elasticsearch-/logs #自定义存放日志的目录。 network.host: node101.yinzhengjie.org.cn #服务启动时绑定的IP地址，默认是loacalhost。 discovery.zen.ping.unicast.hosts: ["node101.yinzhengjie.org.cn:9300", "node102.yinzhengjie.org.cn:9300","node103.yinzhengjie.org.cn:9300"] #这里是集群的各个节点的IP地址，一定别忘记把端口加上哟！因为不加端口，可能有各别节点检测不到到情况！ [root@node101 ~]#
5>.启动ES
[root@node101 download]# sysctl -q vm.max_map_count #调大虚拟内存映射 vm.max_map_count = [root@node101 download]# [root@node101 download]# ulimit -u #调大用户可以开启的最大进程数量 [root@node101 download]# [root@node101 download]# id yinzhengjie #你可以使用useradd命令创建出来一个普通用户 uid=(yinzhengjie) gid=(yinzhengjie) (yinzhengjie),(wheel) [root@node101 download]# [root@node101 download]# / #将ES整个目录授权给一个普通用户 [root@node101 download]# [root@node101 download]# cd /yinzhengjie/softwares/elasticsearch-/bin/ #进入到ES到脚本目录 [root@node101 bin]# [root@node101 bin]# su yinzhengjie #切换到普通用户，因为ES默认是不支持以root身份运行哟！ [yinzhengjie@node101 bin]$ [yinzhengjie@node101 bin]$ ./elasticsearch #启动ES
上面的启动方式是没有配置环境变量，我们可以将ES的bin路径加入到系统到PATH中，这样我们在任意一个位置都可以执行ES的相关命令啦～
[root@node101 bin]# echo "#Add by yinzhengjie" >> /etc/profile [root@node101 bin]# [root@node101 bin]# echo "export PATH=$PATH:/yinzhengjie/softwares/elasticsearch-6.5.4/bin" >> /etc/profile [root@node101 bin]# [root@node101 bin]# /etc/profile #Add by yinzhengjie export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/yinzhengjie/softwares/elasticsearch-/bin [root@node101 bin]# [root@node101 bin]# source /etc/profile #一般情况下，我不建议大家将环境变量配置在“~/.bash_profile”中，将环境变量定义在全局生效，目的就是为了切换用户时，我们配置的环境变量依旧有效！ [root@node101 bin]# [root@node101 ~]# su yinzhengjie [yinzhengjie@node101 root]$
[yinzhengjie@node101 root]$ elasticsearch &
[]
[yinzhengjie@node101 root]$
[yinzhengjie@node101 root]$ [--22T04::,][INFO ][o.e.e.NodeEnvironment ] [node105.yinzhengjie.org.cn] using [] data paths, mounts [[/ (rootfs)]], net usable_space [.5gb], net total_space [49gb], types [rootfs]
[--22T04::,][INFO ][o.e.e.NodeEnvironment ] [node105.yinzhengjie.org.cn] heap size [.3mb], compressed ordinary object pointers [true]
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] node name [node105.yinzhengjie.org.cn], node ID [5Xyf16x8SNaMa_29D7452Q]
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] version[], pid[], build[default/--17T21::.758843Z], OS[Linux/-.el7.x86_64/amd64], JVM[Oracle Corporation/OpenJDK -Bit Server VM/1.8.0_191/25.191-b12]
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=, -Djna.nosys=, -Dlog4j.shutdownHookEnabled=, -XX:GCLogFileSize=64m, -Des.path.home=/yinzhengjie/softwares/elasticsearch-, -Des.path.conf=/yinzhengjie/softwares/elasticsearch-/config, -Des.distribution.flavor=default, -Des.distribution.type=tar]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [aggs-matrix-stats]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [analysis-common]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [ingest-common]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [lang-expression]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [lang-mustache]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [lang-painless]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [mapper-extras]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [parent-join]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [percolator]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [rank-eval]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [reindex]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [repository-url]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [transport-netty4]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [tribe]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-ccr]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-core]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-deprecation]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-graph]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-logstash]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-ml]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-monitoring]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-rollup]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-security]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-sql]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-upgrade]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] loaded module [x-pack-watcher]
[--22T04::,][INFO ][o.e.p.PluginsService ] [node105.yinzhengjie.org.cn] no plugins loaded
[--22T04::,][INFO ][o.e.x.s.a.s.FileRolesStore] [node105.yinzhengjie.org.cn] parsed [] roles from /config/roles.yml]
[--22T04::,][INFO ][o.e.x.m.j.p.l.CppLogMessageHandler] [node105.yinzhengjie.org.cn] [controller/] [Main.] controller ( bit): Version (Build b616085ef32393) Copyright (c) Elasticsearch BV
[--22T04::,][DEBUG][o.e.a.ActionModule ] [node105.yinzhengjie.org.cn] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
[--22T04::,][INFO ][o.e.d.DiscoveryModule ] [node105.yinzhengjie.org.cn] using discovery type [zen] and host providers [settings]
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] initialized
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] starting ...
[--22T04::,][INFO ][o.e.t.TransportService ] [node105.yinzhengjie.org.cn] publish_address {}, bound_addresses {}
[--22T04::,][INFO ][o.e.b.BootstrapChecks ] [node105.yinzhengjie.org.cn] bound or publishing to a non-loopback address, enforcing bootstrap checks
[--22T04::,][INFO ][o.e.c.s.MasterService ] [node105.yinzhengjie.org.cn] zen-disco-elected-as-master ([] nodes joined), reason: new_master {node105.yinzhengjie.org.cn}{5Xyf16x8SNaMa_29D7452Q}{o8lotI6GSg2kQtrFkHf9Eg}{node105.yinzhengjie.org.cn}{}{ml.machine_memory=, xpack.installed=, ml.enabled=true}
[--22T04::,][INFO ][o.e.c.s.ClusterApplierService] [node105.yinzhengjie.org.cn] new_master {node105.yinzhengjie.org.cn}{5Xyf16x8SNaMa_29D7452Q}{o8lotI6GSg2kQtrFkHf9Eg}{node105.yinzhengjie.org.cn}{}{ml.machine_memory=, xpack.installed=, ml.enabled=}{ml.machine_memory=, xpack.installed=, ml.enabled=] source [zen-disco-elected-as-master ([] nodes joined)]])
[--22T04::,][INFO ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [node105.yinzhengjie.org.cn] publish_address {}, bound_addresses {}
[--22T04::,][INFO ][o.e.n.Node ] [node105.yinzhengjie.org.cn] started
[--22T04::,][WARN ][o.e.x.s.a.s.m.NativeRoleMappingStore] [node105.yinzhengjie.org.cn] Failed to clear cache for realms [[]]
[--22T04::,][INFO ][o.e.l.LicenseService ] [node105.yinzhengjie.org.cn] license [c7460796--404e-9b75-6dcb4e6992fe] mode [basic] - valid
[--22T04::,][INFO ][o.e.g.GatewayService ] [node105.yinzhengjie.org.cn] recovered [] indices into cluster_state
[yinzhengjie@node101 root]$ elasticsearch & #后台启动ES，当然输出信息大家可以直接丢弃在Linux的回收站（/dev/null），如果刚刚部署ES建议大家不要这么干，因为输出信息有助于我们排错！
6>.启动ES报错汇总
解决方案：
根据报错提示信息，是由于咱们的默认配置未能达到ES的要求，因此启动失败了，我们按照其要求，修改Linux系统对应的配置文件，于此同时，我还做了一些其他的优化参数。
[root@node101 ~]# cat /etc/security/limits.conf |egrep -v '^#|^$' * soft nofile * hard nofile * soft nproc * hard nproc unlimited * soft memlock unlimited * hard memlock unlimited [root@node101 ~]#
修改用户的资源限制（[root@node101 ~]# cat /etc/security/limits.conf |egrep -v '^#|^$' ）
[root@node101 ~]# cat /etc/sysctl.conf | egrep -v '^#|^$' net.ipv6.conf.all.disable_ipv6 = vm.dirty_ratio = vm.dirty_background_ratio = vm.swappiness = net.core.wmem_default = net.core.rmem_default = net.ipv4.tcp_wmem = net.ipv4.tcp_rmem = net.ipv4.tcp_window_scaling = net.ipv4.tcp_max_syn_backlog = net.core.netdev_max_backlog = vm.max_map_count = [root@node101 ~]#
修改Linux的内核配置（[root@node101 ~]# cat /etc/sysctl.conf | egrep -v '^#|^$'）
7>.访问ES的RESTFUL API接口
由于ES是基于http协议的，因此我们可以通过浏览器访问，当然我们也可以使用curl命令来模拟浏览器。
[root@node101 ~]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; enabled; vendor preset: enabled)
Active: active (running) since Mon -- :: EST; 17h ago
Main PID: (firewalld)
CGroup: /system.slice/firewalld.service
└─ /usr/bin/python -Es /usr/sbin/firewalld --nofork --nopid
Jan :: node101.yinzhengjie.org.cn systemd[]: Starting firewalld - dynamic firewall daemon...
Jan :: node101.yinzhengjie.org.cn systemd[]: Started firewalld - dynamic firewall daemon.
[root@node101 ~]#
[root@node101 ~]#
[root@node101 ~]# systemctl stop firewalld
[root@node101 ~]#
[root@node101 ~]# systemctl disable firewalld
Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service.
Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service.
[root@node101 ~]#
关闭防火墙（[root@node101 ~]# systemctl stop firewalld ）
关闭防火墙后，我们再次访问WebUI，如下图所示：
上面是查看某个节点是否工作正常，如果想要查看整个集群的所有节点信息，我们可以在浏览器输入：http://node101.yinzhengjie.org.cn:9200/_cat/nodes。
当然我们也可以通过curl命令来模拟http请求，详情请参考：https://www.cnblogs.com/yinzhengjie/p/10226567.html。
8>.等待集群每个节点都启动成功后，我们任意选取一个节点在9300端口进行抓包（部署过程重复上述的2~6步骤）
[root@node101 ~]# yum -y install tcpdump Loaded plugins: fastestmirror base | :: extras | :: updates | :: Loading mirror speeds from cached hostfile * base: mirrors.tuna.tsinghua.edu.cn * extras: mirrors.tuna.tsinghua.edu.cn * updates: mirrors.tuna.tsinghua.edu.cn Resolving Dependencies --> Running transaction check ---> Package tcpdump.x86_64 :-.el7 will be installed --> Processing Dependency: libpcap >= :- :tcpdump--.el7.x86_64 --> Processing Dependency: libcrypto.so.(OPENSSL_1.:tcpdump--.el7.x86_64 --> Running transaction check ---> Package libpcap.x86_64 :-.el7 will be updated ---> Package libpcap.x86_64 :-.el7 will be an update ---> Package openssl-libs.x86_64 :.el7. will be updated --> Processing Dependency: openssl-libs(x86-) = :.el7. :openssl-.el7..x86_64 ---> Package openssl-libs.x86_64 :.el7 will be an update --> Running transaction check ---> Package openssl.x86_64 :.el7. will be updated ---> Package openssl.x86_64 :.el7 will be an update --> Finished Dependency Resolution Dependencies Resolved ================================================================================================================================= Package Arch Version Repository Size ================================================================================================================================= Installing: tcpdump x86_64 :-.el7 base k Updating for dependencies: libpcap x86_64 :-.el7 base k openssl x86_64 :.el7 base k openssl-libs x86_64 :.el7 base 1.2 M Transaction Summary ================================================================================================================================= Install Package Upgrade ( Dependent packages) Total download size: 2.2 M Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. (/): libpcap--.el7.x86_64.rpm | kB :: (/): openssl-.el7.x86_64.rpm | kB :: (/): openssl-libs-.el7.x86_64.rpm | :: (/): tcpdump--.el7.x86_64.rpm | kB :: --------------------------------------------------------------------------------------------------------------------------------- Total kB/s | :: Running transaction check Running transaction test Transaction test succeeded Running transaction Updating : :openssl-libs-.el7.x86_64 / Updating : :libpcap--.el7.x86_64 / Installing : :tcpdump--.el7.x86_64 / Updating : :openssl-.el7.x86_64 / Cleanup : :openssl-.el7..x86_64 / Cleanup : :openssl-libs-.el7..x86_64 / Cleanup : :libpcap--.el7.x86_64 / Verifying : :openssl-libs-.el7.x86_64 / Verifying : :tcpdump--.el7.x86_64 / Verifying : :openssl-.el7.x86_64 / Verifying : :libpcap--.el7.x86_64 / Verifying : :openssl-libs-.el7..x86_64 / Verifying : :libpcap--.el7.x86_64 / Verifying : :openssl-.el7..x86_64 / Installed: tcpdump.x86_64 :-.el7 Dependency Updated: libpcap.x86_64 :-.el7 openssl.x86_64 :.el7 openssl-libs.x86_64 :.el7 Complete! [root@node101 ~]#
安装Linux的网络分析工具（[root@node101 ~]# yum -y install tcpdump）
[root@node101 ~]# tcpdump -i eth0 -nn tcp port tcpdump: verbose output suppressed, use -v or -vv for full protocol decode listening on eth0, link-type EN10MB (Ethernet), capture size bytes :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [P.], :, ack , win , options [nop,nop,TS val ecr ], length :: > : Flags [.], ack , win , options [nop,nop,TS val ecr ], length ^C packets captured packets received by filter packets dropped by kernel [root@node101 ~]#
进行抓包分析，我们只看9300端口，发现3个节点有数据在交互（[root@node101 ~]# tcpdump -i eth0 -nn tcp port 9300）