【HA】Heartbeat高可用集群配置

时间:2021-12-26 03:11:25

            主:hh.huangmingming.cn 192.168.1.31

            从:yo.huangmingming.cn 192.168.1.250

        主和从hosts文件配置:

        192.168.1.31 hh hh.huangmingming.cn

        192.168.1.250 yo yo.huangmingming.cn

一、安装epel扩展源

[root@yo ~]# wget http://mirrors.sohu.com/fedora-epel/6/i386/epel-release-6-8.noarch.rpm

[root@hh ~]# yum list |grep heartbeat

heartbeat.x86_64                            3.0.4-2.el6                  epel   

heartbeat-devel.i686                        3.0.4-2.el6                  epel   

heartbeat-devel.x86_64                      3.0.4-2.el6                  epel   

heartbeat-libs.i686                         3.0.4-2.el6                  epel   

heartbeat-libs.x86_64                       3.0.4-2.el6                  epel 

二、安装heartbeat、libnet(主从都需要安装)

[root@hh ~]# yum -y install heartbeat

[root@hh ~]# yum -y install libnet

[root@hh ~]# yum -y install nginx  (安装nginx做测试)


三、配置heartbeat(在主上配置)

1、拷贝配置文件authkeys、ha.cf、haresources到目录/etc/ha.d/下

[root@hh ~]# cd /usr/share/doc/heartbeat-3.0.4/

[root@hh heartbeat-3.0.4]# ls

apphbd.cf  authkeys  AUTHORS  ChangeLog  COPYING  COPYING.LGPL  ha.cf  haresources  README

[root@hh heartbeat-3.0.4]# cp authkeys ha.cf haresources /etc/ha.d/


2、配置authkeys文件

[root@hh ~]# cd /etc/ha.d/

[root@hh ha.d]# vim authkeys 

auth 3

#1 crc

#2 sha1 HI!

3 md5 Hello!

[root@hh ha.d]# chmod 600 authkeys   (authkeys文件的权限要注意改成600)


3、配置haresources文件

[root@hh ha.d]# vim haresources 

hh.huangmingming.cn     192.168.1.13/24/eth0:0 nginx  (指定集群IP)


4、配置ha.cf文件

[root@hh ha.d]# vim ha.cf 

debugfile /var/log/ha-debug

logfile /var/log/ha-log

logfacility     local0

keepalive 2

deadtime 30

warntime 10

initdead 60

udpport 694

ucast eth0 192.168.1.250

auto_failback on

node hh.huangmingming.cn

node yo.huangmingming.cn

ping 192.168.1.1

respawn hacluster /usr/lib64/heartbeat/ipfail


5、把这三个文件发送到yo(从机器上)

[root@hh ha.d]# scp authkeys haresources ha.cf yo:/etc/ha.d/


6、启动heartbeat服务,先主后从

[root@hh ha.d]# /etc/init.d/heartbeat start

Starting High-Availability services: INFO:  Resource is stopped

Done.


四、启动产生的错误

1、<--respawn hacluster /usr/lib64/heartbeat/ipfail (注意当前系统是64位还是32位的否则会产生以下错误)--/>

[root@hh ha.d]# /etc/init.d/heartbeat start

heartbeat: udpport setting must precede media statementsheartbeat[4227]: 2016/01/01_05:04:26 ERROR: Client child command [/usr/lib/heartbeat/ipfail] is not executable

heartbeat[4227]: 2016/01/01_05:04:26 ERROR: Heartbeat not started: configuration error.

heartbeat[4227]: 2016/01/01_05:04:26 ERROR: Configuration error, heartbeat not started.


2、<--以下两个错误都是因为主机名配置不对造成的,在heartbeat配置中指定主机名的地方要与当前主机名对应,否则启不来--/>

[root@hh ha.d]# /etc/init.d/heartbeat start

heartbeat: udpport setting must precede media statementsheartbeat: baudrate setting must precede media statementsheartbeat[28195]: 2015/10/29_21:31:14 info: Pacemaker support: false

heartbeat[28195]: 2015/10/29_21:31:14 ERROR: Current node [hh.huangmingming.com] not in configuration!

heartbeat[28195]: 2015/10/29_21:31:14 info: By default, cluster nodes are named by `uname -n` and must be declared with a 'node' directive in the ha.cf file.

heartbeat[28195]: 2015/10/29_21:31:14 info: See also: http://linux-ha.org/wiki/Ha.cf#node_directive

heartbeat[28195]: 2015/10/29_21:31:14 WARN: Logging daemon is disabled --enabling logging daemon is recommended

heartbeat[28195]: 2015/10/29_21:31:14 ERROR: Configuration error, heartbeat not started.


[root@hh ha.d]# /etc/init.d/heartbeat start

Starting High-Availability services: INFO:  Resource is stopped

 Heartbeat failure [rc=6]. Failed.

heartbeat: udpport setting must precede media statementsheartbeat: baudrate setting must precede media statementsheartbeat[30724]: 2015/10/29_21:56:29 info: Pacemaker support: false

heartbeat[30724]: 2015/10/29_21:56:29 WARN: Logging daemon is disabled --enabling logging daemon is recommended

heartbeat[30724]: 2015/10/29_21:56:29 info: **************************

heartbeat[30724]: 2015/10/29_21:56:29 info: Configuration validated. Starting heartbeat 3.0.4

heartbeat[30724]: 2015/10/29_21:56:29 ERROR: Bad nodename in /etc/ha.d//haresources [hh]

heartbeat[30724]: 2015/10/29_21:56:29 ERROR: Configuration error, heartbeat not started.


五、故障模拟测试,如主down掉,看会不会切换到从继续提供服务

1、正常情况下

[root@hh ha.d]# /etc/init.d/heartbeat start

Starting High-Availability services: INFO:  Resource is stopped

Done.

[root@hh ~]# ifconfig 

eth0      Link encap:Ethernet  HWaddr 00:0C:29:97:EE:BF  

          inet addr:192.168.1.31  Bcast:192.168.1.255  Mask:255.255.255.0

          inet6 addr: fe80::20c:29ff:fe97:eebf/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:37359 errors:0 dropped:0 overruns:0 frame:0

          TX packets:22139 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:36402808 (34.7 MiB)  TX bytes:2377053 (2.2 MiB)


eth0:0    Link encap:Ethernet  HWaddr 00:0C:29:97:EE:BF  

          inet addr:192.168.1.13  Bcast:192.168.1.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1


eth0:1    Link encap:Ethernet  HWaddr 00:0C:29:97:EE:BF  

          inet addr:192.168.1.144  Bcast:192.168.1.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1


lo        Link encap:Local Loopback  

          inet addr:127.0.0.1  Mask:255.0.0.0

          inet6 addr: ::1/128 Scope:Host

          UP LOOPBACK RUNNING  MTU:16436  Metric:1

          RX packets:28 errors:0 dropped:0 overruns:0 frame:0

          TX packets:28 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0 

          RX bytes:2727 (2.6 KiB)  TX bytes:2727 (2.6 KiB)


[root@hh ha.d]# ps aux |grep nginx    (主)

root      31367  0.0  0.1  96488  1728 ?        Ss   21:58   0:00 nginx: master process /usr/sbin/nginx -c /etc/nginx/nginx.conf

nginx     31368  0.0  0.2  96876  2500 ?        S    21:58   0:00 nginx: worker process                   

root      31643  0.0  0.0 103252   824 pts/0    S+   22:16   0:00 grep nginx


[root@yo ha.d]# netstat -tnlp |grep nginx   (从)

[root@yo ha.d]# ps aux |grep nginx

root       5217  0.0  0.0 103256   828 pts/0    S+   06:11   0:00 grep nginx


2、创建测试页面,并在正常情况下测试访问,此时由主提供服务

[root@hh ha.d]# echo "AAAAAAAAAAAAAAAAhh192.168.1.31" >/usr/share/nginx/html/index.html 

[root@yo ha.d]# echo "AAAAAAAAAAAAAAAAyo192.168.1.250" >/usr/share/nginx/html/index.html

【HA】Heartbeat高可用集群配置


3、主服务节点down掉之后(测试)

[root@hh ~]# iptables -A INPUT -p icmp -j DROP

[root@hh ~]# tail /var/log/ha-log   (查看日志信息)

ResourceManager(default)[32095]:2015/10/29_22:24:20 info: Running /etc/ha.d/resource.d/IPaddr 192.168.1.13/24/eth0:0 start

IPaddr(IPaddr_192.168.1.13)[32256]:2015/10/29_22:24:20 INFO: Adding inet address 192.168.1.13/24 with broadcast address 192.168.1.255 to device eth0 (with label eth0:0)

IPaddr(IPaddr_192.168.1.13)[32256]:2015/10/29_22:24:20 INFO: Bringing device eth0 up

IPaddr(IPaddr_192.168.1.13)[32256]:2015/10/29_22:24:20 INFO: /usr/libexec/heartbeat/send_arp -i 200 -r 5 -p /var/run/resource-agents/send_arp-192.168.1.13 eth0 192.168.1.13 auto not_used not_used

/usr/lib/ocf/resource.d//heartbeat/IPaddr(IPaddr_192.168.1.13)[32230]:2015/10/29_22:24:20 INFO:  Success

ResourceManager(default)[32095]:2015/10/29_22:24:20 info: Running /etc/init.d/nginx  start

Oct 29 22:24:20 hh.huangmingming.cn ipfail: [30881]: info: NS: We are still alive!

Oct 29 22:24:20 hh.huangmingming.cn ipfail: [30881]: info: Link Status update: Link yo.huangmingming.cn/eth0 now has status dead

Oct 29 22:24:22 hh.huangmingming.cn ipfail: [30881]: info: Asking other side for ping node count.

Oct 29 22:24:22 hh.huangmingming.cn ipfail: [30881]: info: Checking remote count of ping nodes.


4、在从(yo)上查看有没有自动启动nginx,并在客户端访问,此时由从提供服务

[root@yo ha.d]# ps aux |grep nginx

root       5534  0.0  0.1  96496  1972 ?        Ss   06:20   0:00 nginx: master process /usr/sbin/nginx -c /etc/nginx/nginx.conf

nginx      5535  0.0  0.2  96884  2960 ?        S    06:20   0:00 nginx: worker process                   

root       5546  0.0  0.0 103256   828 pts/0    S+   06:24   0:00 grep nginx

[root@yo ha.d]# ifconfig 

eth0      Link encap:Ethernet  HWaddr 00:0C:29:8B:40:4A  

          inet addr:192.168.1.250  Bcast:192.168.1.255  Mask:255.255.255.0

          inet6 addr: fe80::20c:29ff:fe8b:404a/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:36106 errors:0 dropped:0 overruns:0 frame:0

          TX packets:21435 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000 

          RX bytes:39751462 (37.9 MiB)  TX bytes:2077943 (1.9 MiB)


eth0:0    Link encap:Ethernet  HWaddr 00:0C:29:8B:40:4A  

          inet addr:192.168.1.13  Bcast:192.168.1.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1


lo        Link encap:Local Loopback  

          inet addr:127.0.0.1  Mask:255.0.0.0

          inet6 addr: ::1/128 Scope:Host

          UP LOOPBACK RUNNING  MTU:16436  Metric:1

          RX packets:31 errors:0 dropped:0 overruns:0 frame:0

          TX packets:31 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0 

          RX bytes:3005 (2.9 KiB)  TX bytes:3005 (2.9 KiB)

【HA】Heartbeat高可用集群配置

删除防火墙再测试

[root@hh ~]# iptables -nvL

[root@hh ~]# iptables -D INPUT -p icmp -j DROP