xtrabackup备份与恢复实践

时间:2021-01-02 16:30:39
说明

 
xtrabackup  --percona
特点:
  • 开源,在线备份innodb表
  • 支持限速备份,避免对业务造成影响
  • 支持流备
  • 支持增量备份
  • 支持备份文件压缩与加密
  • 支持并行备份与恢复,速度快
地址:https://www.percona.com/downloads/XtraBackup
 
xtrabackup备份原理
  • 基于innodb的crash-recovery功能
  • 备份期间允许用户读写,写请求产生redo日志
  • 从磁盘上拷贝数据文件
  • 从innodb redo log  file实时拷贝走备份期间产生的所有redo日志
  • 恢复的时候 数据文件+redo日志 = 一致性数据
 
实用脚本innobackupex
  • 开源Perl脚本,封装调用xtrabackup及一系列相关工具与OS操作,最终完成备份过程
  • 支持备份Innodb和其他引擎的表
  • 备份一致性保证
 
 
安装问题

 
问题一:innobackupex发现mysql模块没有安装
140312 13:30:40  innobackupex: Connecting to MySQL server with DSN 'dbi:mysql:;mysql_read_default_file=/etc/my.cnf;mysql_read_default_group=xtrabackup' as 'root'  (using password: YES).
innobackupex: Error: Failed to connect to MySQL server as DBD::mysql module is not installed at /usr/local/mysql/bin/innobackupex line 2956.
 
因为环境是使用二进制文件安装的mysql,在Ubuntu下没有安装mysql-server;
解决:安装mysql-server
aiapple@ubuntu:~$ sudo apt-get install mysql-server
 
 
innobackupex使用

  1. 全量备份
  2. 增量备份
  3. 流方式备份
  4. 并行备份
  5. 限流备份
  6. 压缩备份
  7. 常用参数介绍
1)全量备份:
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf dbbackup/

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup/2016-08-20_06-16-26'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK!
  #备份成功;
  aiapple@ubuntu:~$ ls dbbackup/
  2016-08-20_06-16-26  
2)增量备份,需指定上一次备份目录
注意:innobackupex 增量备份仅针对InnoDB这类支持事务的引擎,对于MyISAM等引擎,则仍然是全备。
增量备份:
 
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --incremental --incremental-dir dbbackup/--20_06--/ dbbackup/

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup/2016-08-20_06-24-08'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK! #备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06--
3)流式备份()
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --stream=xbstream dbbackup/ > dbbackup/stream.bak

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK! #备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06-- stream.bak
4)并行备份--使用4个线程
 
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --parallel= dbbackup/

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup/2016-08-20_06-36-34'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK! #备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06-- --20_06-- stream.bak
5)限流备份--读写速度限制10M
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --throttle= dbbackup/

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup/2016-08-20_06-38-26'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK! #备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06-- stream.bak
--20_06-- --20_06--
6)压缩备份--可以指定压缩备份线程
 
aiapple@ubuntu:~$ innobackupex-1.5. --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --compress --compress-thread  dbbackup/

innobackupex-1.5.: Backup created in directory '/home/aiapple/dbbackup/2016-08-20_06-40-26'
innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK! #备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06-- --20_06--
--20_06-- --20_06-- stream.bak
7)常用参数
innobackupex --help | less
 
 
恢复

 
1.全量备份与恢复:
1)全量备份
mysql> show tables;
+--------------+
| Tables_in_tt |
+--------------+
| course |
| t1 |
+--------------+
rows in set (0.00 sec) aiapple@ubuntu:~$ innobackupex --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf dbbackup/ #备份成功;
aiapple@ubuntu:~$ ls dbbackup/
--20_06--
2)删除表
mysql> drop table t1;
Query OK, rows affected (0.02 sec) mysql> show tables;
+--------------+
| Tables_in_tt |
+--------------+
| course |
+--------------+
row in set (0.00 sec)
 
3)通过全量备份恢复
#只需通过apply-log指定备份文件
aiapple@ubuntu:~$ innobackupex --apply-log dbbackup/--20_06--

InnoDB: Starting shutdown...
InnoDB: Shutdown completed; log sequence number
:: innobackupex: completed OK!
 
#回滚redo log文件;
aiapple@ubuntu:~/dbbackup/--20_06--$ ls
backup-my.cnf mysql xtrabackup_binlog_info
ibdata1 performance_schema xtrabackup_checkpoints
ib_logfile0 tt xtrabackup_logfile
ib_logfile1 xtrabackup_binary
4)复制恢复文件到数据目录
#注意:数据目录要求是空,最好先备份,再清空;
aiapple@ubuntu:~/dbbackup$ innobackupex  --defaults-file=/tmp/mysqldata/my.cnf --user=root --password= --copy-back --20_06--/

innobackupex-1.5.: Copying '/home/aiapple/dbbackup/2016-08-20_06-16-26/ib_logfile1' to '/tmp/mysqldata/node1/ib_logfile1'
innobackupex-1.5.: Finished copying back files.
:: innobackupex-1.5.: completed OK!
 
5)查看
mysql> show tables;
+--------------+
| Tables_in_tt |
+--------------+
| course |
| t1 |
+--------------+
rows in set (0.00 sec)
2.增量备份与恢复
#需指定上次备份目录
1)增加表zengliang;
mysql> show tables;
+--------------+
| Tables_in_tt |
+--------------+
| course |
| t1 |
+--------------+
rows in set (0.00 sec) mysql> create table zengliang(a int ,b int);
Query OK, rows affected (0.06 sec)
2)增量备份
#注意--incremental-dir后面跟基础备份目录,之后再跟增量备份目录,
#与应用增量备份日志相反
aiapple@ubuntu:~$ innobackupex --user=root --password= --defaults-file=/tmp/mysqldata/my.cnf --incremental --incremental-dir dbbackup/--20_06--/ dbbackup/

innobackupex-1.5.: MySQL binlog position: filename 'mysql-bin.000001', position
:: innobackupex-1.5.: Connection to database server closed
:: innobackupex-1.5.: completed OK!
 
#备份成功
aiapple@ubuntu:~$ ls dbbackup/
--20_06-- --20_06--
3)应用日志恢复数据
--apply-log    回滚日志
--redo-only    回滚合并(多个增量的时候,增量也需要用到,直到最后一个增量不用)
     a)恢复完全备份数据
 aiapple@ubuntu:~/dbbackup$ innobackupex --apply-log --redo-only --20_06--
     b)应用增量备份日志
     #注意此时--incremental-dir后面跟的是增量备份的目录,之后再跟基础备份的目录;
     #与增量备份相反
     #注意:由于权限问题,使用innobackupex,应该使用root账户,不然这条不会通过;
  aiapple@ubuntu:~/dbbackup$ innobackupex --apply-log --incremental-dir=(增量备份目录) (基础备份目录)
#不知何原因总是不太容易成功;
 
4)复制恢复文件到数据目录
#注意:数据目录要求是空,最好先备份,再清空;
aiapple@ubuntu:~/dbbackup$ innobackupex  --defaults-file=/tmp/mysqldata/my.cnf --user=root --password= --copy-back --20_06--/

innobackupex-1.5.: Copying '/home/aiapple/dbbackup/2016-08-20_06-16-26/ib_logfile1' to '/tmp/mysqldata/node1/ib_logfile1'
innobackupex-1.5.: Finished copying back files. :: innobackupex-1.5.: completed OK!
3.还原压缩
 
解压--innobackupex --decompress /dbbackup/(备份目录)
应用日志--innobackupex --apply-log /dbbackup/(压缩后目录)
 
 
4)还原流备
 
mkdir stream
xbstream -C stream -x < stream.bak
并行恢复--innobackupex --parallel=4 --apply-log --use-memory=200MB /dbbackup/stream
 
--use-memory:加快恢复速度;
 
binlog恢复

 
在备份恢复之后,使用binlog恢复没有备份的数据;
 
1)查看备份时binlog点;
aiapple@ubuntu:~/dbbackup/mysql3309$ cat xtrabackup_binlog_info
mysql-bin.
 
2)使用mysqlbinlog分析二进制日志
aiapple@ubuntu:/tmp/mysqldata/node1$ mysqlbinlog -vv mysql-bin. | less
# at
# :: server id end_log_pos CRC32 0x683bcdc6 Query thread_id= exec_time= error_code=
SET TIMESTAMP=/*!*/;
insert into t6 values(,),(,),(,)
/*!*/;
# at
# :: server id end_log_pos CRC32 0xf264071a Xid =
COMMIT/*!*/;
# at
# :: server id end_log_pos CRC32 0x3f63ae99 Query thread_id= exec_time= error_code=
SET TIMESTAMP=/*!*/;
BEGIN
/*!*/;
# at
# :: server id end_log_pos CRC32 0x5c3b7667 Query thread_id= exec_time= error_code=
SET TIMESTAMP=/*!*/;
insert into t6 values(,),(,),(,)
/*!*/;
# at
# :: server id end_log_pos CRC32 0x4ea5c481 Xid =
COMMIT/*!*/;
可以看到结束节点在2298
 
3)使用mysqlbinlog+管道+mysql sock登陆
aiapple@ubuntu:/tmp/mysqldata/node1$ mysqlbinlog -vv --start-position=   --stop-position= mysql-bin. | mysql -uroot -p --socket=/home/aiapple/dbbackup/mysql3309/mysql.sock
也可以按照时间恢复:
aiapple@ubuntu:/tmp/mysqldata/node1$ mysqlbinlog -vv --start-datetime='2016-08-20 9:03:58'   --stop-datetime='2016-08-20 9:11:51' mysql-bin. | cat