mysql每天定时自动全库备份、灾备、docker

头像
码农笔录
2020-01-21阅读 144

之前没有意识,在ECS上自己安装的mysql没有自动备份,偶然发现,服务器被黑客入侵,把我的mysql数据库全部删除后,勒索我要比特币,当时也很无语,因为完全么有备份,也没有开启日志,所以只能认倒霉了,然后就研究了怎么进行定时备份,有的是docker环境下运行的,有的是宿主机直接安装。

1.创建几个目录

data 存放备份数据,logs存放每天的日志

注意:目录可以自己随意改,但是一定要修改脚本里的路劲

一.直接安装,非docker模式

2.然后编写脚本 vi backup.sh

#!/bin/bash
#备份目录
BACKUP_ROOT=/data/mysqlbak
BACKUP_FILEDIR=$BACKUP_ROOT/data
#当前日期
DATE=$(date +%Y%m%d)

#查询所有数据库
DATABASES=$(mysql -uroot -p'zgmsoft$123' -e "show databases" | grep -Ev "Database|sys|information_schema|performance_schema|mysql")
#循环数据库进行备份
for db in $DATABASES
do
echo # 过滤有些不需要备份的数据库 if [ "${db}" = "move_oct09" ] || [ "${db}" = "wisdomtourism" ];then
echo "jump over ${db}"
else
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz BEGIN----------
mysqldump -uroot -p'zgmsoft$123' --default-character-set=utf8 -q --lock-all-tables --flush-logs -E -R --triggers -B ${db} | gzip > $BACKUP_FILEDIR/${db}_$DATE.sql.gz
echo ${db}
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz COMPLETE----------
fi
done
echo "done"

如果需要进行灾备,就是吧备份文件复制到其他的服务器上,就这样写,利用scp远程复制,可能服务器需要安装一下expect

#!/bin/bash
#备份目录
BACKUP_ROOT=/data/mysqlbak
BACKUP_FILEDIR=$BACKUP_ROOT/data
#当前日期
DATE=$(date +%Y%m%d)

#查询所有数据库
DATABASES=$(mysql -uroot -p'zgmsoft$123' -e "show databases" | grep -Ev "Database|sys|information_schema|performance_schema|mysql")
#循环数据库进行备份
for db in $DATABASES
do
echo
if [ "${db}" = "move_oct09" ] || [ "${db}" = "wisdomtourism" ];then
echo "jump over ${db}"
else
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz BEGIN----------
mysqldump -uroot -p'zgmsoft$123' --default-character-set=utf8 -q --lock-all-tables --flush-logs -E -R --triggers -B ${db} | gzip > $BACKUP_FILEDIR/${db}_$DATE.sql.gz
echo ${db}
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz COMPLETE----------
echo
echo ----------scp 226 begin----------
expect -c "
spawn scp -r /data/mysqlbak/data/${db}_$DATE.sql.gz root@你的服务器地址:/data/mysqlbak/118mysql/
expect {
\"*assword\" {set timeout 300; send \"你的服务器密码\r\"; exp_continue;}
\"yes/no\" {send \"yes\r\";}
}
expect eof"
echo ----------scp 226 end---------
fi
done

echo "done"


二、docker 环境

2.创建脚本文件 vi backup.sh

注意一点:docker exec -i  ,这里不能加t,因为么有tty输入,所以会报错   the input device is not a TTY

#!/bin/bash
#备份目录
BACKUP_ROOT=/data/mysqlbak
BACKUP_FILEDIR=$BACKUP_ROOT/data
#当前日期
DATE=$(date +%Y%m%d)

#查询所有数据库
DATABASES=$(docker exec -i root_mysql_1_8c6548532b81 mysql -uroot -pyasaka.00 -e "show databases" | grep -Ev "Database|sys|information_schema|performance_schema|mysql")
#循环数据库进行备份
for db in $DATABASES
do
echo
if [[ "${db}" =~ "+" ]] || [[ "${db}" =~ "|" ]];then
echo "jump over ${db}"
else
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz BEGIN----------
docker exec -i root_mysql_1_8c6548532b81 mysqldump -uroot -pyasaka.00 --default-character-set=utf8 -q --lock-all-tables --flush-logs -E -R --triggers -B ${db} | gzip > $BACKUP_FILEDIR/${db}_$DATE.sql.gz
echo ${db}
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz COMPLETE----------
echo
fi
done

echo "done"

如果需要进行灾备,就是吧备份文件复制到其他的服务器上,就这样写,利用scp远程复制,可能服务器需要安装一下expect

#!/bin/bash
#备份目录
BACKUP_ROOT=/data/mysqlbak
BACKUP_FILEDIR=$BACKUP_ROOT/data
#当前日期
DATE=$(date +%Y%m%d)

#查询所有数据库
DATABASES=$(docker exec -i root_mysql_1_8c6548532b81 mysql -uroot -pyasaka.00 -e "show databases" | grep -Ev "Database|sys|information_schema|performance_schema|mysql")
#循环数据库进行备份
for db in $DATABASES
do
echo
if [[ "${db}" =~ "+" ]] || [[ "${db}" =~ "|" ]];then
echo "jump over ${db}"
else
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz BEGIN----------
docker exec -i root_mysql_1_8c6548532b81 mysqldump -uroot -pyasaka.00 --default-character-set=utf8 -q --lock-all-tables --flush-logs -E -R --triggers -B ${db} | gzip > $BACKUP_FILEDIR/${db}_$DATE.sql.gz
echo ${db}
echo ----------$BACKUP_FILEDIR/${db}_$DATE.sql.gz COMPLETE----------
echo
echo ----------scp 109.5 begin----------
expect -c "
spawn scp -P 22 -r /data/mysqlbak/data/${db}_$DATE.sql.gz root@你的服务器地址:/data/mysqlbak/aiprose/
expect {
\"*assword\" {set timeout 300; send \"你的服务器密码\r\"; exp_continue;}
\"yes/no\" {send \"yes\r\";}
}
expect eof"
echo ----------scp 109.5 end---------
fi
done

echo "done"

3.编写清除旧数据脚本 backup_clean.sh

#!/bin/bash
echo ----------CLEAN BEGIN----------
find /data/mysqlbak/data -mtime +7 -name "*.gz" -exec rm -rf {} \;
echo ----------CLEAN COMPLETE---------

4.设置定时任务

脚本编写好了,需要加到系统的定时任务里,负责需要手动执行

查看定时任务
crontab -l

修改定时任务
crontab -e

修改定时任务的时候增加如下,记得修改为自己的脚本路径,下面是凌晨2点自动清理数据,凌晨3点自动备份数据

00 2 * * * /data/mysqlbak/mysql_back/backup_clean.sh > /data/mysqlbak/logs/backup_full_clean.log 2>&1
00 3 * * * /data/mysqlbak/mysql_back/aiprose.sh > /data/mysqlbak/logs/backup.log 2>&1

关注

关注下方微信公众号,可以及时获取到各种技术的干货哦,如果你有想推荐的帖子,也可以联系我们的。