NBU 配置多实例mysql备份报错处理 status: 50 / 29

原创 lizhao01 2022-11-29

1480

报错信息 nbu 中报错信息：

2022-11-28 23:01:45 - 开始写入
2022-11-28 23:05:21 - 严重 bpbrm (pid=226072) unexpected termination of client 10_111_xxx_9
2022-11-28 23:05:21 - 错误 bptm (pid=226116) media manager terminated by parent process
2022-11-28 23:05:23 - 信息 nbu01pri01bak01 (pid=226116) StorageServer=PureDisk:nbu01pri01bak01; Report=PDDO Stats for (nbu01pri01bak01): scanned: 304130 KB, CR sent: 48036 KB, CR sent over FC: 0 KB, dedup: 84.2%, cache hits: 0 (0.0%), where dedup space saving:0.0%, compression space saving:84.2%
2022-11-28 23:05:23 - 信息 dbclient (pid=37533) done. status: 50: client process aborted
2022-11-28 23:05:23 - 结束写入；写入时间: 0:03:38
client process aborted (50)

客户端中的日志：
221129 10:28:16 RLW1 INFO: A copied database page was modified at 734648773613.
(This is the highest lsn found on page)
Scanned log up to lsn 734648800228.
Was able to parse the log up to lsn 734648800228.
221129 10:28:16 RLW1 INFO: Rethrowing the exception.
221129 10:28:16 RLW1 ERROR: Opening of file /usr/openv/netbackup/scripts/full_dbbkdir/29_09/datadir/ibbackup_logfile failed. Error code: 2, No such file or directory
221129 10:28:16 RLW1 INFO: Requesting completion of redo log copy. Rapid: 1
221129 10:28:16 RDR1 INFO: All tables unlocked
221129 10:28:16 RDR1 INFO: All MySQL tables were locked for 1.661 seconds.
221129 10:28:16 RDR1 INFO: Setting server system variable 'old_alter_table' back to '0'.
221129 10:28:16 RDR1 INFO: Reading all global variables from the server.
221129 10:28:16 RDR1 INFO: Completed reading of all global variables from the server.
221129 10:28:16 RDR1 INFO: Writing config file for server '5.7.20-log'.
221129 10:28:16 RDR1 INFO: Creating server config files server-my.cnf and server-all.cnf in /usr/openv/netbackup/scripts/full_dbbkdir/29_09

mysqlbackup failed with errors!

-------------------------------------------
End Full Backup at 20221129_092735
-------------------------------------------

Backup failed... on Tue Nov 29 10:28:16 CST 2022 ====

客户端中表信息记录：

mysql> select * from mysql.backup_history \G
*************************** 7975. row ***************************
backup_id: 16696882904141842
tool_name: /usr/openv/netbackup/ext/db_ext/mysqlbackup --port=3320 --protocol=tcp --user=nbubak --password=xxxxxxxxxxx --incremental --incremental-base=history:last_backup --sbt-lib-path=/usr/openv/netbackup/bin/libobk.so64 --sbt-environment=NB_ORA_SERV=nbu01pri01bak01,NB_ORA_CLIENT=10_166_201_6,NB_ORA_POLICY=mysql_10.111.xxx.9_db_3320_full --backup-dir=/usr/openv/netbackup/scripts/incr_dbbkdir/29_10 --backup-image=sbt:Incr_20221129_101810 backup-to-image
start_time: 2022-11-29 10:18:10
end_time: 2022-11-29 10:18:29
binlog_pos: -1
binlog_file: BINLOG-DISABLED
compression_level: 0
engines:
innodb_data_file_path: ibdata1:1G:autoextend
innodb_file_format: Barracuda
start_lsn: 0
end_lsn: 0
incremental_base_lsn: 0
backup_type: INCREMENTAL
backup_format: IMAGE
mysql_data_dir: /data/mysql/3320/data/
innodb_data_home_dir:
innodb_log_group_home_dir: /data/mysql/3320/data/
innodb_log_files_in_group: 4
innodb_log_file_size: 1073741824
backup_destination: /usr/openv/netbackup/scripts/incr_dbbkdir/29_10
lock_time: 0.000
exit_state: FAILURE
last_error: Creation of file /usr/openv/netbackup/scripts/incr_dbbkdir/29_10/datadir/ibbackup_logfile failed. Error code: 17, File exists
last_error_code: 17
start_time_utc: 1669688290399311
end_time_utc: 1669688309621548
consistency_time_utc: 1669688290399311
meb_version: 4.1.3
server_uuid: c1f763fa-e8fd-11ea-9d97-78b46af201bc

排查原因发现是在一个服务器上多个实例，当不同实例同时发起备份时将ibbackup_logfile这个文件写入到了同一目录中造成了冲突。
然后我对配置文件进行了如下的修改：

initialize()
{
CURDATE=3320_`date +%Y%m%d_%H%M%S` #如果多个mysql应该加上端口号，否则会出现冲突
CURDATE_DIR=3320_`date +%d_%H` #如果多个mysql应该加上端口号，否则会出现冲突
DB_BACKUP_DIR_HOME=/usr/openv/netbackup/scripts/full_dbbkdir/$CURDATE_DIR
INCR_BACKUP_DIR_HOME=/usr/openv/netbackup/scripts/incr_dbbkdir/$CURDATE_DIR
dLIB=/usr/openv/netbackup/bin/libobk.so64
dFULL_BACKUPIMAGENAME=sbt:Full_$CURDATE
dINCR_BACKUPIMAGENAME=sbt:Incr_$CURDATE
dOUTLOG=${0}_`date +%d_%H`.log
dERRORLOG=${0}_error.log
dCLEANUP=0

if [ -f $dOUTLOG ]; then
rm -f $dOUTLOG
fi
}