Ever since I upgraded to from Mysql Cluster 8.0.20 to version 8.0.22 the backup process has been crashing my data nodes. I get this error message:
2020-11-28 17:45:10 [ndbd] INFO -- Adjusting disk write speed bounds due to
: Backup started
For help with below stacktrace consult:
https://dev.mysql.com/doc/refman/en/using-stack-trace.html
Also note that stack_bottom and thread_stack will always show up as zero.
stack_bottom = 0 thread_stack 0x0
/usr/sbin/ndbmtd(my_print_stacktrace(unsigned char const*, unsigned long)+0x3d)
[0x8aad2d]
/usr/sbin/ndbmtd(ndb_print_stacktrace()+0x52) [0x854c62]
/usr/sbin/ndbmtd(ErrorReporter::handleError(int, char const*, char const*, NdbSh
utdownType)+0x2f) [0x80a99f]
/usr/sbin/ndbmtd(SimulatedBlock::progError(int, int, char const*, char const*) c
onst+0xf9) [0x86e919]
/usr/sbin/ndbmtd(Backup::OperationRecord::scanConf(unsigned int, unsigned int, u
nsigned int)+0x9d) [0x7cac9d]
/usr/sbin/ndbmtd(Backup::execSCAN_FRAGCONF(Signal*)+0x19e) [0x7d9c2e]
/usr/sbin/ndbmtd() [0x87c388]
/usr/sbin/ndbmtd() [0x880abb]
/usr/sbin/ndbmtd(mt_job_thread_main+0x249) [0x885749]
/usr/sbin/ndbmtd() [0x852858]
/lib64/libpthread.so.0(+0x7ea5) [0x7f3004397ea5]
/lib64/libc.so.6(clone+0x6d) [0x7f3002dbf96d]
2020-11-28 17:45:17 [ndbd] INFO -- /var/lib/pb2/sb_1-417098-1600898256.43/rp
m/BUILD/mysql-cluster-gpl-8.0.22/mysql-cluster-gpl-8.0.22/storage/ndb/src/kernel
/blocks/backup/Backup.cpp
2020-11-28 17:45:17 [ndbd] INFO -- BACKUP (Line: 9682) 0x00000002 Check noOf
Ops == done failed
2020-11-28 17:45:17 [ndbd] INFO -- Error handler shutting down system
2020-11-28 17:45:17 [ndbd] ALERT -- Node 3: Forced node shutdown completed. C
aused by error 2341: 'Internal program error (failed ndbrequire)(Internal error,
programming error or missing error message, please report a bug). Temporary err
or, restart node'.
Does anyone have any idea how to fix this problem? Thanks much!