ndb cluster crash

[陈 jim]

please look at the log. What caused the cluster crash? thanks

cluster logs

021-04-15 12:14:28 [MgmtSrvr] INFO -- Node 10: Local checkpoint 365 started. Keep GCI = 623677 oldest restorable GCI = 623680
2021-04-15 12:14:39 [MgmtSrvr] INFO -- Node 12: LDM(0): Completed LCP, #frags = 1239 #records = 243009, #bytes = 46801388
2021-04-15 12:14:39 [MgmtSrvr] INFO -- Node 10: LDM(0): Completed LCP, #frags = 1239 #records = 255339, #bytes = 47978584
2021-04-15 12:14:41 [MgmtSrvr] INFO -- Node 11: LDM(0): Completed LCP, #frags = 1239 #records = 227377, #bytes = 42288032
2021-04-15 12:14:41 [MgmtSrvr] INFO -- Node 10: Local checkpoint 365 completed
2021-04-15 13:00:57 [MgmtSrvr] INFO -- Node 12 disconnected in recv with errnum: 104 in state: 0
2021-04-15 13:00:57 [MgmtSrvr] ALERT -- Node 11: Node 12 Disconnected
2021-04-15 13:00:57 [MgmtSrvr] ALERT -- Node 12: Forced node shutdown completed. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
2021-04-15 13:00:57 [MgmtSrvr] ALERT -- Node 1: Node 12 Disconnected
2021-04-15 13:01:03 [MgmtSrvr] INFO -- Node 10 disconnected in state: 0
2021-04-15 13:01:03 [MgmtSrvr] ALERT -- Node 1: Node 10 Disconnected
2021-04-15 13:01:08 [MgmtSrvr] WARNING -- Node 11: Node 10 missed heartbeat 2
2021-04-15 13:01:13 [MgmtSrvr] WARNING -- Node 11: Node 10 missed heartbeat 3
2021-04-15 13:01:18 [MgmtSrvr] INFO -- Node 11 disconnected in recv with errnum: 104 in state: 0
2021-04-15 13:01:18 [MgmtSrvr] ALERT -- Node 11: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.
2021-04-15 13:01:18 [MgmtSrvr] ALERT -- Node 1: Node 11 Disconnected
2021-04-15 13:01:19 [MgmtSrvr] ALERT -- Node 10: Forced node shutdown completed. Occurred during startphase 0. Initiated by signal 11.