Errors In Ndb Cluster

[cary cai]

Occasional error occurred like the following while inserting a large number of data. The cluster version is 7.3.2 and OS is redhat 5.9.

2014-04-08 13:14:42 17391 [Note] NDB Binlog: Node: 3, down, Subscriber bitmask 00
2014-04-08 13:14:42 17391 [Note] NDB Binlog: Node: 4, down, Subscriber bitmask 00
2014-04-08 13:14:42 17391 [Note] NDB Binlog: cluster failure for ./mysql/ndb_schema at epoch 7289535/37.
2014-04-08 13:14:42 17391 [Note] NDB Binlog: cluster failure for ./mysql/ndb_apply_status at epoch 7289535/37.
2014-04-08 13:14:42 17391 [Note] Restarting Cluster Binlog
2014-04-08 13:14:42 17391 [ERROR] Got error 157 when reading table './wmp_db/t_fas_txn_log_his_04'
2014-04-08 13:14:42 17391 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './wmp_db/t_fas_stl_dtl_log_his_04.frm'
2014-04-08 13:14:42 17391 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './wmp_db/t_fas_stl_dtl_log_his_04.frm'
2014-04-08 13:14:42 17391 [ERROR] Error 4009 in ::get_auto_increment(): Cluster Failure
2014-04-08 13:14:42 17391 [ERROR] /usr/sbin/mysqld: Incorrect information in file: './wmp_db/t_fas_stl_dtl_log_his_04.frm'
2014-04-08 13:14:42 17391 [ERROR] Error 4009 in ::get_auto_increment(): Cluster Failure
2014-04-08 13:14:46 17391 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$mysql/ndb_schema
2014-04-08 13:14:46 17391 [Note] NDB Binlog: logging ./mysql/ndb_schema (UPDATED,USE_WRITE)
2014-04-08 13:14:46 17391 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$mysql/ndb_apply_status
2014-04-08 13:14:46 17391 [Note] NDB Binlog: logging ./mysql/ndb_apply_status (UPDATED,USE_WRITE)
2014-04-08 13:14:46 17391 [Note] NDB: Cleaning stray tables from database 'information_schema'
2014-04-08 13:14:46 17391 [Note] NDB: Cleaning stray tables from database 'wmp_db'
2014-04-08 13:14:46 [NdbApi] INFO -- Flushing incomplete GCI:s < 7289538/1
2014-04-08 13:14:46 [NdbApi] INFO -- Flushing incomplete GCI:s < 7289538/1
2014-04-08 13:14:46 17391 [Note] NDB Binlog: starting log at epoch 7289538/1
2014-04-08 13:14:46 17391 [Note] NDB Binlog: ndb tables writable
2014-04-08 13:14:46 17391 [Note] NDB Binlog: Node: 4, subscribe from node 7, Subscriber bitmask 080
2014-04-08 13:14:46 17391 [Note] NDB Binlog: Node: 3, subscribe from node 7, Subscriber bitmask 080

Who can tell me what happened in my cluster? Thanks



Edited 1 time(s). Last edit at 04/08/2014 02:48AM by cary cai.