Cluster Crashes after

[vamsi krishna]

I am runnning a cluster with 5.0.13 version. my setup has 2 nodes with 4ndbd processes running in each and 2 api nodes.

i was importing one of my old database to this cluster and suddenly all the nodes crashed. The log file on management node shows this error for every node -

2005-10-05 14:59:22 [MgmSrvr] INFO -- Node 31: Possible bug in Dbdih::execBL
OCK_COMMIT_ORD c_blockCommit = 1 c_blockCommitNo = 4 sig->failNo =


the log files on the node shows this -

Date/Time: Wednesday 5 October 2005 - 14:51:32
Type of error: error
Message: Arbitrator shutdown
Fault ID: 2305
Problem data: Arbitrator decided to shutdown this node
Object of reference: QMGR (Line: 3787) 0x0000000a
ProgramName: /opt/mysql/bin/ndbd
ProcessID: 6209
TraceFile: /opt/mysqldata/ndb_31_trace.log.2
Version 5.0.13 (rc)
***EOM***


After this i could restart the nodes only restarting the ndb_mgmd on management server. Then after the nodes have restarted i see that the cluster has crashed as i could not access any of the databases that are there on the cluster.

I dont see any errors messages on the logs files either on the nodes or on the management server. Can anyone please tell me the way to restore these databases. i dont have any backup of them.

This is my config.ini file

[NDBD DEFAULT]
NoOfReplicas=2
[MYSQLD DEFAULT]
[NDB_MGMD DEFAULT]
[TCP DEFAULT]
# Managment Server
[NDB_MGMD]
id=1
HostName=192.168.0.30 # the IP of THIS SERVER
# Storage Engines
[NDBD]
id=10
HostName=192.168.0.32 # the IP of the FIRST SERVER
DataDir= /opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=20
HostName=192.168.0.32 # the IP of the FIRST SERVER
DataDir= /opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=30
HostName=192.168.0.32 # the IP of the FIRST SERVER
DataDir= /opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=40
HostName=192.168.0.32 # the IP of the SECOND SERVER
DataDir=/opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=11
HostName=192.168.0.31 # the IP of the FIRST SERVER
DataDir=/opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=21
HostName=192.168.0.31 # the IP of the FIRST SERVER
DataDir=/opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=31
HostName=192.168.0.31 # the IP of the FIRST SERVER
DataDir=/opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[NDBD]
id=41
HostName=192.168.0.31 # the IP of the FIRST SERVER
DataDir=/opt/mysqldata
DataMemory=900M
IndexMemory=200M
#MaxNoOfIndexes=512
MaxNoOfOrderedIndexes=1024
MaxNoOfUniqueHashIndexes=512
TransactionDeadlockDetectionTimeout=8000
[MYSQLD]
id=50
#HostName=172.20.0.19
[MYSQLD]
id=51
[MYSQLD]
id=52


Regards

Vamsi Krishna