MySQL Forums
Forum List  »  NDB clusters

Unknown file system error during ndbd restart (MySQL Cluster)
Posted by: Jérémie Soria
Date: January 23, 2014 09:43AM

Hello,

I built a MySQL Cluster 7.3.3 setup with:
2 datanodes
2 management nodes
2 API nodes

I noticed that when I try restarting a datanode (either through the ndb_mgm admin tool restart or stop and manual launch) I systematically get the following error:
Node 31: Forced node shutdown completed. Occured during startphase 5. Caused by error 2813: 'Unknown file system error(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.

In the error log of the datanode I have:
Status: Temporary error, restart node
Message: Unknown file system error (Internal error, programming error or missing error message, please report a bug)
Error: 2813
Error data: RESTORE: File system read failed. OS errno: 1
Error object: RESTORE (Line: 3649) 0x00000002
Program: ndbd
Pid: 14496
Version: mysql-5.6.14 ndb-7.3.3
Trace: /var/lib/mysql/ndbcluster/data-node/ndb_31_trace.log.13 [t1..t1]

To "fix" it I need to do an --initial start of the ndbd, but even then, if I try to restart it, I will have the same error.

Do any of you have an idea about that ?

Here are my config files:

------ my.cnf ------

[mysqld]
ndbcluster # run NDB storage engine
port=3307 #non-standard port will be change to 3306 after migration is complete
socket=/var/lib/mysql/ndbcluster/mysql-cluster.sock #non-standard to avoid conflict with legacy mysql server

[mysql_cluster]
ndb-connectstring=10.0.0.9,10.0.0.10 #Location of management servers, order imports



------ config.ini ------

[tcp default]
SendBufferMemory=2M
ReceiveBufferMemory=2M

[ndbd default]
# Options affecting ndbd processes on all data nodes:
NoOfReplicas=2 # Number of replicas
DataMemory=3000M # How much memory to allocate for data storage
IndexMemory=512M # How much memory to allocate for index storage
datadir=/var/lib/mysql/ndbcluster/data-node # Directory for this data node's data files

#OS-level options for scheduling and disk IO
ODirect=1
CompressedLCP=1
CompressedBackup=1
SchedulerSpinTimer=400
SchedulerExecutionTimer=100
RealTimeScheduler=1

#Options for sql databases
MaxNoOfConcurrentOperations=100000
MaxNoOfTables=512
MaxNoOfOrderedIndexes=512
MaxNoOfUniqueHashIndexes=256
MaxNoOfAttributes=1200
MaxNoOfTriggers=2000
MaxBufferedEpochs=10000
TimeBetweenEpochs=200
TransactionDeadlockDetectionTimeout=100000
HeartbeatIntervalDbDb=3000
HeartbeatIntervalDbApi=3000

[ndb_mgmd default]
datadir=/var/lib/mysql-cluster/logs #Directory for MGM node log files

[ndb_mgmd]
hostname=10.0.0.9
NodeId=41

[ndb_mgmd]
hostname=10.0.0.10
NodeId=42

[ndbd]
hostname=10.0.0.5
NodeId=31
ServerPort=50501

[ndbd]
hostname=10.0.0.11
NodeId=32
ServerPort=50502

[mysqld]
hostname=10.0.0.5
NodeId=51

[mysqld]
hostname=10.0.0.11
NodeId=52



Edited 1 time(s). Last edit at 01/23/2014 09:45AM by Jérémie Soria.

Options: ReplyQuote


Subject
Views
Written By
Posted
Unknown file system error during ndbd restart (MySQL Cluster)
2962
January 23, 2014 09:43AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.