MySQL Forums
Forum List  »  NDB clusters

memory calculations and configurations in cluster
Posted by: pradeep chandru
Date: May 10, 2006 05:59AM

hi all,
I am setting up a clustering environment with 2 data nodes. I have machines each having 4GB RAM. i have a database of size less than 2 GB in MyISAM (including .MYI and .MYD) files.

Is there some thumb rule that tells me how much should i allocate to DataMemory.

I find issues when imporing data. I initially was getting issues with index memory with iterations i was able to solve it. Now when i insert record i am getting errors saying no sufficient memory decrease some configuration parameters.

import quits in the middle most of the time saying any one of these errors:

perror --ndb 410
NDB error code 410: REDO log files overloaded, consult online manual (decrease TimeBetweenLocalCheckpoints, and|or increase NoOfFragmentLogFiles): Temporary error: Overload error

perror --ndb 2327
NDB error code 2327: Memory allocation failure, please decrease some configuration parameters: Permanent error, external action needed: Configuration error

pls let me know how can i find the apt configurations. Is there some utility to tell me how much memory i am using for mysql cluster with splitup of data and index memory.

My config.ini is as follows.

config.ini
---------------
# Options affecting ndbd processes on all data nodes:

[NDBD DEFAULT]

NoOfReplicas=2 # Number of replicas
DataMemory=1200M # How much memory to allocate for data storage
IndexMemory=700M # How much memory to allocate for index storage
# For DataMemory and IndexMemory, we have used the
# default values. Since the "world" database takes up
# only about 500KB, this should be more than enough for
# this example Cluster setup.
#MaxNoOfIndexes=512

# TCP/IP options:
[TCP DEFAULT]
portnumber=2202 # This the default; however, you can use any
# port that is free for all the hosts in cluster
# Note: It is recommended beginning with MySQL 5.0 that
# you do not specify the portnumber at all and simply allow
# the default value to be used instead

# Management process options:
[NDB_MGMD]
hostname=192.168.1.103 # Hostname or IP address of MGM node
#datadir=/var/lib/mysql-cluster # Directory for MGM node logfiles

# Options for data node "A":
[NDBD]
# (one [NDBD] section per data node)
hostname=192.168.1.101 # Hostname or IP address
#datadir=/mysql/data/testdata # Directory for this data node's datafiles
datadir=/var/lib/mysql-cluster
#datadir=/usr/local/mysql/data
#MaxNoOfIndexes=512
MaxNoOfUniqueHashIndexes=500
MaxNoOfOrderedIndexes=500
MaxNoOfAttributes=5000
MaxNoOfConcurrentOperations=10000000
#NoOfFragmentLogFiles=8

# Options for data node "B":
[NDBD]
hostname=192.168.1.102 # Hostname or IP address
#datadir=/mysql/data/testdata # Directory for this data node's datafiles
datadir=/var/lib/mysql-cluster
#datadir=/usr/local/mysql/data
#MaxNoOfIndexes=512
MaxNoOfUniqueHashIndexes=500
MaxNoOfOrderedIndexes=500
MaxNoOfAttributes=5000
MaxNoOfConcurrentOperations=10000000
#NoOfFragmentLogFiles=8

# SQL node options:
[MYSQLD]
hostname=192.168.1.102 # Hostname or IP address
# (additional mysqld connections can be
# specified for this node for various
# purposes such as running ndb_restore)
[MYSQLD]
hostname=192.168.1.101 # Hostname or IP address


Regards,
N.PradeepChandru.

Options: ReplyQuote


Subject
Views
Written By
Posted
memory calculations and configurations in cluster
2648
May 10, 2006 05:59AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.