MySQL Forums
Forum List  »  NDB clusters

Errors during 'Initial Load' on NDB cluster
Posted by: Deepak Goel
Date: June 13, 2021 09:52AM

Hello

I have a NDB cluster of (2 data nodes, 2 server nodes). When I put a load of 10000 users on this cluster using Jmeter, I get high number of initial errors (almost 100%). As the test continues, the error rates start dropping. Also the response time comes down.

I am worried how do I solve the initial errors. Can I warm up the NDB cluster, so there are no errors.

Please advise.

Thanks!
Deepak

P.S: My config file for the cluster


[ndbd default]
# Options affecting ndbd processes on all data nodes:
NoOfReplicas=2 # Number of replicas
DataMemory=3500M # How much memory to allocate for data storage
IndexMemory=1000M # How much memory to allocate for index storage
MaxNoOfConcurrentOperations=1048576
MaxNoOfConcurrentTransactions= 1048576
MaxNoOfLocalOperations=1048576
MaxNoOfConcurrentIndexOperations=16384
MaxNoOfConcurrentScans=500

[ndb_mgmd]
# Management process options:
hostname=172.31.92.202 # Hostname of the manager
datadir=/var/lib/mysql-cluster # Directory for the log files

[ndbd]
hostname=172.31.87.159 # Hostname/IP of the first data node
NodeId=2 # Node ID for this data node
datadir=/usr/local/mysql/data # Remote directory for the data files

[ndbd]
hostname=172.31.94.204 # Hostname/IP of the second data node
NodeId=3 # Node ID for this data node
datadir=/usr/local/mysql/data # Remote directory for the data files

[mysqld]
# SQL node options:
hostname=172.31.92.202 # In our case the MySQL server/client is on the same Droplet as the cluster manager
max_connections = 1000000
max_connect_errors=1000000
thread_cache_size=16384
back-log=65535
max_user_connections=1000000
Ndb_cluster_connection_pool=16
ndb_autoincrement_prefetch_sz=65536
table_open_cache=524288

[mysqld]
# SQL node options:
hostname=172.31.25.182 # In our case the MySQL server/client is not on the same Droplet as the cluster manager
max_connections = 1000000
max_connect_errors=1000000
thread_cache_size=16384
back-log=65535
max_user_connections=1000000
Ndb_cluster_connection_pool=16
ndb_autoincrement_prefetch_sz=65536
table_open_cache=524288

Options: ReplyQuote


Subject
Views
Written By
Posted
Errors during 'Initial Load' on NDB cluster
272
June 13, 2021 09:52AM


Sorry, only registered users may post in this forum.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.