Re: poor performance on load data to NDB

[Andy Kwong]

Thanks for your reply.

I'm using the BASIC config according to the mySQL 5.1 documentation. This is just a test setup so I assume I need to config the cluster correctly.

As for the network, it is gigabit with both 1gb bind together so the effective bandwidth is 2gb between the nodes.

I'm using "LOAD DATA INFILE" to load CSV file into mySQL. I would believe this is bulk and not insert one at a time. I don't think it even considered as a transaction, right?

I'm trying to setup the mySQL cluster as a Highly available SLAVE to the source data. So, I want to take the data to load periodically into mysql. It took 40 mins to load 10 millions row with "LOAD DATA" with NDB engine. I tried again with INNODB, it is less than a minute.

Is there any other way to speed up getting data into an NDB table?



Edited 1 time(s). Last edit at 10/06/2006 08:44AM by Andy Kwong.