MySQL Forums
Forum List  »  NDB clusters

Re: What is a best way to load large amount of data?
Posted by: Mark Malakanov
Date: May 04, 2006 01:05PM

I see. Thank you Adam.

The reason I asked I had problems to load a table with 1 mln rows by "ALTER TABLE" and by "INSERT .. SELECT" methods.
Always got errors like "REDO is not enough. Decrease TimeBetweenLocalCheckpoints or|and increase NoOfFragmentLogFiles."
and even "unknown error".
I decreased TimeBetweenLocalCheckpoints, increased NoOfFragmentLogFiles - but no luck.

My config.ini just in case.
Quote

[NDBD DEFAULT]
NoOfReplicas=1
DataMemory=2000M
IndexMemory=200M
MaxNoOfConcurrentOperations=200000
NoOfFragmentLogFiles=16
# 18 - 1Mb; 19 - 2Mb; 20 - 4Mb ...
TimeBetweenLocalCheckpoints=17
#TimeBetweenGlobalCheckpoints = 1500
RedoBuffer=256M
#NoOfDiskPagesToDiskAfterRestartTUP = 175
#NoOfDiskPagesToDiskAfterRestartACC = 80

[MYSQLD DEFAULT]
[NDB_MGMD DEFAULT]
[TCP DEFAULT]

# Managment Server
[NDB_MGMD]
# the IP of THIS SERVER
HostName=192.168.0.21

# Storage Engines
[NDBD]

I have vorked it around by a procedure with "loop fetch; insert; end loop;"
It worked fine and quite fast.

Options: ReplyQuote


Subject
Views
Written By
Posted
Re: What is a best way to load large amount of data?
1252
May 04, 2006 01:05PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.