Re: What is a best way to load large amount of data?
I see. Thank you Adam.
The reason I asked I had problems to load a table with 1 mln rows by "ALTER TABLE" and by "INSERT .. SELECT" methods.
Always got errors like "REDO is not enough. Decrease TimeBetweenLocalCheckpoints or|and increase NoOfFragmentLogFiles."
and even "unknown error".
I decreased TimeBetweenLocalCheckpoints, increased NoOfFragmentLogFiles - but no luck.
My config.ini just in case.
Quote
[NDBD DEFAULT]
NoOfReplicas=1
DataMemory=2000M
IndexMemory=200M
MaxNoOfConcurrentOperations=200000
NoOfFragmentLogFiles=16
# 18 - 1Mb; 19 - 2Mb; 20 - 4Mb ...
TimeBetweenLocalCheckpoints=17
#TimeBetweenGlobalCheckpoints = 1500
RedoBuffer=256M
#NoOfDiskPagesToDiskAfterRestartTUP = 175
#NoOfDiskPagesToDiskAfterRestartACC = 80
[MYSQLD DEFAULT]
[NDB_MGMD DEFAULT]
[TCP DEFAULT]
# Managment Server
[NDB_MGMD]
# the IP of THIS SERVER
HostName=192.168.0.21
# Storage Engines
[NDBD]
I have vorked it around by a procedure with "loop fetch; insert; end loop;"
It worked fine and quite fast.
Subject
Views
Written By
Posted
1723
May 03, 2006 04:00AM
1164
May 03, 2006 06:12PM
Re: What is a best way to load large amount of data?
1252
May 04, 2006 01:05PM
1287
May 04, 2006 01:46PM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion
of Oracle or any other party.