MySQL Forums
Forum List  »  Performance

Re: loading data infile incredibly slow
Posted by: jason rickabaugh
Date: June 04, 2005 04:57PM

Whooo there, that's alot of data it is going to take some time.
Ok couple things when loading this much data you need to shut off index uniqueness checks(primary keys) and logging.
That should fix alot of your overhead problems. What I usually do is create the tables then add the indexes.

SET SQL_LOG_BIN=0;
set UNIQUE_CHECKS=0;

If you don't disable logging and index checking you may want to consider starting the dataload then taking some time off visit the folks see the world you know......

Also if you are using innodb make sure that the ib_file is large enough to accomidate the data before you load it. There are some settings in /etc/my.cnf to make these changes. Not sure how it works in myisam

Options: ReplyQuote


Subject
Views
Written By
Posted
Re: loading data infile incredibly slow
1442
June 04, 2005 04:57PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.