MySQL Forums
Forum List  »  Performance

mysqlimport get very slow for large files
Posted by: Jun Zhang
Date: August 03, 2012 09:44AM

I use a command like
mysqlimport --local homo_sapiens_variation_67_37 t1.txt
had t1.txt 24G, and the command finished in a few hours, which is OK.
Now t2.txt is 33G in size, I ran the same command, so far it's been two days, the process is still running. I noticed that the file t2.MYI is about 40G, and growing with a rate about 10M/s. Another fact is that t2.MYI grew to the size of the t2.txt in only a few hours.

The system memory report
# free -m
total used free shared buffers cached
Mem: 64544 63811 733 0 128 56409
-/+ buffers/cache: 7272 57271
Swap: 66607 495 66112

CPU has high percentage idle

Anybody know about this? I have two big table waiting to be imported, one of the txt file is 133G, the other is 245G.

Jun

Options: ReplyQuote


Subject
Views
Written By
Posted
mysqlimport get very slow for large files
6305
August 03, 2012 09:44AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.