mysqlimport get very slow for large files
Posted by:
Jun Zhang
Date: August 03, 2012 09:44AM
I use a command like
mysqlimport --local homo_sapiens_variation_67_37 t1.txt
had t1.txt 24G, and the command finished in a few hours, which is OK.
Now t2.txt is 33G in size, I ran the same command, so far it's been two days, the process is still running. I noticed that the file t2.MYI is about 40G, and growing with a rate about 10M/s. Another fact is that t2.MYI grew to the size of the t2.txt in only a few hours.
The system memory report
# free -m
total used free shared buffers cached
Mem: 64544 63811 733 0 128 56409
-/+ buffers/cache: 7272 57271
Swap: 66607 495 66112
CPU has high percentage idle
Anybody know about this? I have two big table waiting to be imported, one of the txt file is 133G, the other is 245G.
Jun
Subject
Views
Written By
Posted
mysqlimport get very slow for large files
6315
August 03, 2012 09:44AM
4242
August 03, 2012 11:04AM
2312
August 03, 2012 03:06PM
1983
August 04, 2012 04:35AM
1998
August 07, 2012 08:12AM
1638
August 07, 2012 08:39AM
2089
August 07, 2012 10:21AM
1575
August 05, 2012 08:58AM
1455
August 07, 2012 11:07AM
1871
August 08, 2012 08:34AM
1339
August 08, 2012 04:19PM
2982
August 09, 2012 04:15AM
1655
August 09, 2012 07:37PM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion
of Oracle or any other party.