mysqlimport get very slow for large files
Posted by:
Jun Zhang
Date: August 03, 2012 09:44AM
I use a command like
mysqlimport --local homo_sapiens_variation_67_37 t1.txt
had t1.txt 24G, and the command finished in a few hours, which is OK.
Now t2.txt is 33G in size, I ran the same command, so far it's been two days, the process is still running. I noticed that the file t2.MYI is about 40G, and growing with a rate about 10M/s. Another fact is that t2.MYI grew to the size of the t2.txt in only a few hours.
The system memory report
# free -m
total used free shared buffers cached
Mem: 64544 63811 733 0 128 56409
-/+ buffers/cache: 7272 57271
Swap: 66607 495 66112
CPU has high percentage idle
Anybody know about this? I have two big table waiting to be imported, one of the txt file is 133G, the other is 245G.
Jun
Subject
Views
Written By
Posted
mysqlimport get very slow for large files
6305
August 03, 2012 09:44AM
4239
August 03, 2012 11:04AM
2308
August 03, 2012 03:06PM
1979
August 04, 2012 04:35AM
1989
August 07, 2012 08:12AM
1632
August 07, 2012 08:39AM
2081
August 07, 2012 10:21AM
1571
August 05, 2012 08:58AM
1449
August 07, 2012 11:07AM
1864
August 08, 2012 08:34AM
1329
August 08, 2012 04:19PM
2979
August 09, 2012 04:15AM
1649
August 09, 2012 07:37PM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion
of Oracle or any other party.