MySQL Forums
Forum List  »  Performance

Re: 350+ million rows -- is this as fast as it can get? (too slow at the moment!)
Posted by: lau ch
Date: February 10, 2009 02:13AM

From my experience, Rick James's mulitple rows insertion in a single insert stetement can help a lot.

In addition, apart from just use one single session to do the insertion, you may also consider use muilt-session/multithread to do the insertion simultanuously. My test result is that it can insert 80M records within 4 hours for a table with ~60 fields plus 5 indexes.

However, I also experience the problem that when the table get larger, the insert rate get slower in a exponential rate. Rick James, do you have any idea for this problem? ("iostat -dx" return 70% io written)


Options: ReplyQuote

Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.