MySQL Forums
Forum List  »  Connector/Python

Large Volume queries hang
Posted by: David Butt
Date: May 15, 2007 03:11AM

Hi I'm using Python and MySQL to copy large tables.

The code batches copies up into sets of 10,000 rows and copies them in to a new table which is an exact copy of the old table.

This all works fine up to about 1,000,000 rows, and then it gets slower and slower and eventually hangs around the 3,000,000th row. "top" doesn't seem to show any lack of resources, and it's not thrashing the processor.

I'm running MySQL 4.1.15 with Python 2.5. On Linux. The script is very simple and does the copies using a "INSERT INTO x SELECT FROM y" style query.

Is there some kind of limitation of the MySQL / Python combination that could explain this?
Thanks

Options: ReplyQuote


Subject
Written By
Posted
Large Volume queries hang
May 15, 2007 03:11AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.