MySQL Forums
Forum List  »  Newbie

slow csv import
Posted by: Andy Sarroff
Date: November 14, 2009 04:12PM

Hello,


I am not that familiar with proper MYSQL usage, so I am probably doing something wrong here. Some friendly advice would be greatly appreciated:

I am importing a .csv file with approx 1.1 million lines and 8 columns into this table:

+---------------+-----------------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+---------------+-----------------------+------+-----+---------+----------------+
| index | mediumint(8) unsigned | NO | PRI | NULL | auto_increment |
| sampleTimeMs | int(10) unsigned | YES | | NULL | |
| joystickX | smallint(5) unsigned | YES | | NULL | |
| joystickY | smallint(5) unsigned | YES | | NULL | |
| dotX | smallint(5) unsigned | YES | | NULL | |
| dotY | smallint(5) unsigned | YES | | NULL | |
| errorFlag | bit(1) | NO | | | |
| responseIndex | mediumint(8) unsigned | NO | | | |
+---------------+-----------------------+------+-----+---------+----------------+
8 rows in set (0.11 sec)

I am using the phpmyadmin graphical interface, my connection is via a ssh tunnel and the .csv file is an uncompressed 55.7 MB in size. This import has been running for approximately 20 hours and is only about half way done. I am wondering if this is strange to take so long. Is there a better way to import this data? Any advice is greatly appreciated and if any more info is needed from me, please let me know!

Thanks,
--Andy

Options: ReplyQuote


Subject
Written By
Posted
slow csv import
November 14, 2009 04:12PM
November 16, 2009 03:19AM
December 11, 2009 03:01AM
November 16, 2009 05:58AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.