MySQL Forums
Forum List  »  CSV Storage Engine

Can't load huge CSV file
Posted by: Fabian Pinzon
Date: August 16, 2012 04:42AM

Hello,

My problem is a little bit complicated to understand. I have a csv file (27M) with more than 1048576 lines.

Firstly, I've tried to load it in a temporal table I've created in mySQl, but when I excecute the follow instruction in MySQL QUery Browser:

"LOAD DATA LOCAL INFILE 'file.csv'
INTO TABLE Temp FIELDS TERMINATED BY ','
LINES TERMINATED BY '\r\n' IGNORE 1 LINES (column1,column2,column3,Column4,Column5,Column6)"

The result is "Query Returned no Resulset".

Secondly, I've opened the file with Excel (obviously, Excel has told me that is not possible to load the whole file) and I've saved it with only 1048576 lines. Then, when I tried to load the new file again, it works!!!

I've changed the max_allowed_packet=100M but definitely it doesn't work.

I've tried delete rows in notepad and I've let the file with 1048576 lines but still doesn't work. It seems that Excel "add something" to the file.

I hope you understand.

Options: ReplyQuote


Subject
Views
Written By
Posted
Can't load huge CSV file
4697
August 16, 2012 04:42AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.