Re: Partitioning

[Ahmad Sakhi]

Thanks Rick. Really appreciate it.

This table is mainly and only for lookup (SELECT), through the application.

There could be INSERTS, but that would happen outside the application and could be extremely rare. And certainly no DELETE. Again, if there's any at all, then it would be outside the application and very very rarely.

So, if I understood correctly, the better option would be plan B. Because my WHERE clause will always contain URI_CM='String value.

A side question: I am just thinking a head of myself on how to effeciently load these data from these set of CSV files?

I can put this script in a shell script to loop through my folder and sweep all CSV files and load one by one. But, there are around 9 MILLION CSV files. I am wondering if this is my only option? And if there are any advise and suggestion I need to take into considerations. Thanks again Rick. Appreciate it.





mysql -uadmin -ppassword --local_infile=1 mydb -e "LOAD DATA LOCAL INFILE 'C:\DATA\file_0001.csv' INTO TABLE book_tbl FIELDS TERMINATED BY '\t' (ID,SCORE,URI_CM,URI,START_CM,END_CM,TEXT_1,TEXT_2)"