Re: Slow Inserts

[Vince Gatto]

This approach is similar to what I'm using right now. If your staging table has indexes, building those indexes could be slowing you down. Since you'll likely be doing a table scan during your insert select, indexes probably won't be of much help. If you do need indexes on your staging table, make sure that you've already sorted the data before insert. You might also try dumping the data to file and loading using LOAD DATA INFILE. Also, simple UNIX tools like sort and uniq can outperform MySQL in some scenarios, so if you're going to dump to disk, you can sort the data and remove duplicates before you load it into MySQL.