MySQL Forums
Forum List  »  Partitioning

Re: Partitioning help
Posted by: Rick James
Date: September 25, 2010 01:09PM

It will be tight, but probably possible. Here are some issues...

Writing 10GB/hour to a disk is pushing the limits. Hardware RAID with buffering and striping would help.

How many rows per second? Can you batch up the rows? A batched insert of 100-1000 rows will work much faster than individual inserts.

What do you mean by 0.05s?

Indexes could kill the project; please SHOW CREATE TABLE. We need to discuss the indexes in more detail. Along with that, we need to discuss the ultimate SELECTs.

What will be done with the data? Can it be summarized _before_ inserting it? If so, let's focus on how to do that efficiently. You may not need to keep the data that long, or perhaps not in a bug table, or perhaps not at all.

Otherwise, PARTITION with either MyISAM or InnoDB, together with ALTER PARTITION to drop partitions after a few days, should work nicely.

How much disk space do you have? Sounds like you need a few terabytes!

MyISAM is usually 2x-3x smaller than InnoDB, so you may have to go with MyISAM.

Options: ReplyQuote


Subject
Views
Written By
Posted
3335
September 24, 2010 02:16AM
Re: Partitioning help
1792
September 25, 2010 01:09PM
1759
September 27, 2010 03:43AM
1738
September 27, 2010 07:55PM
1704
October 12, 2010 01:55AM
1682
October 12, 2010 08:03AM
1596
October 13, 2010 03:27AM
1633
October 13, 2010 06:03PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.