MySQL Forums
Forum List  »  Partitioning

Re: Partitioning help
Posted by: Rick James
Date: September 25, 2010 01:09PM

It will be tight, but probably possible. Here are some issues...

Writing 10GB/hour to a disk is pushing the limits. Hardware RAID with buffering and striping would help.

How many rows per second? Can you batch up the rows? A batched insert of 100-1000 rows will work much faster than individual inserts.

What do you mean by 0.05s?

Indexes could kill the project; please SHOW CREATE TABLE. We need to discuss the indexes in more detail. Along with that, we need to discuss the ultimate SELECTs.

What will be done with the data? Can it be summarized _before_ inserting it? If so, let's focus on how to do that efficiently. You may not need to keep the data that long, or perhaps not in a bug table, or perhaps not at all.

Otherwise, PARTITION with either MyISAM or InnoDB, together with ALTER PARTITION to drop partitions after a few days, should work nicely.

How much disk space do you have? Sounds like you need a few terabytes!

MyISAM is usually 2x-3x smaller than InnoDB, so you may have to go with MyISAM.

Options: ReplyQuote


Subject
Views
Written By
Posted
3237
September 24, 2010 02:16AM
Re: Partitioning help
1730
September 25, 2010 01:09PM
1701
September 27, 2010 03:43AM
1664
September 27, 2010 07:55PM
1619
October 12, 2010 01:55AM
1611
October 12, 2010 08:03AM
1535
October 13, 2010 03:27AM
1572
October 13, 2010 06:03PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.