MySQL Forums
Forum List  »  Partitioning

Re: Evolve from Partition to Sharding?
Posted by: Rick James
Date: August 22, 2010 09:02AM

PARTITION makes splitting up the data mostly transparent. Sharding requires that your code do all the work. There are some third party products on the market that makes sharding transparent to you.

Suggest you make an abstraction layer now, before launching into sharding. This layer would receive not the SQL statements, but an abstraction of such. With your current implementation (PARTITION), the layer would turn the abstract request simply into SQL and hit your one table.

Once you have debugged that, then consider sharding. Now, the layer would look at the tweet_id, hash it to decide which server to hit connect to _that_ server, and finally issue the SQL.

Options: ReplyQuote


Subject
Views
Written By
Posted
3664
August 21, 2010 04:56AM
Re: Evolve from Partition to Sharding?
1648
August 22, 2010 09:02AM
2184
August 23, 2010 12:03AM
1456
August 23, 2010 12:42AM
2296
August 23, 2010 12:48AM
1448
August 23, 2010 09:45PM
1602
August 23, 2010 10:18PM
1640
August 27, 2010 07:41AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.