Forum for Sharding. http://forums.mysql.com/list.php?170 Wed, 19 Jun 2013 14:46:27 +0000 Phorum 5.2.19 http://forums.mysql.com/read.php?170,576271,576271#msg-576271 http://forums.mysql.com/read.php?170,576271,576271#msg-576271 http://blog.ulf-wendel.de/2012/shard-key-support-and-cache-locality-optimization-support-for-php-mysql-driver/
http://blog.ulf-wendel.de/2011/php-load-balancing-and-sharding-combined-with-mysqlnd/]]> Edwin Desouza Sharding Wed, 19 Dec 2012 00:54:37 +0000 http://forums.mysql.com/read.php?170,569058,569058#msg-569058 http://forums.mysql.com/read.php?170,569058,569058#msg-569058
Regards
Anands]]> Express Meds Sharding Thu, 20 Sep 2012 08:49:26 +0000 http://forums.mysql.com/read.php?170,553506,553506#msg-553506 http://forums.mysql.com/read.php?170,553506,553506#msg-553506
Slides:
https://github.com/tumblr/jetpants/blob/master/doc/VelocityEurope2011Presentation.pdf?raw=true

https://github.com/tumblr/jetpants

OVERVIEW:

Jetpants is an automation toolkit for handling monstrously large MySQL database topologies. It is geared towards common operational tasks like cloning slaves, rebalancing shards, and performing master promotions. It features a command suite for easy use by operations staff, though it’s also a full Ruby library for use in developing custom migration scripts and database automation.

Jetpants supports a range-based sharding scheme for MySQL by providing a fast way to split shards that are approaching capacity or I/O limitations. Jetpants is able to accomplish this without any locking, downtime, data inconsistency, or query failures. Dynamically resizable range-based sharding allows you to scale MySQL horizontally in a sane manner, without any need for a central lookup service or massive pre-allocation of tiny shards.

MOTIVATION:

Jetpants was created by Tumblr to help manage our database infrastructure. It handles automation tasks for our entire database topology, which as of June 2012 consists of approximately:

- 200 dedicated database servers
- 12 global (unsharded) functional pools
- 45 shard pools
- 21 terabytes total of unique relational data on masters
- 60 billion total unique relational rows on masters

One of the primary requirements for Jetpants was speed. On our hardware, Jetpants can divide a 750GB, billion-row shard in half in about six hours – or even faster if you’re diving into thirds or fourths. It can also clone slaves at line speed on gigabit ethernet, including to multiple destinations at once, using a novel “chained copy” approach.]]> Edwin Desouza Sharding Fri, 08 Jun 2012 03:26:25 +0000 http://forums.mysql.com/read.php?170,545664,545664#msg-545664 http://forums.mysql.com/read.php?170,545664,545664#msg-545664 http://www.slideshare.net/ryanthiessen/mysql-conference-2011-the-secret-sauce-of-sharding-ryan-thiessen
https://github.com/tumblr/jetpants/blob/master/doc/VelocityEurope2011Presentation.pdf?raw=true
http://www.slideshare.net/oemebamo/database-sharding-at-netlog
http://www.slideshare.net/RockeTier/database2011-my-sql-sharding
http://www.slideshare.net/RockeTier/how-sharding-turned-mysql-into-the-internet-defacto-database-standard-moshe-kaplan-rocketier
http://www.slideshare.net/guest0e6d5e/sharding-architectures


Blogs:
http://blog.ulf-wendel.de/2012/shard-key-support-and-cache-locality-optimization-support-for-php-mysql-driver/
http://blog.ulf-wendel.de/2011/php-load-balancing-and-sharding-combined-with-mysqlnd/
http://blog.evernote.com/tech/2012/04/26/shard-boiled/
http://mysqldba.blogspot.in/2012/03/mysql-shards-gearman-rabbitmq-nodejs.html
http://blogs.citrix.com/2011/07/15/db-sharding-with-netscaler-datastream/


Projects:
https://github.com/tumblr/jetpants
https://github.com/twitter/gizzard
http://code.google.com/p/shard-query/
http://www.slideshare.net/datacharmer/sharding-for-the-masses
http://www.slideshare.net/Kentoku/spider-muc2010-20100414
https://github.com/tchandy/octopus/wiki/Sharding
http://www.slideshare.net/tchandy/projeto-octopus-database-sharding-para-activerecord
http://kovyrin.github.com/db-charmer/#sharding]]> Edwin Desouza Sharding Fri, 01 Jun 2012 01:24:21 +0000