Skip navigation links

MySQL Forums :: Partitioning :: Partition problem (Data striping)

Advanced Search

Re: Partition problem (Data striping)
Posted by: Rick James ()
Date: April 13, 2012 04:49PM

> Its a bit of a rant
I would say it is a bit of a "rut". You have decided that I/O is the problem, and you have decided on how to solve it. My job is to get you to back up and question all of your assumptions...

> But I need more performance out of them, and the rows need to be on a separate disk,...
You are assuming your OS and device drivers will do anything in parallel. That is a big assumption!

> at best I get 100 a second on my hdds
Yeah, that's all you can get on standard hardware.

> there are millions to be updated
Do they have to be updated _now_? Or can they be delayed? Or batched? Or accumulated from a log? Or kept in RAM?

Have you tuned your cache?-- see

InnoDB? If so, please provide SHOW STATUS LIKE 'innodb%'; -- some settings have a big impact on disk hits. Are you using transactions? autocommit=1?

Are the rows to be updated "clustered" at all? That is, could they be "near" each other on disk?

Edited 1 time(s). Last edit at 04/13/2012 04:50PM by Rick James.

Options: ReplyQuote

Subject Views Written By Posted
Partition problem (Data striping) 1895 Randy Roadax 04/10/2012 07:09PM
Re: Partition problem (Data striping) 968 Rick James 04/12/2012 07:02PM
Re: Partition problem (Data striping) 1097 Randy Roadax 04/12/2012 08:30PM
Re: Partition problem (Data striping) 1022 Rick James 04/13/2012 04:49PM
Re: Partition problem (Data striping) 1107 Randy Roadax 04/13/2012 06:18PM
Re: Partition problem (Data striping) 1141 Mattias Jonsson 04/13/2012 08:08AM
Re: Partition problem (Data striping) 1178 Randy Roadax 04/13/2012 03:20PM
Re: Partition problem (Data striping) 1183 Mattias Jonsson 04/13/2012 04:17PM
Re: Partition problem (Data striping) 1099 Randy Roadax 04/13/2012 04:36PM
Re: Partition problem (Data striping) 1008 Mattias Jonsson 04/14/2012 05:25PM

Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.