Skip navigation links

MySQL Forums :: Partitioning :: Partition problem (Data striping)

Advanced Search

Re: Partition problem (Data striping)
Posted by: Rick James ()
Date: April 13, 2012 04:49PM

> Its a bit of a rant
I would say it is a bit of a "rut". You have decided that I/O is the problem, and you have decided on how to solve it. My job is to get you to back up and question all of your assumptions...

> But I need more performance out of them, and the rows need to be on a separate disk,...
You are assuming your OS and device drivers will do anything in parallel. That is a big assumption!

> at best I get 100 a second on my hdds
Yeah, that's all you can get on standard hardware.

> there are millions to be updated
Do they have to be updated _now_? Or can they be delayed? Or batched? Or accumulated from a log? Or kept in RAM?

Have you tuned your cache?-- see

InnoDB? If so, please provide SHOW STATUS LIKE 'innodb%'; -- some settings have a big impact on disk hits. Are you using transactions? autocommit=1?

Are the rows to be updated "clustered" at all? That is, could they be "near" each other on disk?

Edited 1 time(s). Last edit at 04/13/2012 04:50PM by Rick James.

Options: ReplyQuote

Subject Views Written By Posted
Partition problem (Data striping) 1800 Randy Roadax 04/10/2012 07:09PM
Re: Partition problem (Data striping) 904 Rick James 04/12/2012 07:02PM
Re: Partition problem (Data striping) 1039 Randy Roadax 04/12/2012 08:30PM
Re: Partition problem (Data striping) 958 Rick James 04/13/2012 04:49PM
Re: Partition problem (Data striping) 1045 Randy Roadax 04/13/2012 06:18PM
Re: Partition problem (Data striping) 1079 Mattias Jonsson 04/13/2012 08:08AM
Re: Partition problem (Data striping) 1104 Randy Roadax 04/13/2012 03:20PM
Re: Partition problem (Data striping) 1103 Mattias Jonsson 04/13/2012 04:17PM
Re: Partition problem (Data striping) 1033 Randy Roadax 04/13/2012 04:36PM
Re: Partition problem (Data striping) 944 Mattias Jonsson 04/14/2012 05:25PM

Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.