Skip navigation links

MySQL Forums :: Partitioning :: Partition problem (Data striping)


Advanced Search

Re: Partition problem (Data striping)
Posted by: Rick James ()
Date: April 13, 2012 04:49PM

> Its a bit of a rant
I would say it is a bit of a "rut". You have decided that I/O is the problem, and you have decided on how to solve it. My job is to get you to back up and question all of your assumptions...

> But I need more performance out of them, and the rows need to be on a separate disk,...
You are assuming your OS and device drivers will do anything in parallel. That is a big assumption!

> at best I get 100 a second on my hdds
Yeah, that's all you can get on standard hardware.

> there are millions to be updated
Why?
Do they have to be updated _now_? Or can they be delayed? Or batched? Or accumulated from a log? Or kept in RAM?

Have you tuned your cache?-- see http://mysql.rjweb.org/doc.php/memory

InnoDB? If so, please provide SHOW STATUS LIKE 'innodb%'; -- some settings have a big impact on disk hits. Are you using transactions? autocommit=1?

Are the rows to be updated "clustered" at all? That is, could they be "near" each other on disk?



Edited 1 time(s). Last edit at 04/13/2012 04:50PM by Rick James.

Options: ReplyQuote


Subject Views Written By Posted
Partition problem (Data striping) 1686 Randy Roadax 04/10/2012 07:09PM
Re: Partition problem (Data striping) 835 Rick James 04/12/2012 07:02PM
Re: Partition problem (Data striping) 977 Randy Roadax 04/12/2012 08:30PM
Re: Partition problem (Data striping) 882 Rick James 04/13/2012 04:49PM
Re: Partition problem (Data striping) 988 Randy Roadax 04/13/2012 06:18PM
Re: Partition problem (Data striping) 1009 Mattias Jonsson 04/13/2012 08:08AM
Re: Partition problem (Data striping) 1029 Randy Roadax 04/13/2012 03:20PM
Re: Partition problem (Data striping) 1025 Mattias Jonsson 04/13/2012 04:17PM
Re: Partition problem (Data striping) 951 Randy Roadax 04/13/2012 04:36PM
Re: Partition problem (Data striping) 875 Mattias Jonsson 04/14/2012 05:25PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.