MySQL Forums
Forum List  »  InnoDB

Re: High concurrency for master and high reading from slave slowing down insert
Posted by: Peter Brawley
Date: June 20, 2017 12:22PM

For huge Inserts on a system with lots of RAM and multiple cores, innodb_read_io_threads = 64 etc is worth a try. No guarantees.

The Java API may be a bottleneck. Have you tested its capacity? Remember that presorting bulk inserts on the PK does speed things up.

Bill Karwin's piece at https://www.slideshare.net/billkarwin/load-data-fast is a pretty good real-world summary of bulk insert benchmarking. You might want to rework someof his scripts for Java and see how they do on your system.

I doubt replication will help.

Options: ReplyQuote


Subject
Views
Written By
Posted
Re: High concurrency for master and high reading from slave slowing down insert
35
June 20, 2017 12:22PM


Sorry, only registered users may post in this forum.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.