Re: Performance bottlenecks with thousands of small databases
Posted by: Rick James
Date: March 15, 2014 05:06PM

The real problem is that the operating system bogs down when there are thousands of directories (databases) or thousands of files (tables).

If the tables are small,
innodb_file_per_table = OFF

SHOW VARIABLES LIKE '%open%';
Increasing the values of these _may_ help:
| innodb_open_files | 2048 |
| open_files_limit | 5000 |
| table_open_cache | 2048 |
Your values may be excessive:
open_files_limit=65535
innodb_open_files=65535
table_open_cache=32768
table_definition_cache=65535
(I don't know if making those too large causes trouble.)

Increasing this may help avoid connection failurs:
connect_timeout=10

> hardware is virtualized

That takes a toll.

query_cache_type=1
query_cache_limit=4M
query_cache_size=512M
Those are really bad! Whenever a write occurs, all 512MB must be scanned to see what needs purging. Decrease that to no more than 50M.

innodb_flush_log_at_trx_commit=1
Changing to 2 may help some.

Options: ReplyQuote




Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.