Mysql using 10GB more in ps aux than in MysqlTuner
Posted by: Trebonius -
Date: December 10, 2017 04:58AM

I've been using MySQL 5.7.20 on Ubuntu 16.04.2 for a while and I've noticed that it currently uses far too much memory than what I would expect. I have around 700 tables which are all **MyISAM**.

I've a 128GB RAM server (which uses the memory to do other stuff) and the MySQL memory usage is around 51GB. Here is what `ps aux | grep mysql` gives me

> mysql 7306 105 41.2 63640784 54426684 ? Ssl Dec06 5272:34 /usr/sbin/mysqld

I would expect to be more around 40GB. When I start MySQLTuner, I get the following

`[--] Physical Memory : 125.8G
[--] Max MySQL memory : 42.4G
[--] Other process memory: 43.8G
[--] Total buffers: 40.2G global + 8.8M per thread (256 max threads)
[--] P_S Max memory usage: 72B
[--] Galera GCache Max memory usage: 0B
[OK] Maximum reached memory usage: 42.4G (33.68% of installed RAM)
[OK] Maximum possible memory usage: 42.4G (33.67% of installed RAM)
`

This confuses me since it says that the max mysql memory is 42.4GB, whereas when I do my `ps aux` I have almost 10GB more!

Finally here is my mysqld.conf file

#
# The MySQL database server configuration file.
#
# You can copy this to one of:
# - "/etc/mysql/my.cnf" to set global options,
# - "~/.my.cnf" to set user-specific options.
#
# One can use all long options that the program supports.
# Run program with --help to get a list of available options and with
# --print-defaults to see which it would actually understand and use.
#
# For explanations see
# http://dev.mysql.com/doc/mysql/en/server-system-variables.html

# This will be passed to all mysql clients
# It has been reported that passwords should be enclosed with ticks/quotes
# escpecially if they contain "#" chars...
# Remember to edit /etc/mysql/debian.cnf when changing the socket location.

# Here is entries for some specific programs
# The following values assume you have at least 32M ram

[mysqld_safe]
socket = /var/run/mysqld/mysqld.sock
nice = 0

[mysqld]
#
# * Basic Settings
#
user = mysql
pid-file = /var/run/mysqld/mysqld.pid
socket = /var/run/mysqld/mysqld.sock
port = 3306
basedir = /usr
datadir = /var/lib/mysql
tmpdir = /tmp
lc-messages-dir = /usr/share/mysql
skip-external-locking

#
# Instead of skip-networking the default is now to listen only on
# localhost which is more compatible and is not less secure.
bind-address = 127.0.0.1
#
# * Fine Tuning
#
key_buffer_size = 36G
max_allowed_packet = 64M
tmp_table_size = 4G
max_heap_table_size = 4G
max_connections = 256
table_open_cache = 16384
bulk_insert_buffer_size = 512M
thread_stack = 192K
thread_cache_size = 8
sort_buffer_size = 8M
myisam_sort_buffer_size = 8M

# This replaces the startup script and checks MyISAM tables if needed
# the first time they are touched
myisam-recover-options = BACKUP
#max_connections = 100
#table_cache = 64
#thread_concurrency = 10
#
# * Query Cache Configuration
#
query_cache_limit = 1M
query_cache_size = 16M
#
# * Logging and Replication
#
# Both location gets rotated by the cronjob.
# Be aware that this log type is a performance killer.
# As of 5.1 you can enable the log at runtime!
#general_log_file = /var/log/mysql/mysql.log
#general_log = 1
#
# Error log - should be very few entries.
#
log_error = /var/log/mysql/error.log
#
# Here you can see queries with especially long duration
#slow_query_log=1
#slow_query_log_file=/var/log/mysql/slow-query.log
#long_query_time=1
#log-queries-not-using-indexes
#
# The following can be used as easy to replay backup logs or for replication.
# note: if you are setting up a replication slave, see README.Debian about
# other settings you may need to change.
#server-id = 1
#log_bin = /var/log/mysql/mysql-bin.log
expire_logs_days = 10
max_binlog_size = 100M
#binlog_do_db = include_database_name
#binlog_ignore_db = include_database_name
#
# * InnoDB
#
# InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/.
# Read the manual for more InnoDB related options. There are many!
#
# * Security Features
#
# Read the manual, too, if you want chroot!
# chroot = /var/lib/mysql/
#
# For generating SSL certificates I recommend the OpenSSL GUI "tinyca".
#
# ssl-ca=/etc/mysql/cacert.pem
# ssl-cert=/etc/mysql/server-cert.pem
# ssl-key=/etc/mysql/server-key.pem
[isamchk]
key_buffer_size = 36G
sort_buffer_size = 1G
read_buffer = 4M
write_buffer = 4M

Could you help me understanding where those missing 10GB are coming from, and how can I reclaim them ?

Thanks for your help !

Options: ReplyQuote


Subject
Written By
Posted
Mysql using 10GB more in ps aux than in MysqlTuner
December 10, 2017 04:58AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.