MySQL Forums
Forum List  »  Performance

High load average (MySQL 5.6.16)
Posted by: Peter Wells
Date: February 19, 2014 05:24AM

Hi all. I've been reading this forums for years, and until now I've solved every problem related to MySQl since version 4. But now I'm stuck and so this is my first post here. Thanks to everyone in advance.

I run a machine with MySQL 5.6.16 and Tomcat 7.0.35. The traffic is around 50000 daily pageviews, 25000 daily unique visitors. Apart from serving pages, there are complex applications that do background, parallel processing in the database.

Machine specs
-------------

2xCPU E5-2630 2.3 ghz (12 physical cores, 24 logical cores), 32GB RAM, 4x600GB SAS in RAID 10, Red Hat Enterprise Linux 6.4

The problem
-----------

Load average is high, around 10. Iowait between 5%-15%. I don't know the reason. I thought it could be queries without indexes, but it doesn't seem to be that (see below). Almost every query is using indexes, with the exception of some UNION ALL that are infrequent.

[EDITED]

I disabled PERFORMANCE_SCHEMA option, and there is no big difference. When restarting the MySQL server, load average goes 20 and even 30, and performance is very bad (lots of simple queries taking ages to finish). After 15 minutes everything becomes stable.

Yesterday I saw load average of 2-3, surprisingly slow, in the maximum load of the server (350 current users). After that (maybe 2-3 hours) it went up to 10 again.

Load average has been increased in the last weeks.

top - 10:21:41 up 174 days, 18:24, 1 user, load average: 10.60, 9.31, 8.60
Tasks: 637 total, 1 running, 635 sleeping, 0 stopped, 1 zombie
Cpu(s): 6.5%us, 0.6%sy, 0.0%ni, 82.9%id, 9.9%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 32687288k total, 32451548k used, 235740k free, 17308k buffers
Swap: 2097144k total, 7412k used, 2089732k free, 5882968k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
5780 mysql 20 0 33.2g 22g 5832 S 91.8 73.6 2040:56 mysqld
13729 root 20 0 14.6g 1.7g 8328 S 83.9 5.4 655:03.48 java
11206 root 20 0 15420 1748 968 R 0.7 0.0 0:06.48 top
160 root 20 0 0 0 0 S 0.3 0.0 167:12.04 kblockd/6
259 root 20 0 0 0 0 S 0.3 0.0 146:53.47 kswapd1
338 root 39 19 0 0 0 S 0.3 0.0 215:51.21 kipmi0
1 root 20 0 19228 480 292 S 0.0 0.0 0:26.77 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kthreadd
3 root RT 0 0 0 0 S 0.0 0.0 15:57.16 migration/0


top - 10:32:36 up 174 days, 18:35, 2 users, load average: 7.45, 8.71, 8.71
Tasks: 543 total, 1 running, 542 sleeping, 0 stopped, 0 zombie
Cpu(s): 4.9%us, 0.4%sy, 0.0%ni, 86.7%id, 7.8%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 32687288k total, 32475072k used, 212216k free, 18128k buffers
Swap: 2097144k total, 7412k used, 2089732k free, 5963572k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
5780 mysql 20 0 33.2g 22g 5832 S 67.5 73.5 2051:44 mysqld
13729 root 20 0 14.6g 1.7g 8332 S 65.2 5.4 665:41.57 java
99 root 20 0 0 0 0 S 0.3 0.0 56:33.75 events/0
122 root 20 0 0 0 0 S 0.3 0.0 10:09.10 events/23
259 root 20 0 0 0 0 S 0.3 0.0 146:54.01 kswapd1
338 root 39 19 0 0 0 S 0.3 0.0 215:51.77 kipmi0
13512 root 20 0 15424 1716 1008 R 0.3 0.0 0:00.17 top
1 root 20 0 19228 480 292 S 0.0 0.0 0:26.77 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kthreadd


top - 12:04:54 up 174 days, 20:07, 1 user, load average: 10.51, 9.24, 9.09
Tasks: 619 total, 1 running, 618 sleeping, 0 stopped, 0 zombie
Cpu(s): 3.0%us, 0.5%sy, 0.0%ni, 91.9%id, 4.6%wa, 0.0%hi, 0.1%si, 0.0%st
Mem: 32687288k total, 32488104k used, 199184k free, 20200k buffers
Swap: 2097144k total, 7412k used, 2089732k free, 6297620k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
16032 root 20 0 14.7g 1.4g 12m S 58.3 4.4 61:26.96 java
5780 mysql 20 0 33.8g 22g 5840 S 25.8 73.5 2138:04 mysqld
116 root 20 0 0 0 0 S 0.3 0.0 9:50.24 events/17
154 root 20 0 0 0 0 S 0.3 0.0 175:36.99 kblockd/0
1 root 20 0 19228 480 292 S 0.0 0.0 0:26.78 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kthreadd

top - 12:07:25 up 174 days, 20:10, 1 user, load average: 10.56, 9.55, 9.22
Tasks: 619 total, 1 running, 617 sleeping, 0 stopped, 1 zombie
Cpu(s): 7.4%us, 0.6%sy, 0.0%ni, 80.4%id, 11.4%wa, 0.0%hi, 0.2%si, 0.0%st
Mem: 32687288k total, 32341388k used, 345900k free, 18172k buffers
Swap: 2097144k total, 7412k used, 2089732k free, 6079752k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
16032 root 20 0 14.7g 1.4g 12m S 113.8 4.5 63:55.32 java
5780 mysql 20 0 33.8g 22g 5840 S 82.4 73.7 2140:07 mysqld
20596 root 20 0 15428 1768 1008 R 0.7 0.0 0:00.70 top
338 root 39 19 0 0 0 S 0.3 0.0 215:56.71 kipmi0
1598 root 20 0 243m 5236 428 S 0.3 0.0 2:48.35 rsyslogd
1 root 20 0 19228 480 292 S 0.0 0.0 0:26.78 init
2 root 20 0 0 0 0 S 0.0 0.0 0:00.01 kthreadd



Performance is good, enabling slow_query_log with long_query_time=1 shows few queries every 3-5 minutes.

Enabling slow_query_log with log_queries_not_using_indexes, shows many UNION ALL queries, like these:

# Query_time: 0.000544 Lock_time: 0.000213 Rows_sent: 0 Rows_examined: 0
SET timestamp=1392804389;
select A.* from administradores_absolutos A,administradores_absolutos_multiples_nombres AN where AN.NOMBRE='XXX YYY ZZZ' and A.id=AN.id_administrador and AN.id_administrador!=1143381 UNION ALL select A.* from administradores_absolutos A,administradores_absolutos_multiples_nombres AN where AN.id_administrador=1143381 and AN.nombre=A.nombre and AN.pais=A.pais and AN.NOMBRE!='XXX YYY ZZZ';

I'm concerned about the future, because the database is growing. The current size is 462 GB. Largest table is 42 GB.

The speed of the background processing is not important. We used to perform INSERT and UPDATE in N parallel threads, but now we use a single thread and process them in a batch.

There are sometimes extremely slow insert & updates (background). There are sometimes extremely slow queries like this (10GB table)

# Query_time: 5.354870 Lock_time: 0.000035 Rows_sent: 251 Rows_examined: 251
SET timestamp=1392806972;
SELECT DATE,PAIS FROM STATS_DC_T_1 WHERE OBJECT_ID=3097122;

Explain plan:

id;select_type;table;type;possible_keys;key;key_len;ref;rows;Extra
1;SIMPLE;STATS_DC_T_1;ref;OBJECT_ID;OBJECT_ID;8;const;251;

Configuration files
---------------------

my.cnf:

[mysqld]
datadir = /opt/db
lower_case_table_names=1
innodb_large_prefix=true
innodb_file_format=barracuda
innodb_file_per_table=true
innodb_buffer_pool_size=20G
innodb_buffer_pool_instances=2
transaction-isolation=READ-COMMITTED
table-definition-cache=2000
default-time-zone='Europe/Madrid'
max_connections=130
query_cache_type=0
max_allowed_packet=64M
query_cache_size=0
key_buffer_size=512M
innodb_flush_log_at_trx_commit=2
innodb_read_io_threads = 32
innodb_write_io_threads = 32
thread_cache_size=128
innodb_log_file_size=128M
tmpdir=/dev/shm
table_open_cache=3000
skip-name-resolve
sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES

The Java JVM uses 2GB memory.
I've tried with innodb_buffer_pool_size of 16GB, and the situation is the same, with slightly worse performance.
I've tried different innodb_buffer_pool_instances values (between 2 and 8), currently 2 gives the best performance
I've tried different innodb_flush_method values, all of them give worse performance
I've tried innodb_flush_log_at_trx_commit=0, and updates are slower (innodb_flush_log_at_trx_commit=1 much slower)
I've tried different innodb_io_capacity values, with no luck

Database is in a lvm volume, mount info:

/dev/mapper/VolGroup-lvroot on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
/dev/sda3 on /boot type ext4 (rw)
/dev/sda1 on /boot/efi type vfat (rw,umask=0077,shortname=winnt)
/dev/mapper/VolGroup-lvdata on /opt/data type ext4 (rw,noatime,data=writeback,barrier=0,nobh)
/dev/mapper/VolGroup-lvdb on /opt/db type ext4 (rw,noatime,data=writeback,barrier=0,nobh)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)

df-k output:

Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/VolGroup-lvroot
10321208 4177700 5619220 43% /
tmpfs 16343644 4 16343640 1% /dev/shm
/dev/sda3 198337 68681 119416 37% /boot
/dev/sda1 204580 260 204320 1% /boot/efi
/dev/mapper/VolGroup-lvdata
209859040 64405708 134793084 33% /opt/data
/dev/mapper/VolGroup-lvdb
928910792 589935960 291788912 67% /opt/db

MySQLTuner information:

-------- General Statistics --------------------------------------------------
[--] Skipped version check for MySQLTuner script
[OK] Currently running supported MySQL version 5.6.16
[OK] Operating on 64-bit architecture

-------- Storage Engine Statistics -------------------------------------------
[--] Status: +Archive -BDB -Federated +InnoDB -ISAM -NDBCluster
Warning: Using a password on the command line interface can be insecure.
Warning: Using a password on the command line interface can be insecure.
[--] Data in MyISAM tables: 2G (Tables: 121)
[--] Data in InnoDB tables: 232G (Tables: 436)
[--] Data in PERFORMANCE_SCHEMA tables: 0B (Tables: 52)
[!!] Total fragmented tables: 220

-------- Security Recommendations -------------------------------------------
[OK] All database users have passwords assigned

-------- Performance Metrics -------------------------------------------------
[--] Up for: 1d 7h 3m 36s (177M q [1K qps], 713K conn, TX: 158B, RX: 26B)
[--] Reads / Writes: 96% / 4%
[--] Total buffers: 20.5G global + 1.1M per thread (130 max threads)
[OK] Maximum possible memory usage: 20.7G (66% of installed RAM)
[OK] Slow queries: 0% (2K/177M)
[OK] Highest usage of available connections: 69% (90/130)
[OK] Key buffer size / total MyISAM indexes: 512.0M/320.9M
[OK] Key buffer hit rate: 100.0% (27M cached / 7K reads)
[!!] Query cache is disabled
[OK] Sorts requiring temporary tables: 2% (19K temp sorts / 736K sorts)
[OK] Temporary tables created on disk: 0% (880 on disk / 4M total)
[OK] Thread cache hit rate: 99% (90 created / 713K connections)
[OK] Table cache hit rate: 98% (1K open / 1K opened)
[OK] Open file limit used: 0% (85/16K)
[OK] Table locks acquired immediately: 99% (111M immediate / 111M locks)
[!!] InnoDB data size / buffer pool: 232.9G/20.0G

-------- Recommendations -----------------------------------------------------
General recommendations:
Run OPTIMIZE TABLE to defragment tables for better performance
Variables to adjust:
query_cache_size (>= 8M)
innodb_buffer_pool_size (>= 232G)

Variables:

Variable_name;Value
auto_increment_increment;1
auto_increment_offset;1
autocommit;ON
automatic_sp_privileges;ON
back_log;76
basedir;/usr
big_tables;OFF
bind_address;*
binlog_cache_size;32768
binlog_checksum;CRC32
binlog_direct_non_transactional_updates;OFF
binlog_format;STATEMENT
binlog_max_flush_queue_time;0
binlog_order_commits;ON
binlog_row_image;FULL
binlog_rows_query_log_events;OFF
binlog_stmt_cache_size;32768
bulk_insert_buffer_size;8388608
character_set_client;utf8
character_set_connection;utf8
character_set_database;latin1
character_set_filesystem;binary
character_set_results;utf8
character_set_server;latin1
character_set_system;utf8
character_sets_dir;/usr/share/mysql/charsets/
collation_connection;utf8_general_ci
collation_database;latin1_spanish_ci
collation_server;latin1_swedish_ci
completion_type;NO_CHAIN
concurrent_insert;AUTO
connect_timeout;10
core_file;OFF
datadir;/opt/db/
date_format;%Y-%m-%d
datetime_format;%Y-%m-%d %H:%i:%s
default_storage_engine;InnoDB
default_tmp_storage_engine;InnoDB
default_week_format;0
delay_key_write;ON
delayed_insert_limit;100
delayed_insert_timeout;300
delayed_queue_size;1000
disconnect_on_expired_password;ON
div_precision_increment;4
end_markers_in_json;OFF
enforce_gtid_consistency;OFF
eq_range_index_dive_limit;10
error_count;0
event_scheduler;OFF
expire_logs_days;0
explicit_defaults_for_timestamp;OFF
external_user;
flush;OFF
flush_time;0
foreign_key_checks;ON
ft_boolean_syntax;+ -><()~*:""&|
ft_max_word_len;84
ft_min_word_len;4
ft_query_expansion_limit;20
ft_stopword_file;(built-in)
general_log;OFF
general_log_file;/opt/db/instnt.log
group_concat_max_len;1024
gtid_executed;
gtid_mode;OFF
gtid_next;AUTOMATIC
gtid_owned;
gtid_purged;
have_compress;YES
have_crypt;YES
have_dynamic_loading;YES
have_geometry;YES
have_openssl;DISABLED
have_profiling;YES
have_query_cache;YES
have_rtree_keys;YES
have_ssl;DISABLED
have_symlink;YES
host_cache_size;258
hostname;xxxx.com
identity;0
ignore_builtin_innodb;OFF
ignore_db_dirs;
init_connect;
init_file;
init_slave;
innodb_adaptive_flushing;ON
innodb_adaptive_flushing_lwm;10
innodb_adaptive_hash_index;ON
innodb_adaptive_max_sleep_delay;150000
innodb_additional_mem_pool_size;8388608
innodb_api_bk_commit_interval;5
innodb_api_disable_rowlock;OFF
innodb_api_enable_binlog;OFF
innodb_api_enable_mdl;OFF
innodb_api_trx_level;0
innodb_autoextend_increment;64
innodb_autoinc_lock_mode;1
innodb_buffer_pool_dump_at_shutdown;OFF
innodb_buffer_pool_dump_now;OFF
innodb_buffer_pool_filename;ib_buffer_pool
innodb_buffer_pool_instances;2
innodb_buffer_pool_load_abort;OFF
innodb_buffer_pool_load_at_startup;OFF
innodb_buffer_pool_load_now;OFF
innodb_buffer_pool_size;21474836480
innodb_change_buffer_max_size;25
innodb_change_buffering;all
innodb_checksum_algorithm;innodb
innodb_checksums;ON
innodb_cmp_per_index_enabled;OFF
innodb_commit_concurrency;0
innodb_compression_failure_threshold_pct;5
innodb_compression_level;6
innodb_compression_pad_pct_max;50
innodb_concurrency_tickets;5000
innodb_data_file_path;ibdata1:12M:autoextend
innodb_data_home_dir;
innodb_disable_sort_file_cache;OFF
innodb_doublewrite;ON
innodb_fast_shutdown;1
innodb_file_format;Barracuda
innodb_file_format_check;ON
innodb_file_format_max;Barracuda
innodb_file_per_table;ON
innodb_flush_log_at_timeout;1
innodb_flush_log_at_trx_commit;2
innodb_flush_method;
innodb_flush_neighbors;1
innodb_flushing_avg_loops;30
innodb_force_load_corrupted;OFF
innodb_force_recovery;0
innodb_ft_aux_table;
innodb_ft_cache_size;8000000
innodb_ft_enable_diag_print;OFF
innodb_ft_enable_stopword;ON
innodb_ft_max_token_size;84
innodb_ft_min_token_size;3
innodb_ft_num_word_optimize;2000
innodb_ft_result_cache_limit;2000000000
innodb_ft_server_stopword_table;
innodb_ft_sort_pll_degree;2
innodb_ft_total_cache_size;640000000
innodb_ft_user_stopword_table;
innodb_io_capacity;200
innodb_io_capacity_max;2000
innodb_large_prefix;ON
innodb_lock_wait_timeout;50
innodb_locks_unsafe_for_binlog;OFF
innodb_log_buffer_size;8388608
innodb_log_compressed_pages;ON
innodb_log_file_size;134217728
innodb_log_files_in_group;2
innodb_log_group_home_dir;./
innodb_lru_scan_depth;1024
innodb_max_dirty_pages_pct;75
innodb_max_dirty_pages_pct_lwm;0
innodb_max_purge_lag;0
innodb_max_purge_lag_delay;0
innodb_mirrored_log_groups;1
innodb_monitor_disable;
innodb_monitor_enable;
innodb_monitor_reset;
innodb_monitor_reset_all;
innodb_old_blocks_pct;37
innodb_old_blocks_time;1000
innodb_online_alter_log_max_size;134217728
innodb_open_files;3000
innodb_optimize_fulltext_only;OFF
innodb_page_size;16384
innodb_print_all_deadlocks;OFF
innodb_purge_batch_size;300
innodb_purge_threads;1
innodb_random_read_ahead;OFF
innodb_read_ahead_threshold;56
innodb_read_io_threads;32
innodb_read_only;OFF
innodb_replication_delay;0
innodb_rollback_on_timeout;OFF
innodb_rollback_segments;128
innodb_sort_buffer_size;1048576
innodb_spin_wait_delay;6
innodb_stats_auto_recalc;ON
innodb_stats_method;nulls_equal
innodb_stats_on_metadata;OFF
innodb_stats_persistent;ON
innodb_stats_persistent_sample_pages;20
innodb_stats_sample_pages;8
innodb_stats_transient_sample_pages;8
innodb_status_output;OFF
innodb_status_output_locks;OFF
innodb_strict_mode;OFF
innodb_support_xa;ON
innodb_sync_array_size;1
innodb_sync_spin_loops;30
innodb_table_locks;ON
innodb_thread_concurrency;0
innodb_thread_sleep_delay;10000
innodb_undo_directory;.
innodb_undo_logs;128
innodb_undo_tablespaces;0
innodb_use_native_aio;ON
innodb_use_sys_malloc;ON
innodb_version;5.6.16
innodb_write_io_threads;32
insert_id;0
interactive_timeout;28800
join_buffer_size;262144
keep_files_on_create;OFF
key_buffer_size;536870912
key_cache_age_threshold;300
key_cache_block_size;1024
key_cache_division_limit;100
large_files_support;ON
large_page_size;0
large_pages;OFF
last_insert_id;0
lc_messages;en_US
lc_messages_dir;/usr/share/mysql/
lc_time_names;en_US
license;GPL
local_infile;ON
lock_wait_timeout;31536000
locked_in_memory;OFF
log_bin;OFF
log_bin_basename;
log_bin_index;
log_bin_trust_function_creators;OFF
log_bin_use_v1_row_events;OFF
log_error;/opt/db/instnt.com.err
log_output;FILE
log_queries_not_using_indexes;OFF
log_slave_updates;OFF
log_slow_admin_statements;OFF
log_slow_slave_statements;OFF
log_throttle_queries_not_using_indexes;0
log_warnings;1
long_query_time;1.000000
low_priority_updates;OFF
lower_case_file_system;OFF
lower_case_table_names;1
master_info_repository;FILE
master_verify_checksum;OFF
max_allowed_packet;67108864
max_binlog_cache_size;18446744073709547520
max_binlog_size;1073741824
max_binlog_stmt_cache_size;18446744073709547520
max_connect_errors;100
max_connections;130
max_delayed_threads;20
max_error_count;64
max_heap_table_size;16777216
max_insert_delayed_threads;20
max_join_size;18446744073709551615
max_length_for_sort_data;1024
max_prepared_stmt_count;16382
max_relay_log_size;0
max_seeks_for_key;18446744073709551615
max_sort_length;1024
max_sp_recursion_depth;0
max_tmp_tables;32
max_user_connections;0
max_write_lock_count;18446744073709551615
metadata_locks_cache_size;1024
metadata_locks_hash_instances;8
min_examined_row_limit;0
multi_range_count;256
myisam_data_pointer_size;6
myisam_max_sort_file_size;9223372036853727232
myisam_mmap_size;18446744073709551615
myisam_recover_options;OFF
myisam_repair_threads;1
myisam_sort_buffer_size;8388608
myisam_stats_method;nulls_unequal
myisam_use_mmap;OFF
net_buffer_length;16384
net_read_timeout;30
net_retry_count;10
net_write_timeout;60
new;OFF
old;OFF
old_alter_table;OFF
old_passwords;0
open_files_limit;16384
optimizer_prune_level;1
optimizer_search_depth;62
optimizer_switch;index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,engine_condition_pushdown=on,index_condition_pushdown=on,mrr=on,mrr_cost_based=on,block_nested_loop=on,batched_key_access=off,materialization=on,semijoin=on,loosescan=on,firstmatch=on,subquery_materialization_cost_based=on,use_index_extensions=on
optimizer_trace;enabled=off,one_line=off
optimizer_trace_features;greedy_search=on,range_optimizer=on,dynamic_range=on,repeated_subselect=on
optimizer_trace_limit;1
optimizer_trace_max_mem_size;16384
optimizer_trace_offset;-1
performance_schema;ON
performance_schema_accounts_size;100
performance_schema_digests_size;10000
performance_schema_events_stages_history_long_size;10000
performance_schema_events_stages_history_size;10
performance_schema_events_statements_history_long_size;10000
performance_schema_events_statements_history_size;10
performance_schema_events_waits_history_long_size;10000
performance_schema_events_waits_history_size;10
performance_schema_hosts_size;100
performance_schema_max_cond_classes;80
performance_schema_max_cond_instances;4620
performance_schema_max_file_classes;50
performance_schema_max_file_handles;32768
performance_schema_max_file_instances;9539
performance_schema_max_mutex_classes;200
performance_schema_max_mutex_instances;21780
performance_schema_max_rwlock_classes;40
performance_schema_max_rwlock_instances;12660
performance_schema_max_socket_classes;10
performance_schema_max_socket_instances;280
performance_schema_max_stage_classes;150
performance_schema_max_statement_classes;168
performance_schema_max_table_handles;6000
performance_schema_max_table_instances;12500
performance_schema_max_thread_classes;50
performance_schema_max_thread_instances;360
performance_schema_session_connect_attrs_size;512
performance_schema_setup_actors_size;100
performance_schema_setup_objects_size;100
performance_schema_users_size;100
pid_file;/opt/db/instint.com.pid
plugin_dir;/usr/lib64/mysql/plugin/
port;3306
preload_buffer_size;32768
profiling;OFF
profiling_history_size;15
protocol_version;10
proxy_user;
pseudo_slave_mode;OFF
pseudo_thread_id;698665
query_alloc_block_size;8192
query_cache_limit;1048576
query_cache_min_res_unit;4096
query_cache_size;0
query_cache_type;OFF
query_cache_wlock_invalidate;OFF
query_prealloc_size;8192
rand_seed1;0
rand_seed2;0
range_alloc_block_size;4096
read_buffer_size;131072
read_only;OFF
read_rnd_buffer_size;262144
relay_log;
relay_log_basename;
relay_log_index;
relay_log_info_file;relay-log.info
relay_log_info_repository;FILE
relay_log_purge;ON
relay_log_recovery;OFF
relay_log_space_limit;0
report_host;
report_password;
report_port;3306
report_user;
rpl_stop_slave_timeout;31536000
secure_auth;ON
secure_file_priv;
server_id;0
server_id_bits;32
server_uuid;d112791a-7160-11e2-a0d8-6cae8b61ce6a
skip_external_locking;ON
skip_name_resolve;ON
skip_networking;OFF
skip_show_database;OFF
slave_allow_batching;OFF
slave_checkpoint_group;512
slave_checkpoint_period;300
slave_compressed_protocol;OFF
slave_exec_mode;STRICT
slave_load_tmpdir;/dev/shm
slave_max_allowed_packet;1073741824
slave_net_timeout;3600
slave_parallel_workers;0
slave_pending_jobs_size_max;16777216
slave_rows_search_algorithms;TABLE_SCAN,INDEX_SCAN
slave_skip_errors;OFF
slave_sql_verify_checksum;ON
slave_transaction_retries;10
slave_type_conversions;
slow_launch_time;2
slow_query_log;ON
slow_query_log_file;/opt/db/instint-slow.log
socket;/var/lib/mysql/mysql.sock
sort_buffer_size;262144
sql_auto_is_null;OFF
sql_big_selects;ON
sql_buffer_result;OFF
sql_log_bin;ON
sql_log_off;OFF
sql_mode;STRICT_TRANS_TABLES,NO_ENGINE_SUBSTITUTION
sql_notes;ON
sql_quote_show_create;ON
sql_safe_updates;OFF
sql_select_limit;18446744073709551615
sql_slave_skip_counter;0
sql_warnings;OFF
ssl_ca;
ssl_capath;
ssl_cert;
ssl_cipher;
ssl_crl;
ssl_crlpath;
ssl_key;
storage_engine;InnoDB
stored_program_cache;256
sync_binlog;0
sync_frm;ON
sync_master_info;10000
sync_relay_log;10000
sync_relay_log_info;10000
system_time_zone;CET
table_definition_cache;2000
table_open_cache;3000
table_open_cache_instances;1
thread_cache_size;128
thread_concurrency;10
thread_handling;one-thread-per-connection
thread_stack;262144
time_format;%H:%i:%s
time_zone;Europe/Madrid
timed_mutexes;OFF
timestamp;1392808236.865061
tmp_table_size;16777216
tmpdir;/dev/shm
transaction_alloc_block_size;8192
transaction_allow_batching;OFF
transaction_prealloc_size;4096
tx_isolation;READ-COMMITTED
tx_read_only;OFF
unique_checks;ON
updatable_views_with_limit;YES
version;5.6.16
version_comment;MySQL Community Server (GPL)
version_compile_machine;x86_64
version_compile_os;Linux
wait_timeout;28800
warning_count;0

Status:

Variable_name;Value
Aborted_clients;71
Aborted_connects;14
Binlog_cache_disk_use;0
Binlog_cache_use;0
Binlog_stmt_cache_disk_use;0
Binlog_stmt_cache_use;0
Bytes_received;10982
Bytes_sent;465207
Com_admin_commands;474
Com_assign_to_keycache;0
Com_alter_db;0
Com_alter_db_upgrade;0
Com_alter_event;0
Com_alter_function;0
Com_alter_procedure;0
Com_alter_server;0
Com_alter_table;0
Com_alter_tablespace;0
Com_alter_user;0
Com_analyze;0
Com_begin;0
Com_binlog;0
Com_call_procedure;0
Com_change_db;1
Com_change_master;0
Com_check;0
Com_checksum;0
Com_commit;0
Com_create_db;0
Com_create_event;0
Com_create_function;0
Com_create_index;0
Com_create_procedure;0
Com_create_server;0
Com_create_table;0
Com_create_trigger;0
Com_create_udf;0
Com_create_user;0
Com_create_view;0
Com_dealloc_sql;0
Com_delete;0
Com_delete_multi;0
Com_do;0
Com_drop_db;0
Com_drop_event;0
Com_drop_function;0
Com_drop_index;0
Com_drop_procedure;0
Com_drop_server;0
Com_drop_table;0
Com_drop_trigger;0
Com_drop_user;0
Com_drop_view;0
Com_empty_query;0
Com_execute_sql;0
Com_flush;0
Com_get_diagnostics;0
Com_grant;0
Com_ha_close;0
Com_ha_open;0
Com_ha_read;0
Com_help;0
Com_insert;0
Com_insert_select;0
Com_install_plugin;0
Com_kill;0
Com_load;0
Com_lock_tables;0
Com_optimize;0
Com_preload_keys;0
Com_prepare_sql;0
Com_purge;0
Com_purge_before_date;0
Com_release_savepoint;0
Com_rename_table;0
Com_rename_user;0
Com_repair;0
Com_replace;0
Com_replace_select;0
Com_reset;0
Com_resignal;0
Com_revoke;0
Com_revoke_all;0
Com_rollback;0
Com_rollback_to_savepoint;0
Com_savepoint;0
Com_select;13
Com_set_option;5
Com_signal;0
Com_show_binlog_events;0
Com_show_binlogs;0
Com_show_charsets;0
Com_show_collations;1
Com_show_create_db;0
Com_show_create_event;0
Com_show_create_func;0
Com_show_create_proc;0
Com_show_create_table;9
Com_show_create_trigger;0
Com_show_databases;0
Com_show_engine_logs;0
Com_show_engine_mutex;0
Com_show_engine_status;0
Com_show_events;1
Com_show_errors;0
Com_show_fields;1
Com_show_function_code;0
Com_show_function_status;1
Com_show_grants;0
Com_show_keys;0
Com_show_master_status;0
Com_show_open_tables;0
Com_show_plugins;0
Com_show_privileges;0
Com_show_procedure_code;0
Com_show_procedure_status;1
Com_show_processlist;1
Com_show_profile;0
Com_show_profiles;0
Com_show_relaylog_events;0
Com_show_slave_hosts;0
Com_show_slave_status;0
Com_show_status;3
Com_show_storage_engines;1
Com_show_table_status;5
Com_show_tables;0
Com_show_triggers;1
Com_show_variables;4
Com_show_warnings;0
Com_slave_start;0
Com_slave_stop;0
Com_stmt_close;0
Com_stmt_execute;0
Com_stmt_fetch;0
Com_stmt_prepare;0
Com_stmt_reprepare;0
Com_stmt_reset;0
Com_stmt_send_long_data;0
Com_truncate;0
Com_uninstall_plugin;0
Com_unlock_tables;0
Com_update;2
Com_update_multi;0
Com_xa_commit;0
Com_xa_end;0
Com_xa_prepare;0
Com_xa_recover;0
Com_xa_rollback;0
Com_xa_start;0
Compression;ON
Connection_errors_accept;0
Connection_errors_internal;0
Connection_errors_max_connections;0
Connection_errors_peer_address;0
Connection_errors_select;0
Connection_errors_tcpwrap;0
Connections;751138
Created_tmp_disk_tables;5
Created_tmp_files;38576
Created_tmp_tables;72
Delayed_errors;0
Delayed_insert_threads;0
Delayed_writes;0
Flush_commands;1
Handler_commit;12
Handler_delete;0
Handler_discover;0
Handler_external_lock;36
Handler_mrr_init;0
Handler_prepare;0
Handler_read_first;2
Handler_read_key;1030
Handler_read_last;4
Handler_read_next;1029
Handler_read_prev;2826
Handler_read_rnd;0
Handler_read_rnd_next;2549
Handler_rollback;0
Handler_savepoint;0
Handler_savepoint_rollback;0
Handler_update;2
Handler_write;2532
Innodb_buffer_pool_dump_status;not started
Innodb_buffer_pool_load_status;not started
Innodb_buffer_pool_pages_data;1252604
Innodb_buffer_pool_bytes_data;20522663936
Innodb_buffer_pool_pages_dirty;20404
Innodb_buffer_pool_bytes_dirty;334299136
Innodb_buffer_pool_pages_flushed;7782403
Innodb_buffer_pool_pages_free;2005
Innodb_buffer_pool_pages_misc;56110
Innodb_buffer_pool_pages_total;1310719
Innodb_buffer_pool_read_ahead_rnd;0
Innodb_buffer_pool_read_ahead;1163621
Innodb_buffer_pool_read_ahead_evicted;9
Innodb_buffer_pool_read_requests;22041438899
Innodb_buffer_pool_reads;42474547
Innodb_buffer_pool_wait_free;0
Innodb_buffer_pool_write_requests;106010393
Innodb_data_fsyncs;1896949
Innodb_data_pending_fsyncs;1
Innodb_data_pending_reads;2
Innodb_data_pending_writes;0
Innodb_data_read;732948140032
Innodb_data_reads;44737350
Innodb_data_writes;13616761
Innodb_data_written;267467585536
Innodb_dblwr_pages_written;7782403
Innodb_dblwr_writes;227552
Innodb_have_atomic_builtins;ON
Innodb_log_waits;17
Innodb_log_write_requests;24735436
Innodb_log_writes;5568625
Innodb_os_log_fsyncs;131688
Innodb_os_log_pending_fsyncs;0
Innodb_os_log_pending_writes;0
Innodb_os_log_written;12448931328
Innodb_page_size;16384
Innodb_pages_created;270343
Innodb_pages_read;44738563
Innodb_pages_written;7782402
Innodb_row_lock_current_waits;0
Innodb_row_lock_time;372756
Innodb_row_lock_time_avg;46
Innodb_row_lock_time_max;51004
Innodb_row_lock_waits;7962
Innodb_rows_deleted;476002
Innodb_rows_inserted;10079517
Innodb_rows_read;7521242058
Innodb_rows_updated;4611614
Innodb_num_open_files;471
Innodb_truncated_status_writes;0
Innodb_available_undo_logs;128
Key_blocks_not_flushed;0
Key_blocks_unused;420105
Key_blocks_used;8689
Key_read_requests;29874549
Key_reads;8220
Key_write_requests;3323642
Key_writes;17199
Last_query_cost;10.499000
Last_query_partial_plans;1
Max_used_connections;99
Not_flushed_delayed_rows;0
Open_files;308
Open_streams;0
Open_table_definitions;689
Open_tables;1661
Opened_files;43412
Opened_table_definitions;0
Opened_tables;0
Performance_schema_accounts_lost;0
Performance_schema_cond_classes_lost;0
Performance_schema_cond_instances_lost;0
Performance_schema_digest_lost;0
Performance_schema_file_classes_lost;0
Performance_schema_file_handles_lost;0
Performance_schema_file_instances_lost;0
Performance_schema_hosts_lost;0
Performance_schema_locker_lost;0
Performance_schema_mutex_classes_lost;0
Performance_schema_mutex_instances_lost;0
Performance_schema_rwlock_classes_lost;0
Performance_schema_rwlock_instances_lost;0
Performance_schema_session_connect_attrs_lost;0
Performance_schema_socket_classes_lost;0
Performance_schema_socket_instances_lost;0
Performance_schema_stage_classes_lost;0
Performance_schema_statement_classes_lost;0
Performance_schema_table_handles_lost;0
Performance_schema_table_instances_lost;0
Performance_schema_thread_classes_lost;0
Performance_schema_thread_instances_lost;0
Performance_schema_users_lost;0
Prepared_stmt_count;0
Qcache_free_blocks;0
Qcache_free_memory;0
Qcache_hits;0
Qcache_inserts;0
Qcache_lowmem_prunes;0
Qcache_not_cached;0
Qcache_queries_in_cache;0
Qcache_total_blocks;0
Queries;187455074
Questions;52
Select_full_join;0
Select_full_range_join;0
Select_range;2
Select_range_check;0
Select_scan;21
Slave_heartbeat_period;
Slave_last_heartbeat;
Slave_open_temp_tables;0
Slave_received_heartbeats;
Slave_retried_transactions;
Slave_running;OFF
Slow_launch_threads;0
Slow_queries;3
Sort_merge_passes;0
Sort_range;0
Sort_rows;0
Sort_scan;0
Ssl_accept_renegotiates;0
Ssl_accepts;0
Ssl_callback_cache_hits;0
Ssl_cipher;
Ssl_cipher_list;
Ssl_client_connects;0
Ssl_connect_renegotiates;0
Ssl_ctx_verify_depth;0
Ssl_ctx_verify_mode;0
Ssl_default_timeout;0
Ssl_finished_accepts;0
Ssl_finished_connects;0
Ssl_server_not_after;
Ssl_server_not_before;
Ssl_session_cache_hits;0
Ssl_session_cache_misses;0
Ssl_session_cache_mode;NONE
Ssl_session_cache_overflows;0
Ssl_session_cache_size;0
Ssl_session_cache_timeouts;0
Ssl_sessions_reused;0
Ssl_used_session_cache_entries;0
Ssl_verify_depth;0
Ssl_verify_mode;0
Ssl_version;
Table_locks_immediate;117792284
Table_locks_waited;43
Table_open_cache_hits;601
Table_open_cache_misses;0
Table_open_cache_overflows;0
Tc_log_max_pages_used;0
Tc_log_page_size;0
Tc_log_page_waits;0
Threads_cached;74
Threads_connected;25
Threads_created;99
Threads_running;19
Uptime;117556
Uptime_since_flush_status;117556


=====================================
2014-02-19 12:13:33 7f8ec11b0700 INNODB MONITOR OUTPUT
=====================================
Per second averages calculated from the last 25 seconds
-----------------
BACKGROUND THREAD
-----------------
srv_master_thread loops: 92543 srv_active, 0 srv_shutdown, 39 srv_idle
srv_master_thread log flush and writes: 92582
----------
SEMAPHORES
----------
OS WAIT ARRAY INFO: reservation count 3909832
OS WAIT ARRAY INFO: signal count 5847856
Mutex spin waits 12196760, rounds 93452389, OS waits 2736187
RW-shared spins 2257375, rounds 29148794, OS waits 705893
RW-excl spins 722218, rounds 21939901, OS waits 417583
Spin rounds per wait: 7.66 mutex, 12.91 RW-shared, 30.38 RW-excl
--------
FILE I/O
--------
I/O thread 0 state: waiting for completed aio requests (insert buffer thread)
I/O thread 1 state: waiting for completed aio requests (log thread)
I/O thread 2 state: waiting for completed aio requests (read thread)
I/O thread 3 state: waiting for completed aio requests (read thread)
I/O thread 4 state: waiting for completed aio requests (read thread)
I/O thread 5 state: waiting for completed aio requests (read thread)
I/O thread 6 state: waiting for completed aio requests (read thread)
I/O thread 7 state: waiting for completed aio requests (read thread)
I/O thread 8 state: waiting for completed aio requests (read thread)
I/O thread 9 state: waiting for completed aio requests (read thread)
I/O thread 10 state: waiting for completed aio requests (read thread)
I/O thread 11 state: waiting for completed aio requests (read thread)
I/O thread 12 state: waiting for completed aio requests (read thread)
I/O thread 13 state: waiting for completed aio requests (read thread)
I/O thread 14 state: waiting for completed aio requests (read thread)
I/O thread 15 state: waiting for completed aio requests (read thread)
I/O thread 16 state: waiting for completed aio requests (read thread)
I/O thread 17 state: waiting for completed aio requests (read thread)
I/O thread 18 state: waiting for completed aio requests (read thread)
I/O thread 19 state: waiting for completed aio requests (read thread)
I/O thread 20 state: waiting for completed aio requests (read thread)
I/O thread 21 state: waiting for completed aio requests (read thread)
I/O thread 22 state: waiting for completed aio requests (read thread)
I/O thread 23 state: waiting for completed aio requests (read thread)
I/O thread 24 state: waiting for completed aio requests (read thread)
I/O thread 25 state: waiting for completed aio requests (read thread)
I/O thread 26 state: waiting for completed aio requests (read thread)
I/O thread 27 state: waiting for completed aio requests (read thread)
I/O thread 28 state: waiting for completed aio requests (read thread)
I/O thread 29 state: waiting for completed aio requests (read thread)
I/O thread 30 state: waiting for completed aio requests (read thread)
I/O thread 31 state: waiting for completed aio requests (read thread)
I/O thread 32 state: waiting for completed aio requests (read thread)
I/O thread 33 state: waiting for completed aio requests (read thread)
I/O thread 34 state: waiting for completed aio requests (write thread)
I/O thread 35 state: waiting for completed aio requests (write thread)
I/O thread 36 state: waiting for completed aio requests (write thread)
I/O thread 37 state: waiting for completed aio requests (write thread)
I/O thread 38 state: waiting for completed aio requests (write thread)
I/O thread 39 state: waiting for completed aio requests (write thread)
I/O thread 40 state: waiting for completed aio requests (write thread)
I/O thread 41 state: waiting for completed aio requests (write thread)
I/O thread 42 state: waiting for completed aio requests (write thread)
I/O thread 43 state: waiting for completed aio requests (write thread)
I/O thread 44 state: waiting for completed aio requests (write thread)
I/O thread 45 state: waiting for completed aio requests (write thread)
I/O thread 46 state: waiting for completed aio requests (write thread)
I/O thread 47 state: waiting for completed aio requests (write thread)
I/O thread 48 state: waiting for completed aio requests (write thread)
I/O thread 49 state: waiting for completed aio requests (write thread)
I/O thread 50 state: waiting for completed aio requests (write thread)
I/O thread 51 state: waiting for completed aio requests (write thread)
I/O thread 52 state: waiting for completed aio requests (write thread)
I/O thread 53 state: waiting for completed aio requests (write thread)
I/O thread 54 state: waiting for completed aio requests (write thread)
I/O thread 55 state: waiting for completed aio requests (write thread)
I/O thread 56 state: waiting for completed aio requests (write thread)
I/O thread 57 state: waiting for completed aio requests (write thread)
I/O thread 58 state: waiting for completed aio requests (write thread)
I/O thread 59 state: waiting for completed aio requests (write thread)
I/O thread 60 state: waiting for completed aio requests (write thread)
I/O thread 61 state: waiting for completed aio requests (write thread)
I/O thread 62 state: waiting for completed aio requests (write thread)
I/O thread 63 state: waiting for completed aio requests (write thread)
I/O thread 64 state: waiting for completed aio requests (write thread)
I/O thread 65 state: waiting for completed aio requests (write thread)
Pending normal aio reads: 0 [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] , aio writes: 0 [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] ,
ibuf aio reads: 0, log i/o's: 0, sync i/o's: 0
Pending flushes (fsync) log: 0; buffer pool: 0
44793995 OS file reads, 13633525 OS file writes, 1899611 OS fsyncs
4 pending preads, 0 pending pwrites
425.42 reads/s, 16384 avg bytes/read, 80.28 writes/s, 16.64 fsyncs/s
-------------------------------------
INSERT BUFFER AND ADAPTIVE HASH INDEX
-------------------------------------
Ibuf: size 5909, free list len 55168, seg size 61078, 1595654 merges
merged operations:
insert 3332111, delete mark 1293065, delete 386475
discarded operations:
insert 5, delete mark 0, delete 0
Hash table size 42499631, node heap has 56124 buffer(s)
81103.16 hash searches/s, 5544.98 non-hash searches/s
---
LOG
---
Log sequence number 1880598171372
Log flushed up to 1880598141532
Pages flushed up to 1880574289557
Last checkpoint at 1880573892822
0 pending log writes, 0 pending chkp writes
5587307 log i/o's done, 28.04 log i/o's/second
----------------------
BUFFER POOL AND MEMORY
----------------------
Total memory allocated 21978152960; in additional pool allocated 0
Dictionary memory allocated 9544167
Buffer pool size 1310719
Free buffers 1693
Database pages 1252902
Old database pages 462535
Modified db pages 17740
Pending reads 4
Pending writes: LRU 0, flush list 0, single page 0
Pages made young 27257573, not young 607122492
221.83 youngs/s, 5617.74 non-youngs/s
Pages read 44795222, created 270601, written 7793375
425.26 reads/s, 1.36 creates/s, 50.20 writes/s
Buffer pool hit rate 999 / 1000, young-making rate 0 / 1000 not 20 / 1000
Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s
LRU len: 1252902, unzip_LRU len: 0
I/O sum[43420]:cur[880], unzip sum[0]:cur[0]
----------------------
INDIVIDUAL BUFFER POOL INFO
----------------------
---BUFFER POOL 0
Buffer pool size 655360
Free buffers 841
Database pages 626478
Old database pages 231277
Modified db pages 9225
Pending reads 0
Pending writes: LRU 0, flush list 0, single page 0
Pages made young 13930350, not young 306054081
115.00 youngs/s, 2823.69 non-youngs/s
Pages read 22695071, created 162262, written 4001055
217.31 reads/s, 1.08 creates/s, 27.44 writes/s
Buffer pool hit rate 999 / 1000, young-making rate 0 / 1000 not 20 / 1000
Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s
LRU len: 626478, unzip_LRU len: 0
I/O sum[21710]:cur[440], unzip sum[0]:cur[0]
---BUFFER POOL 1
Buffer pool size 655359
Free buffers 852
Database pages 626424
Old database pages 231258
Modified db pages 8515
Pending reads 4
Pending writes: LRU 0, flush list 0, single page 0
Pages made young 13327223, not young 301068411
106.84 youngs/s, 2794.05 non-youngs/s
Pages read 22100151, created 108339, written 3792320
207.95 reads/s, 0.28 creates/s, 22.76 writes/s
Buffer pool hit rate 999 / 1000, young-making rate 0 / 1000 not 20 / 1000
Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s
LRU len: 626424, unzip_LRU len: 0
I/O sum[21710]:cur[440], unzip sum[0]:cur[0]
--------------
ROW OPERATIONS
--------------
0 queries inside InnoDB, 0 queries in queue
3 read views open inside InnoDB
Main thread process no. 5780, id 140226909579008, state: sleeping
Number of rows inserted 10080740, updated 4617793, deleted 476016, read 7525336775
7.60 inserts/s, 20.32 updates/s, 0.08 deletes/s, 105339.35 reads/s
----------------------------
END OF INNODB MONITOR OUTPUT
============================

[EDITED] Adding iotop & iostat output

Total DISK READ: 7.73 M/s | Total DISK WRITE: 585.06 K/s
TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND
919 be/4 mysql 1751.45 K/s 0.00 B/s 0.00 % 81.28 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
929 be/4 mysql 1248.38 K/s 0.00 B/s 0.00 % 77.67 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
936 be/4 mysql 972.62 K/s 3.73 K/s 0.00 % 50.25 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1341 be/4 mysql 566.43 K/s 7.45 K/s 0.00 % 41.37 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1166 be/4 mysql 715.49 K/s 3.73 K/s 0.00 % 37.34 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1142 be/4 mysql 521.71 K/s 0.00 B/s 0.00 % 36.38 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1138 be/4 mysql 208.68 K/s 0.00 B/s 0.00 % 29.05 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
906 be/4 mysql 149.06 K/s 3.73 K/s 0.00 % 23.47 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1348 be/4 mysql 283.21 K/s 0.00 B/s 0.00 % 23.10 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1468 be/4 mysql 327.93 K/s 0.00 B/s 0.00 % 20.66 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1182 be/4 mysql 402.46 K/s 3.73 K/s 0.00 % 20.60 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
934 be/4 mysql 365.20 K/s 7.45 K/s 0.00 % 17.85 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
30255 be/4 daemon 3.73 K/s 0.00 B/s 0.00 % 12.51 % httpd
1146 be/4 mysql 417.37 K/s 0.00 B/s 0.00 % 8.20 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1435 be/4 mysql 74.53 K/s 0.00 B/s 0.00 % 6.93 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
908 be/4 mysql 0.00 B/s 357.74 K/s 0.00 % 5.30 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
826 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 3.91 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1021 be/4 mysql 193.78 K/s 0.00 B/s 0.00 % 3.78 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
860 be/4 mysql 0.00 B/s 3.73 K/s 0.00 % 3.21 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
887 be/4 mysql 0.00 B/s 14.91 K/s 0.00 % 2.56 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
828 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 1.47 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1161 be/4 mysql 44.72 K/s 0.00 B/s 0.00 % 1.02 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
841 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.74 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
907 be/4 mysql 14.91 K/s 0.00 B/s 0.00 % 0.39 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1239 be/3 root 0.00 B/s 3.73 K/s 0.00 % 0.16 % [jbd2/dm-2-8]
845 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.02 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
863 be/4 mysql 0.00 B/s 0.00 B/s 0.00 % 0.00 % mysqld --basedir=/usr --datadir=/opt/db --plugin~/xxxx.com.err --pid-file=/opt/db/xxxx.com.pid
1 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % init
2 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [kthreadd]
3 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/0]
4 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/0]
5 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/0]
6 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/0]
7 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/1]
8 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [migration/1]
9 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [ksoftirqd/1]
10 rt/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % [watchdog/1]


avg-cpu: %user %nice %system %iowait %steal %idle
5.60 0.00 0.75 9.07 0.00 84.58

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 418.00 14760.00 4688.00 14760 4688
dm-0 0.00 0.00 0.00 0 0
dm-1 0.00 0.00 0.00 0 0
dm-2 923.00 14504.00 4688.00 14504 4688
dm-3 0.00 0.00 0.00 0 0

avg-cpu: %user %nice %system %iowait %steal %idle
2.88 0.00 0.54 11.45 0.00 85.13

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 509.00 19824.00 6192.00 19824 6192
dm-0 2.00 16.00 0.00 16 0
dm-1 0.00 0.00 0.00 0 0
dm-2 1195.00 19848.00 6192.00 19848 6192
dm-3 0.00 0.00 0.00 0 0

avg-cpu: %user %nice %system %iowait %steal %idle
12.57 0.00 1.34 7.56 0.00 78.53

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 400.00 16296.00 1368.00 16296 1368
dm-0 0.00 0.00 0.00 0 0
dm-1 0.00 0.00 0.00 0 0
dm-2 538.00 16584.00 1320.00 16584 1320
dm-3 6.00 0.00 48.00 0 48

avg-cpu: %user %nice %system %iowait %steal %idle
5.44 0.00 2.89 11.77 0.00 79.90

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 440.00 14264.00 6232.00 14264 6232
dm-0 0.00 0.00 0.00 0 0
dm-1 0.00 0.00 0.00 0 0
dm-2 1105.00 14248.00 6232.00 14248 6232
dm-3 1.00 8.00 0.00 8 0

avg-cpu: %user %nice %system %iowait %steal %idle
4.17 0.00 0.58 9.47 0.00 85.77

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 628.00 27560.00 6136.00 27560 6136
dm-0 0.00 0.00 0.00 0 0
dm-1 0.00 0.00 0.00 0 0
dm-2 1283.00 27656.00 6080.00 27656 6080
dm-3 7.00 0.00 56.00 0 56




Again, many thanks in advance



Edited 2 time(s). Last edit at 02/20/2014 03:36AM by Peter Wells.

Options: ReplyQuote


Subject
Views
Written By
Posted
High load average (MySQL 5.6.16)
13974
February 19, 2014 05:24AM
2957
February 21, 2014 06:12PM
2507
February 26, 2014 08:48AM
3017
February 26, 2014 08:49AM
2457
February 26, 2014 11:44PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.