sync_binlog=1 and innodb_flush_log_at_trx_commit = 1 killing write performance
Posted by: Bill Plimpton
Date: June 23, 2014 04:52PM
Date: June 23, 2014 04:52PM
setup: mariadb 10 (latest stable from their debian repo)
debian 7.5 64 bit
filesystem: ext3 with relatime
Replicating from one master to one slave. Slave is in total standby (not a read slave). If master fails for any
kind of reason (network outage, mysqld crashes, etc.) we switch to slave which is located at another physical
location (east coast vs west coast). Whatever did not reach slave at that point is discarded. Slave becomes the
new master. Slave db is dumped to restore old master to new slave.
We currently use the recommended settings:
sync-binlog = 1
innodb_flush_log_at_trx_commit = 1
But performance is TERRIBLE. Disabling BOTH settings gives us an order of magnitude improvement in writes.
We have done no tuning of kernel based caches or HDD caches. We use software RAID 1 (2 disks).
$ hdparm /dev/sda
/dev/sda:
multcount = 16 (on)
IO_support = 0 (default)
readonly = 0 (off)
readahead = 256 (on)
geometry = 30400/255/63, sectors = 488390625, start = 0
$ cat /proc/sys/vm/drop_caches
0
$ cat /proc/sys/vm/dirty_expire_centisecs
3000
$ cat /proc/sys/vm/dirty_writeback_centisecs
500
The question we have is, considering our replication strategy, would it be safe to run with sync-binlog = 0
(or a high number like 100) AND innodb_flush_log_at_trx_commit = 0?
Are there any other NEWER settings worth trying to make the disk flushing less of a performance killer? I was
under the impression that 5.6 and newer mysql drastically improved these sorts of issues.
GLOBAL VARS and STATUS FOLLOWS
=====================================
aria_block_size 8192
aria_checkpoint_interval 30
aria_checkpoint_log_activity 1048576
aria_force_start_after_recovery_failures 0
aria_group_commit none
aria_group_commit_interval 0
aria_log_file_size 1073741824
aria_log_purge_type immediate
aria_max_sort_file_size 9223372036853727232
aria_page_checksum ON
aria_pagecache_age_threshold 300
aria_pagecache_buffer_size 134217728
aria_pagecache_division_limit 100
aria_recover NORMAL
aria_repair_threads 1
aria_sort_buffer_size 268434432
aria_stats_method nulls_unequal
aria_sync_log_dir NEWFILE
aria_used_for_temp_tables ON
auto_increment_increment 1
auto_increment_offset 1
autocommit ON
automatic_sp_privileges ON
back_log 65
basedir /usr
big_tables OFF
binlog_annotate_row_events OFF
binlog_cache_size 32768
binlog_checksum NONE
binlog_commit_wait_count 0
binlog_commit_wait_usec 100000
binlog_direct_non_transactional_updates OFF
binlog_format STATEMENT
binlog_optimize_thread_scheduling ON
binlog_stmt_cache_size 32768
bulk_insert_buffer_size 16777216
character_set_client latin1
character_set_connection latin1
character_set_database latin1
character_set_filesystem binary
character_set_results latin1
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/
collation_connection latin1_swedish_ci
collation_database latin1_swedish_ci
collation_server latin1_swedish_ci
completion_type NO_CHAIN
concurrent_insert AUTO
connect_timeout 5
datadir /var/lib/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
deadlock_search_depth_long 15
deadlock_search_depth_short 4
deadlock_timeout_long 50000000
deadlock_timeout_short 10000
debug_no_thread_alarm OFF
default_regex_flags
default_storage_engine InnoDB
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
div_precision_increment 4
event_scheduler OFF
expensive_subquery_limit 100
expire_logs_days 0
extra_max_connections 1
extra_port 0
flush OFF
flush_time 0
foreign_key_checks ON
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
general_log OFF
group_concat_max_len 1024
gtid_binlog_pos 0-2-8061682
gtid_binlog_state 0-2-8061682
gtid_current_pos 0-2-8061682
gtid_domain_id 0
gtid_ignore_duplicates OFF
gtid_slave_pos 0-1-5800710
gtid_strict_mode OFF
have_compress YES
have_crypt YES
have_dynamic_loading YES
have_geometry YES
have_openssl YES
have_profiling YES
have_query_cache YES
have_rtree_keys YES
have_ssl DISABLED
have_symlink YES
histogram_size 0
histogram_type SINGLE_PREC_HB
host_cache_size 128
ignore_builtin_innodb OFF
ignore_db_dirs
init_connect
init_file
init_slave
innodb_adaptive_flushing ON
innodb_adaptive_flushing_lwm 10
innodb_adaptive_hash_index ON
innodb_adaptive_hash_index_partitions 1
innodb_adaptive_max_sleep_delay 150000
innodb_additional_mem_pool_size 20971520
innodb_api_bk_commit_interval 5
innodb_api_disable_rowlock OFF
innodb_api_enable_binlog OFF
innodb_api_enable_mdl OFF
innodb_api_trx_level 0
innodb_autoextend_increment 64
innodb_autoinc_lock_mode 1
innodb_buffer_pool_dump_at_shutdown OFF
innodb_buffer_pool_dump_now OFF
innodb_buffer_pool_filename ib_buffer_pool
innodb_buffer_pool_instances 8
innodb_buffer_pool_load_abort OFF
innodb_buffer_pool_load_at_startup OFF
innodb_buffer_pool_load_now OFF
innodb_buffer_pool_populate OFF
innodb_buffer_pool_size 536870912
innodb_change_buffer_max_size 25
innodb_change_buffering all
innodb_checksum_algorithm innodb
innodb_checksums ON
innodb_cleaner_lsn_age_factor high_checkpoint
innodb_cmp_per_index_enabled OFF
innodb_commit_concurrency 0
innodb_compression_failure_threshold_pct 5
innodb_compression_level 6
innodb_compression_pad_pct_max 50
innodb_concurrency_tickets 5000
innodb_corrupt_table_action assert
innodb_data_file_path ibdata1:12M:autoextend
innodb_data_home_dir
innodb_disable_sort_file_cache OFF
innodb_doublewrite ON
innodb_empty_free_list_algorithm backoff
innodb_fake_changes OFF
innodb_fast_shutdown 1
innodb_file_format Antelope
innodb_file_format_check ON
innodb_file_format_max Antelope
innodb_file_per_table ON
innodb_flush_log_at_timeout 1
innodb_flush_log_at_trx_commit 1
innodb_flush_method O_DIRECT
innodb_flush_neighbors 1
innodb_flushing_avg_loops 30
innodb_force_load_corrupted OFF
innodb_force_recovery 0
innodb_foreground_preflush exponential_backoff
innodb_ft_aux_table
innodb_ft_cache_size 8000000
innodb_ft_enable_diag_print OFF
innodb_ft_enable_stopword ON
innodb_ft_max_token_size 84
innodb_ft_min_token_size 3
innodb_ft_num_word_optimize 2000
innodb_ft_result_cache_limit 2000000000
innodb_ft_server_stopword_table
innodb_ft_sort_pll_degree 2
innodb_ft_total_cache_size 640000000
innodb_ft_user_stopword_table
innodb_io_capacity 400
innodb_io_capacity_max 2000
innodb_kill_idle_transaction 0
innodb_large_prefix OFF
innodb_lock_wait_timeout 50
innodb_locking_fake_changes ON
innodb_locks_unsafe_for_binlog OFF
innodb_log_arch_dir ./
innodb_log_arch_expire_sec 0
innodb_log_archive OFF
innodb_log_block_size 512
innodb_log_buffer_size 4194304
innodb_log_checksum_algorithm innodb
innodb_log_compressed_pages ON
innodb_log_file_size 67108864
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_lru_scan_depth 1024
innodb_max_bitmap_file_size 104857600
innodb_max_changed_pages 1000000
innodb_max_dirty_pages_pct 75
innodb_max_dirty_pages_pct_lwm 0
innodb_max_purge_lag 0
innodb_max_purge_lag_delay 0
innodb_mirrored_log_groups 1
innodb_monitor_disable
innodb_monitor_enable
innodb_monitor_reset
innodb_monitor_reset_all
innodb_old_blocks_pct 37
innodb_old_blocks_time 1000
innodb_online_alter_log_max_size 134217728
innodb_open_files 400
innodb_optimize_fulltext_only OFF
innodb_page_size 16384
innodb_print_all_deadlocks OFF
innodb_purge_batch_size 300
innodb_purge_threads 1
innodb_random_read_ahead OFF
innodb_read_ahead_threshold 56
innodb_read_io_threads 4
innodb_read_only OFF
innodb_replication_delay 0
innodb_rollback_on_timeout OFF
innodb_rollback_segments 128
innodb_sched_priority_cleaner 19
innodb_show_locks_held 10
innodb_show_verbose_locks 0
innodb_sort_buffer_size 1048576
innodb_spin_wait_delay 6
innodb_stats_auto_recalc ON
innodb_stats_method nulls_equal
innodb_stats_on_metadata OFF
innodb_stats_persistent ON
innodb_stats_persistent_sample_pages 20
innodb_stats_sample_pages 8
innodb_stats_transient_sample_pages 8
innodb_status_output OFF
innodb_status_output_locks OFF
innodb_strict_mode OFF
innodb_support_xa ON
innodb_sync_array_size 1
innodb_sync_spin_loops 30
innodb_table_locks ON
innodb_thread_concurrency 0
innodb_thread_sleep_delay 10000
innodb_track_changed_pages OFF
innodb_undo_directory .
innodb_undo_logs 128
innodb_undo_tablespaces 0
innodb_use_atomic_writes OFF
innodb_use_fallocate OFF
innodb_use_global_flush_log_at_trx_commit ON
innodb_use_native_aio ON
innodb_use_stacktrace OFF
innodb_use_sys_malloc ON
innodb_version 5.6.17-65.0
innodb_write_io_threads 4
interactive_timeout 120
join_buffer_size 262144
join_buffer_space_limit 2097152
join_cache_level 2
keep_files_on_create OFF
key_buffer_size 67108864
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
key_cache_segments 0
large_files_support ON
large_page_size 0
large_pages OFF
lc_messages en_US
lc_messages_dir /usr/share/mysql
lc_time_names en_US
license GPL
local_infile ON
lock_wait_timeout 31536000
locked_in_memory OFF
log_bin ON
log_bin_trust_function_creators ON
log_error
log_output FILE
log_queries_not_using_indexes OFF
log_slave_updates OFF
log_slow_filter admin,filesort,filesort_on_disk,full_join,full_scan,query_cache,query_cache_miss,tmp_table,tmp_table_on_disk
log_slow_rate_limit 1
log_slow_verbosity query_plan
log_warnings 2
long_query_time 2.000000
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
master_verify_checksum OFF
max_allowed_packet 16777216
max_binlog_cache_size 18446744073709547520
max_binlog_size 104857600
max_binlog_stmt_cache_size 18446744073709547520
max_connect_errors 100
max_connections 65
max_delayed_threads 20
max_error_count 64
max_heap_table_size 33554432
max_insert_delayed_threads 20
max_join_size 18446744073709551615
max_length_for_sort_data 1024
max_long_data_size 16777216
max_prepared_stmt_count 16382
max_relay_log_size 104857600
max_seeks_for_key 4294967295
max_sort_length 1024
max_sp_recursion_depth 0
max_tmp_tables 32
max_user_connections 60
max_write_lock_count 4294967295
metadata_locks_cache_size 1024
metadata_locks_hash_instances 8
min_examined_row_limit 0
mrr_buffer_size 262144
multi_range_count 256
myisam_block_size 1024
myisam_data_pointer_size 6
myisam_max_sort_file_size 9223372036853727232
myisam_mmap_size 18446744073709551615
myisam_recover_options BACKUP
myisam_repair_threads 1
myisam_sort_buffer_size 67108864
myisam_stats_method nulls_unequal
myisam_use_mmap OFF
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 30
old OFF
old_alter_table OFF
old_mode
old_passwords OFF
open_files_limit 1024
optimizer_prune_level 1
optimizer_search_depth 62
optimizer_selectivity_sampling_limit 100
optimizer_switch index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=off
optimizer_use_condition_selectivity 1
performance_schema ON
performance_schema_accounts_size 10
performance_schema_digests_size 1000
performance_schema_events_stages_history_long_size 100
performance_schema_events_stages_history_size 5
performance_schema_events_statements_history_long_size 100
performance_schema_events_statements_history_size 5
performance_schema_events_waits_history_long_size 100
performance_schema_events_waits_history_size 5
performance_schema_hosts_size 20
performance_schema_max_cond_classes 80
performance_schema_max_cond_instances 645
performance_schema_max_file_classes 50
performance_schema_max_file_handles 32768
performance_schema_max_file_instances 1556
performance_schema_max_mutex_classes 200
performance_schema_max_mutex_instances 2995
performance_schema_max_rwlock_classes 40
performance_schema_max_rwlock_instances 1628
performance_schema_max_socket_classes 10
performance_schema_max_socket_instances 84
performance_schema_max_stage_classes 150
performance_schema_max_statement_classes 180
performance_schema_max_table_handles 445
performance_schema_max_table_instances 445
performance_schema_max_thread_classes 50
performance_schema_max_thread_instances 128
performance_schema_session_connect_attrs_size 512
performance_schema_setup_actors_size 100
performance_schema_setup_objects_size 100
performance_schema_users_size 5
pid_file /var/run/mysqld/mysqld.pid
plugin_dir /usr/lib/mysql/plugin/
plugin_maturity unknown
port 3306
preload_buffer_size 32768
profiling OFF
profiling_history_size 15
progress_report_time 5
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 262144
query_cache_min_res_unit 4096
query_cache_size 33554432
query_cache_strip_comments OFF
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 4096
read_buffer_size 262144
read_only OFF
read_rnd_buffer_size 524288
relay_log /var/log/mysql/relay-bin
relay_log_index /var/log/mysql/relay-bin.index
relay_log_info_file /var/log/mysql/relay-bin.info
relay_log_purge ON
relay_log_recovery OFF
relay_log_space_limit 0
replicate_annotate_row_events OFF
replicate_do_db
replicate_do_table
replicate_events_marked_for_skip replicate
replicate_ignore_db
replicate_ignore_table
replicate_wild_do_table
replicate_wild_ignore_table
report_host
report_password
report_port 3306
report_user
rowid_merge_buff_size 8388608
rpl_recovery_rank 0
secure_auth OFF
secure_file_priv
server_id 2
skip_external_locking ON
skip_name_resolve OFF
skip_networking OFF
skip_show_database OFF
slave_compressed_protocol OFF
slave_ddl_exec_mode IDEMPOTENT
slave_domain_parallel_threads 0
slave_exec_mode STRICT
slave_load_tmpdir /tmp
slave_max_allowed_packet 1073741824
slave_net_timeout 3600
slave_parallel_max_queued 131072
slave_parallel_threads 0
slave_skip_errors OFF
slave_sql_verify_checksum ON
slave_transaction_retries 10
slave_type_conversions
slow_launch_time 2
slow_query_log ON
slow_query_log_file /var/log/mysql/mysql-slow.log
socket /var/run/mysqld/mysqld.sock
sort_buffer_size 2097152
sql_auto_is_null OFF
sql_big_selects ON
sql_buffer_result OFF
sql_log_bin ON
sql_log_off OFF
sql_mode
sql_notes ON
sql_quote_show_create ON
sql_safe_updates OFF
sql_select_limit 18446744073709551615
sql_slave_skip_counter 0
sql_warnings OFF
ssl_ca
ssl_capath
ssl_cert
ssl_cipher
ssl_crl
ssl_crlpath
ssl_key
storage_engine InnoDB
stored_program_cache 256
sync_binlog 1
sync_frm ON
sync_master_info 0
sync_relay_log 0
sync_relay_log_info 0
system_time_zone PDT
table_definition_cache 400
table_open_cache 128
thread_cache_size 32
thread_concurrency 8
thread_handling one-thread-per-connection
thread_pool_idle_timeout 60
thread_pool_max_threads 500
thread_pool_oversubscribe 3
thread_pool_size 4
thread_pool_stall_limit 500
thread_stack 196608
time_format %H:%i:%s
time_zone SYSTEM
timed_mutexes OFF
tmp_table_size 33554432
tmpdir /tmp
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
tx_read_only OFF
unique_checks ON
updatable_views_with_limit YES
use_stat_tables NEVER
userstat OFF
version 10.0.11-MariaDB-1~wheezy-log
version_comment mariadb.org binary distribution
version_compile_machine x86_64
version_compile_os debian-linux-gnu
version_malloc_library bundled jemalloc
wait_timeout 15
GLOBAL STATUS
==================================================
Aborted_clients 53
Aborted_connects 2981
Access_denied_errors 1
Aria_pagecache_blocks_not_flushed 0
Aria_pagecache_blocks_unused 15737
Aria_pagecache_blocks_used 2
Aria_pagecache_read_requests 4064
Aria_pagecache_reads 520
Aria_pagecache_write_requests 592
Aria_pagecache_writes 0
Aria_transaction_log_syncs 0
Binlog_commits 388754
Binlog_group_commits 380721
Binlog_snapshot_file mariadb-bin.000717
Binlog_snapshot_position 102400030
Binlog_bytes_written 181612989
Binlog_cache_disk_use 1
Binlog_cache_use 388761
Binlog_stmt_cache_disk_use 0
Binlog_stmt_cache_use 0
Busy_time 0.000000
Bytes_received 490713275
Bytes_sent 5297754877
Com_admin_commands 7
Com_alter_db 0
Com_alter_db_upgrade 0
Com_alter_event 0
Com_alter_function 0
Com_alter_procedure 0
Com_alter_server 0
Com_alter_table 0
Com_alter_tablespace 0
Com_analyze 0
Com_assign_to_keycache 0
Com_begin 139167
Com_binlog 0
Com_call_procedure 0
Com_change_db 263
Com_change_master 0
Com_check 0
Com_checksum 261
Com_commit 139153
Com_create_db 0
Com_create_event 0
Com_create_function 0
Com_create_index 0
Com_create_procedure 0
Com_create_role 0
Com_create_server 0
Com_create_table 0
Com_create_trigger 0
Com_create_udf 0
Com_create_user 0
Com_create_view 0
Com_dealloc_sql 0
Com_delete 9944
Com_delete_multi 4
Com_do 0
Com_drop_db 0
Com_drop_event 0
Com_drop_function 0
Com_drop_index 0
Com_drop_procedure 0
Com_drop_role 0
Com_drop_server 0
Com_drop_table 0
Com_drop_trigger 0
Com_drop_user 0
Com_drop_view 0
Com_empty_query 0
Com_execute_sql 0
Com_flush 8
Com_get_diagnostics 0
Com_grant 0
Com_grant_role 0
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_help 0
Com_insert 45177
Com_insert_select 0
Com_install_plugin 0
Com_kill 0
Com_load 0
Com_lock_tables 0
Com_optimize 0
Com_preload_keys 0
Com_prepare_sql 0
Com_purge 0
Com_purge_before_date 1
Com_release_savepoint 3
Com_rename_table 0
Com_rename_user 0
Com_repair 0
Com_replace 0
Com_replace_select 0
Com_reset 0
Com_resignal 0
Com_revoke 0
Com_revoke_all 0
Com_revoke_role 0
Com_rollback 11
Com_rollback_to_savepoint 216
Com_savepoint 3
Com_select 1331400
Com_set_option 23013
Com_show_authors 0
Com_show_binlog_events 0
Com_show_binlogs 597
Com_show_charsets 0
Com_show_client_statistics 0
Com_show_collations 0
Com_show_contributors 0
Com_show_create_db 0
Com_show_create_event 0
Com_show_create_func 3
Com_show_create_proc 0
Com_show_create_table 602
Com_show_create_trigger 0
Com_show_databases 4
Com_show_engine_logs 0
Com_show_engine_mutex 0
Com_show_engine_status 613
Com_show_errors 0
Com_show_events 0
Com_show_explain 0
Com_show_fields 296
Com_show_function_status 0
Com_show_grants 0
Com_show_index_statistics 0
Com_show_keys 20
Com_show_master_status 0
Com_show_open_tables 0
Com_show_plugins 0
Com_show_privileges 0
Com_show_procedure_status 0
Com_show_processlist 0
Com_show_profile 0
Com_show_profiles 11
Com_show_relaylog_events 0
Com_show_slave_hosts 0
Com_show_slave_status 1194
Com_show_status 652
Com_show_storage_engines 0
Com_show_table_statistics 0
Com_show_table_status 216
Com_show_tables 11
Com_show_triggers 222
Com_show_user_statistics 0
Com_show_variables 623
Com_show_warnings 0
Com_shutdown 0
Com_signal 0
Com_start_all_slaves 0
Com_start_slave 0
Com_stmt_close 1567132
Com_stmt_execute 1567132
Com_stmt_fetch 0
Com_stmt_prepare 1567132
Com_stmt_reprepare 0
Com_stmt_reset 0
Com_stmt_send_long_data 0
Com_stop_all_slaves 0
Com_stop_slave 447015
Com_truncate 0
Com_uninstall_plugin 0
Com_unlock_tables 3
Com_update 365053
Com_update_multi 0
Com_xa_commit 0
Com_xa_end 0
Com_xa_prepare 0
Com_xa_recover 0
Com_xa_rollback 0
Com_xa_start 0
Compression OFF
Connection_errors_accept 0
Connection_errors_internal 0
Connection_errors_max_connections 0
Connection_errors_peer_address 0
Connection_errors_select 0
Connection_errors_tcpwrap 0
Connections 451580
Cpu_time 0.000000
Created_tmp_disk_tables 557
Created_tmp_files 13
Created_tmp_tables 95668
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Empty_queries 326408
Executed_events 0
Executed_triggers 0
Feature_dynamic_columns 0
Feature_fulltext 0
Feature_gis 0
Feature_locale 0
Feature_subquery 166933
Feature_timezone 3
Feature_trigger 0
Feature_xml 0
Flush_commands 5
Handler_commit 1481805
Handler_delete 12085
Handler_discover 0
Handler_external_lock 0
Handler_icp_attempts 412884
Handler_icp_match 229663
Handler_mrr_init 0
Handler_mrr_key_refills 0
Handler_mrr_rowid_refills 0
Handler_prepare 730949
Handler_read_first 4687
Handler_read_key 2827569
Handler_read_last 271
Handler_read_next 6265552
Handler_read_prev 17163099
Handler_read_rnd 949454
Handler_read_rnd_deleted 5
Handler_read_rnd_next 66999805
Handler_rollback 331
Handler_savepoint 6
Handler_savepoint_rollback 432
Handler_tmp_update 52
Handler_tmp_write 794786
Handler_update 187721
Handler_write 45178
Innodb_available_undo_logs 128
Innodb_background_log_sync 174887
Innodb_buffer_pool_bytes_data 497696768
Innodb_buffer_pool_bytes_dirty 966656
Innodb_buffer_pool_dump_status not started
Innodb_buffer_pool_load_status not started
Innodb_buffer_pool_pages_data 30377
Innodb_buffer_pool_pages_dirty 59
Innodb_buffer_pool_pages_flushed 219751
Innodb_buffer_pool_pages_free 1024
Innodb_buffer_pool_pages_lru_flushed 0
Innodb_buffer_pool_pages_made_not_young 7802825
Innodb_buffer_pool_pages_made_young 111036
Innodb_buffer_pool_pages_misc 1366
Innodb_buffer_pool_pages_old 11193
Innodb_buffer_pool_pages_total 32767
Innodb_buffer_pool_read_ahead 46582
Innodb_buffer_pool_read_ahead_evicted 0
Innodb_buffer_pool_read_ahead_rnd 0
Innodb_buffer_pool_read_requests 108881491
Innodb_buffer_pool_reads 102472
Innodb_buffer_pool_wait_free 0
Innodb_buffer_pool_write_requests 1815500
Innodb_checkpoint_age 14294
Innodb_checkpoint_max_age 108005254
Innodb_data_fsyncs 331128
Innodb_data_pending_fsyncs 1
Innodb_data_pending_reads 0
Innodb_data_pending_writes 0
Innodb_data_read 2470580224
Innodb_data_reads 150873
Innodb_data_writes 503833
Innodb_data_written 7447897088
Innodb_dblwr_pages_written 219751
Innodb_dblwr_writes 25874
Innodb_deadlocks 9
Innodb_have_atomic_builtins ON
Innodb_history_list_length 3284
Innodb_ibuf_discarded_delete_marks 0
Innodb_ibuf_discarded_deletes 0
Innodb_ibuf_discarded_inserts 0
Innodb_ibuf_free_list 143
Innodb_ibuf_merged_delete_marks 3383
Innodb_ibuf_merged_deletes 1866
Innodb_ibuf_merged_inserts 2124
Innodb_ibuf_merges 2091
Innodb_ibuf_segment_size 145
Innodb_ibuf_size 1
Innodb_log_waits 0
Innodb_log_write_requests 232924
Innodb_log_writes 236506
Innodb_lsn_current 60890507015
Innodb_lsn_flushed 60890506525
Innodb_lsn_last_checkpoint 60890492721
Innodb_master_thread_active_loops 80742
Innodb_master_thread_idle_loops 94160
Innodb_max_trx_id 181302712
Innodb_mem_adaptive_hash 31235792
Innodb_mem_dictionary 2745710
Innodb_mem_total 549453824
Innodb_mutex_os_waits 45236
Innodb_mutex_spin_rounds 7714968
Innodb_mutex_spin_waits 340407
Innodb_oldest_view_low_limit_trx_id 0
Innodb_os_log_fsyncs 249496
Innodb_os_log_pending_fsyncs 1
Innodb_os_log_pending_writes 0
Innodb_os_log_written 236351488
Innodb_page_size 16384
Innodb_pages_created 618
Innodb_pages_read 150787
Innodb_pages_written 219751
Innodb_purge_trx_id 181302710
Innodb_purge_undo_no 0
Innodb_read_views_memory 552
Innodb_row_lock_current_waits 0
Innodb_row_lock_time 42761
Innodb_row_lock_time_avg 90
Innodb_row_lock_time_max 1150
Innodb_row_lock_waits 474
Innodb_rows_deleted 12085
Innodb_rows_inserted 44260
Innodb_rows_read 93001360
Innodb_rows_updated 187721
Innodb_s_lock_os_waits 23138
Innodb_s_lock_spin_rounds 699885
Innodb_s_lock_spin_waits 23671
Innodb_truncated_status_writes 0
Innodb_x_lock_os_waits 2877
Innodb_x_lock_spin_rounds 88806
Innodb_x_lock_spin_waits 169
Key_blocks_not_flushed 0
Key_blocks_unused 53583
Key_blocks_used 2
Key_blocks_warm 0
Key_read_requests 1560
Key_reads 8
Key_write_requests 0
Key_writes 0
Last_query_cost 0.000000
Max_used_connections 18
Memory_used 242496560
Not_flushed_delayed_rows 0
Open_files 17
Open_streams 0
Open_table_definitions 74
Open_tables 124
Opened_files 40476
Opened_plugin_libraries 0
Opened_table_definitions 240
Opened_tables 609
Opened_views 0
Performance_schema_accounts_lost 0
Performance_schema_cond_classes_lost 0
Performance_schema_cond_instances_lost 0
Performance_schema_digest_lost 0
Performance_schema_file_classes_lost 1
Performance_schema_file_handles_lost 0
Performance_schema_file_instances_lost 0
Performance_schema_hosts_lost 0
Performance_schema_locker_lost 0
Performance_schema_mutex_classes_lost 0
Performance_schema_mutex_instances_lost 0
Performance_schema_rwlock_classes_lost 0
Performance_schema_rwlock_instances_lost 0
Performance_schema_session_connect_attrs_lost 0
Performance_schema_socket_classes_lost 0
Performance_schema_socket_instances_lost 0
Performance_schema_stage_classes_lost 0
Performance_schema_statement_classes_lost 0
Performance_schema_table_handles_lost 0
Performance_schema_table_instances_lost 0
Performance_schema_thread_classes_lost 0
Performance_schema_thread_instances_lost 0
Performance_schema_users_lost 1
Prepared_stmt_count 0
Qcache_free_blocks 5234
Qcache_free_memory 18581136
Qcache_hits 967185
Qcache_inserts 283158
Qcache_lowmem_prunes 38515
Qcache_not_cached 77005
Qcache_queries_in_cache 13744
Qcache_total_blocks 32764
Queries 6092219
Questions 2954038
Rows_read 92962071
Rows_sent 15134564
Rows_tmp_read 815425
Rpl_status AUTH_MASTER
Select_full_join 3
Select_full_range_join 2
Select_range 73422
Select_range_check 60
Select_scan 11567
Slave_heartbeat_period 1800.000
Slave_open_temp_tables 0
Slave_received_heartbeats 0
Slave_retried_transactions 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 42
Sort_merge_passes 3
Sort_range 185365
Sort_rows 1010314
Sort_scan 19624
Ssl_accept_renegotiates 0
Ssl_accepts 0
Ssl_callback_cache_hits 0
Ssl_cipher
Ssl_cipher_list
Ssl_client_connects 0
Ssl_connect_renegotiates 0
Ssl_ctx_verify_depth 0
Ssl_ctx_verify_mode 0
Ssl_default_timeout 0
Ssl_finished_accepts 0
Ssl_finished_connects 0
Ssl_server_not_after
Rpl_status AUTH_MASTER
Select_full_join 3
Select_full_range_join 2
Select_range 73422
Select_range_check 60
Select_scan 11567
Slave_heartbeat_period 1800.000
Slave_open_temp_tables 0
Slave_received_heartbeats 0
Slave_retried_transactions 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 42
Sort_merge_passes 3
Sort_range 185365
Sort_rows 1010314
Sort_scan 19624
Ssl_accept_renegotiates 0
Ssl_accepts 0
Ssl_callback_cache_hits 0
Ssl_cipher
Ssl_cipher_list
Ssl_client_connects 0
Ssl_connect_renegotiates 0
Ssl_ctx_verify_depth 0
Ssl_ctx_verify_mode 0
Ssl_default_timeout 0
Ssl_finished_accepts 0
Ssl_finished_connects 0
Ssl_server_not_after
Ssl_server_not_before
Ssl_session_cache_hits 0
Ssl_session_cache_misses 0
Ssl_session_cache_mode NONE
Ssl_session_cache_overflows 0
Ssl_session_cache_size 0
Ssl_session_cache_timeouts 0
Ssl_sessions_reused 0
Ssl_used_session_cache_entries 0
Ssl_verify_depth 0
Ssl_verify_mode 0
Ssl_version
Subquery_cache_hit 172108
Subquery_cache_miss 16734
Syncs 177196
Table_locks_immediate 926927
Table_locks_waited 0
Tc_log_max_pages_used 0
Tc_log_page_size 0
Tc_log_page_waits 0
Threadpool_idle_threads 0
Threadpool_threads 0
Threads_cached 14
Threads_connected 4
Threads_created 18
Threads_running 3
Uptime 178882
Uptime_since_flush_status 178882
debian 7.5 64 bit
filesystem: ext3 with relatime
Replicating from one master to one slave. Slave is in total standby (not a read slave). If master fails for any
kind of reason (network outage, mysqld crashes, etc.) we switch to slave which is located at another physical
location (east coast vs west coast). Whatever did not reach slave at that point is discarded. Slave becomes the
new master. Slave db is dumped to restore old master to new slave.
We currently use the recommended settings:
sync-binlog = 1
innodb_flush_log_at_trx_commit = 1
But performance is TERRIBLE. Disabling BOTH settings gives us an order of magnitude improvement in writes.
We have done no tuning of kernel based caches or HDD caches. We use software RAID 1 (2 disks).
$ hdparm /dev/sda
/dev/sda:
multcount = 16 (on)
IO_support = 0 (default)
readonly = 0 (off)
readahead = 256 (on)
geometry = 30400/255/63, sectors = 488390625, start = 0
$ cat /proc/sys/vm/drop_caches
0
$ cat /proc/sys/vm/dirty_expire_centisecs
3000
$ cat /proc/sys/vm/dirty_writeback_centisecs
500
The question we have is, considering our replication strategy, would it be safe to run with sync-binlog = 0
(or a high number like 100) AND innodb_flush_log_at_trx_commit = 0?
Are there any other NEWER settings worth trying to make the disk flushing less of a performance killer? I was
under the impression that 5.6 and newer mysql drastically improved these sorts of issues.
GLOBAL VARS and STATUS FOLLOWS
=====================================
aria_block_size 8192
aria_checkpoint_interval 30
aria_checkpoint_log_activity 1048576
aria_force_start_after_recovery_failures 0
aria_group_commit none
aria_group_commit_interval 0
aria_log_file_size 1073741824
aria_log_purge_type immediate
aria_max_sort_file_size 9223372036853727232
aria_page_checksum ON
aria_pagecache_age_threshold 300
aria_pagecache_buffer_size 134217728
aria_pagecache_division_limit 100
aria_recover NORMAL
aria_repair_threads 1
aria_sort_buffer_size 268434432
aria_stats_method nulls_unequal
aria_sync_log_dir NEWFILE
aria_used_for_temp_tables ON
auto_increment_increment 1
auto_increment_offset 1
autocommit ON
automatic_sp_privileges ON
back_log 65
basedir /usr
big_tables OFF
binlog_annotate_row_events OFF
binlog_cache_size 32768
binlog_checksum NONE
binlog_commit_wait_count 0
binlog_commit_wait_usec 100000
binlog_direct_non_transactional_updates OFF
binlog_format STATEMENT
binlog_optimize_thread_scheduling ON
binlog_stmt_cache_size 32768
bulk_insert_buffer_size 16777216
character_set_client latin1
character_set_connection latin1
character_set_database latin1
character_set_filesystem binary
character_set_results latin1
character_set_server latin1
character_set_system utf8
character_sets_dir /usr/share/mysql/charsets/
collation_connection latin1_swedish_ci
collation_database latin1_swedish_ci
collation_server latin1_swedish_ci
completion_type NO_CHAIN
concurrent_insert AUTO
connect_timeout 5
datadir /var/lib/mysql/
date_format %Y-%m-%d
datetime_format %Y-%m-%d %H:%i:%s
deadlock_search_depth_long 15
deadlock_search_depth_short 4
deadlock_timeout_long 50000000
deadlock_timeout_short 10000
debug_no_thread_alarm OFF
default_regex_flags
default_storage_engine InnoDB
default_week_format 0
delay_key_write ON
delayed_insert_limit 100
delayed_insert_timeout 300
delayed_queue_size 1000
div_precision_increment 4
event_scheduler OFF
expensive_subquery_limit 100
expire_logs_days 0
extra_max_connections 1
extra_port 0
flush OFF
flush_time 0
foreign_key_checks ON
ft_boolean_syntax + -><()~*:""&|
ft_max_word_len 84
ft_min_word_len 4
ft_query_expansion_limit 20
ft_stopword_file (built-in)
general_log OFF
group_concat_max_len 1024
gtid_binlog_pos 0-2-8061682
gtid_binlog_state 0-2-8061682
gtid_current_pos 0-2-8061682
gtid_domain_id 0
gtid_ignore_duplicates OFF
gtid_slave_pos 0-1-5800710
gtid_strict_mode OFF
have_compress YES
have_crypt YES
have_dynamic_loading YES
have_geometry YES
have_openssl YES
have_profiling YES
have_query_cache YES
have_rtree_keys YES
have_ssl DISABLED
have_symlink YES
histogram_size 0
histogram_type SINGLE_PREC_HB
host_cache_size 128
ignore_builtin_innodb OFF
ignore_db_dirs
init_connect
init_file
init_slave
innodb_adaptive_flushing ON
innodb_adaptive_flushing_lwm 10
innodb_adaptive_hash_index ON
innodb_adaptive_hash_index_partitions 1
innodb_adaptive_max_sleep_delay 150000
innodb_additional_mem_pool_size 20971520
innodb_api_bk_commit_interval 5
innodb_api_disable_rowlock OFF
innodb_api_enable_binlog OFF
innodb_api_enable_mdl OFF
innodb_api_trx_level 0
innodb_autoextend_increment 64
innodb_autoinc_lock_mode 1
innodb_buffer_pool_dump_at_shutdown OFF
innodb_buffer_pool_dump_now OFF
innodb_buffer_pool_filename ib_buffer_pool
innodb_buffer_pool_instances 8
innodb_buffer_pool_load_abort OFF
innodb_buffer_pool_load_at_startup OFF
innodb_buffer_pool_load_now OFF
innodb_buffer_pool_populate OFF
innodb_buffer_pool_size 536870912
innodb_change_buffer_max_size 25
innodb_change_buffering all
innodb_checksum_algorithm innodb
innodb_checksums ON
innodb_cleaner_lsn_age_factor high_checkpoint
innodb_cmp_per_index_enabled OFF
innodb_commit_concurrency 0
innodb_compression_failure_threshold_pct 5
innodb_compression_level 6
innodb_compression_pad_pct_max 50
innodb_concurrency_tickets 5000
innodb_corrupt_table_action assert
innodb_data_file_path ibdata1:12M:autoextend
innodb_data_home_dir
innodb_disable_sort_file_cache OFF
innodb_doublewrite ON
innodb_empty_free_list_algorithm backoff
innodb_fake_changes OFF
innodb_fast_shutdown 1
innodb_file_format Antelope
innodb_file_format_check ON
innodb_file_format_max Antelope
innodb_file_per_table ON
innodb_flush_log_at_timeout 1
innodb_flush_log_at_trx_commit 1
innodb_flush_method O_DIRECT
innodb_flush_neighbors 1
innodb_flushing_avg_loops 30
innodb_force_load_corrupted OFF
innodb_force_recovery 0
innodb_foreground_preflush exponential_backoff
innodb_ft_aux_table
innodb_ft_cache_size 8000000
innodb_ft_enable_diag_print OFF
innodb_ft_enable_stopword ON
innodb_ft_max_token_size 84
innodb_ft_min_token_size 3
innodb_ft_num_word_optimize 2000
innodb_ft_result_cache_limit 2000000000
innodb_ft_server_stopword_table
innodb_ft_sort_pll_degree 2
innodb_ft_total_cache_size 640000000
innodb_ft_user_stopword_table
innodb_io_capacity 400
innodb_io_capacity_max 2000
innodb_kill_idle_transaction 0
innodb_large_prefix OFF
innodb_lock_wait_timeout 50
innodb_locking_fake_changes ON
innodb_locks_unsafe_for_binlog OFF
innodb_log_arch_dir ./
innodb_log_arch_expire_sec 0
innodb_log_archive OFF
innodb_log_block_size 512
innodb_log_buffer_size 4194304
innodb_log_checksum_algorithm innodb
innodb_log_compressed_pages ON
innodb_log_file_size 67108864
innodb_log_files_in_group 2
innodb_log_group_home_dir ./
innodb_lru_scan_depth 1024
innodb_max_bitmap_file_size 104857600
innodb_max_changed_pages 1000000
innodb_max_dirty_pages_pct 75
innodb_max_dirty_pages_pct_lwm 0
innodb_max_purge_lag 0
innodb_max_purge_lag_delay 0
innodb_mirrored_log_groups 1
innodb_monitor_disable
innodb_monitor_enable
innodb_monitor_reset
innodb_monitor_reset_all
innodb_old_blocks_pct 37
innodb_old_blocks_time 1000
innodb_online_alter_log_max_size 134217728
innodb_open_files 400
innodb_optimize_fulltext_only OFF
innodb_page_size 16384
innodb_print_all_deadlocks OFF
innodb_purge_batch_size 300
innodb_purge_threads 1
innodb_random_read_ahead OFF
innodb_read_ahead_threshold 56
innodb_read_io_threads 4
innodb_read_only OFF
innodb_replication_delay 0
innodb_rollback_on_timeout OFF
innodb_rollback_segments 128
innodb_sched_priority_cleaner 19
innodb_show_locks_held 10
innodb_show_verbose_locks 0
innodb_sort_buffer_size 1048576
innodb_spin_wait_delay 6
innodb_stats_auto_recalc ON
innodb_stats_method nulls_equal
innodb_stats_on_metadata OFF
innodb_stats_persistent ON
innodb_stats_persistent_sample_pages 20
innodb_stats_sample_pages 8
innodb_stats_transient_sample_pages 8
innodb_status_output OFF
innodb_status_output_locks OFF
innodb_strict_mode OFF
innodb_support_xa ON
innodb_sync_array_size 1
innodb_sync_spin_loops 30
innodb_table_locks ON
innodb_thread_concurrency 0
innodb_thread_sleep_delay 10000
innodb_track_changed_pages OFF
innodb_undo_directory .
innodb_undo_logs 128
innodb_undo_tablespaces 0
innodb_use_atomic_writes OFF
innodb_use_fallocate OFF
innodb_use_global_flush_log_at_trx_commit ON
innodb_use_native_aio ON
innodb_use_stacktrace OFF
innodb_use_sys_malloc ON
innodb_version 5.6.17-65.0
innodb_write_io_threads 4
interactive_timeout 120
join_buffer_size 262144
join_buffer_space_limit 2097152
join_cache_level 2
keep_files_on_create OFF
key_buffer_size 67108864
key_cache_age_threshold 300
key_cache_block_size 1024
key_cache_division_limit 100
key_cache_segments 0
large_files_support ON
large_page_size 0
large_pages OFF
lc_messages en_US
lc_messages_dir /usr/share/mysql
lc_time_names en_US
license GPL
local_infile ON
lock_wait_timeout 31536000
locked_in_memory OFF
log_bin ON
log_bin_trust_function_creators ON
log_error
log_output FILE
log_queries_not_using_indexes OFF
log_slave_updates OFF
log_slow_filter admin,filesort,filesort_on_disk,full_join,full_scan,query_cache,query_cache_miss,tmp_table,tmp_table_on_disk
log_slow_rate_limit 1
log_slow_verbosity query_plan
log_warnings 2
long_query_time 2.000000
low_priority_updates OFF
lower_case_file_system OFF
lower_case_table_names 0
master_verify_checksum OFF
max_allowed_packet 16777216
max_binlog_cache_size 18446744073709547520
max_binlog_size 104857600
max_binlog_stmt_cache_size 18446744073709547520
max_connect_errors 100
max_connections 65
max_delayed_threads 20
max_error_count 64
max_heap_table_size 33554432
max_insert_delayed_threads 20
max_join_size 18446744073709551615
max_length_for_sort_data 1024
max_long_data_size 16777216
max_prepared_stmt_count 16382
max_relay_log_size 104857600
max_seeks_for_key 4294967295
max_sort_length 1024
max_sp_recursion_depth 0
max_tmp_tables 32
max_user_connections 60
max_write_lock_count 4294967295
metadata_locks_cache_size 1024
metadata_locks_hash_instances 8
min_examined_row_limit 0
mrr_buffer_size 262144
multi_range_count 256
myisam_block_size 1024
myisam_data_pointer_size 6
myisam_max_sort_file_size 9223372036853727232
myisam_mmap_size 18446744073709551615
myisam_recover_options BACKUP
myisam_repair_threads 1
myisam_sort_buffer_size 67108864
myisam_stats_method nulls_unequal
myisam_use_mmap OFF
net_buffer_length 16384
net_read_timeout 30
net_retry_count 10
net_write_timeout 30
old OFF
old_alter_table OFF
old_mode
old_passwords OFF
open_files_limit 1024
optimizer_prune_level 1
optimizer_search_depth 62
optimizer_selectivity_sampling_limit 100
optimizer_switch index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=off
optimizer_use_condition_selectivity 1
performance_schema ON
performance_schema_accounts_size 10
performance_schema_digests_size 1000
performance_schema_events_stages_history_long_size 100
performance_schema_events_stages_history_size 5
performance_schema_events_statements_history_long_size 100
performance_schema_events_statements_history_size 5
performance_schema_events_waits_history_long_size 100
performance_schema_events_waits_history_size 5
performance_schema_hosts_size 20
performance_schema_max_cond_classes 80
performance_schema_max_cond_instances 645
performance_schema_max_file_classes 50
performance_schema_max_file_handles 32768
performance_schema_max_file_instances 1556
performance_schema_max_mutex_classes 200
performance_schema_max_mutex_instances 2995
performance_schema_max_rwlock_classes 40
performance_schema_max_rwlock_instances 1628
performance_schema_max_socket_classes 10
performance_schema_max_socket_instances 84
performance_schema_max_stage_classes 150
performance_schema_max_statement_classes 180
performance_schema_max_table_handles 445
performance_schema_max_table_instances 445
performance_schema_max_thread_classes 50
performance_schema_max_thread_instances 128
performance_schema_session_connect_attrs_size 512
performance_schema_setup_actors_size 100
performance_schema_setup_objects_size 100
performance_schema_users_size 5
pid_file /var/run/mysqld/mysqld.pid
plugin_dir /usr/lib/mysql/plugin/
plugin_maturity unknown
port 3306
preload_buffer_size 32768
profiling OFF
profiling_history_size 15
progress_report_time 5
protocol_version 10
query_alloc_block_size 8192
query_cache_limit 262144
query_cache_min_res_unit 4096
query_cache_size 33554432
query_cache_strip_comments OFF
query_cache_type ON
query_cache_wlock_invalidate OFF
query_prealloc_size 8192
range_alloc_block_size 4096
read_buffer_size 262144
read_only OFF
read_rnd_buffer_size 524288
relay_log /var/log/mysql/relay-bin
relay_log_index /var/log/mysql/relay-bin.index
relay_log_info_file /var/log/mysql/relay-bin.info
relay_log_purge ON
relay_log_recovery OFF
relay_log_space_limit 0
replicate_annotate_row_events OFF
replicate_do_db
replicate_do_table
replicate_events_marked_for_skip replicate
replicate_ignore_db
replicate_ignore_table
replicate_wild_do_table
replicate_wild_ignore_table
report_host
report_password
report_port 3306
report_user
rowid_merge_buff_size 8388608
rpl_recovery_rank 0
secure_auth OFF
secure_file_priv
server_id 2
skip_external_locking ON
skip_name_resolve OFF
skip_networking OFF
skip_show_database OFF
slave_compressed_protocol OFF
slave_ddl_exec_mode IDEMPOTENT
slave_domain_parallel_threads 0
slave_exec_mode STRICT
slave_load_tmpdir /tmp
slave_max_allowed_packet 1073741824
slave_net_timeout 3600
slave_parallel_max_queued 131072
slave_parallel_threads 0
slave_skip_errors OFF
slave_sql_verify_checksum ON
slave_transaction_retries 10
slave_type_conversions
slow_launch_time 2
slow_query_log ON
slow_query_log_file /var/log/mysql/mysql-slow.log
socket /var/run/mysqld/mysqld.sock
sort_buffer_size 2097152
sql_auto_is_null OFF
sql_big_selects ON
sql_buffer_result OFF
sql_log_bin ON
sql_log_off OFF
sql_mode
sql_notes ON
sql_quote_show_create ON
sql_safe_updates OFF
sql_select_limit 18446744073709551615
sql_slave_skip_counter 0
sql_warnings OFF
ssl_ca
ssl_capath
ssl_cert
ssl_cipher
ssl_crl
ssl_crlpath
ssl_key
storage_engine InnoDB
stored_program_cache 256
sync_binlog 1
sync_frm ON
sync_master_info 0
sync_relay_log 0
sync_relay_log_info 0
system_time_zone PDT
table_definition_cache 400
table_open_cache 128
thread_cache_size 32
thread_concurrency 8
thread_handling one-thread-per-connection
thread_pool_idle_timeout 60
thread_pool_max_threads 500
thread_pool_oversubscribe 3
thread_pool_size 4
thread_pool_stall_limit 500
thread_stack 196608
time_format %H:%i:%s
time_zone SYSTEM
timed_mutexes OFF
tmp_table_size 33554432
tmpdir /tmp
transaction_alloc_block_size 8192
transaction_prealloc_size 4096
tx_isolation REPEATABLE-READ
tx_read_only OFF
unique_checks ON
updatable_views_with_limit YES
use_stat_tables NEVER
userstat OFF
version 10.0.11-MariaDB-1~wheezy-log
version_comment mariadb.org binary distribution
version_compile_machine x86_64
version_compile_os debian-linux-gnu
version_malloc_library bundled jemalloc
wait_timeout 15
GLOBAL STATUS
==================================================
Aborted_clients 53
Aborted_connects 2981
Access_denied_errors 1
Aria_pagecache_blocks_not_flushed 0
Aria_pagecache_blocks_unused 15737
Aria_pagecache_blocks_used 2
Aria_pagecache_read_requests 4064
Aria_pagecache_reads 520
Aria_pagecache_write_requests 592
Aria_pagecache_writes 0
Aria_transaction_log_syncs 0
Binlog_commits 388754
Binlog_group_commits 380721
Binlog_snapshot_file mariadb-bin.000717
Binlog_snapshot_position 102400030
Binlog_bytes_written 181612989
Binlog_cache_disk_use 1
Binlog_cache_use 388761
Binlog_stmt_cache_disk_use 0
Binlog_stmt_cache_use 0
Busy_time 0.000000
Bytes_received 490713275
Bytes_sent 5297754877
Com_admin_commands 7
Com_alter_db 0
Com_alter_db_upgrade 0
Com_alter_event 0
Com_alter_function 0
Com_alter_procedure 0
Com_alter_server 0
Com_alter_table 0
Com_alter_tablespace 0
Com_analyze 0
Com_assign_to_keycache 0
Com_begin 139167
Com_binlog 0
Com_call_procedure 0
Com_change_db 263
Com_change_master 0
Com_check 0
Com_checksum 261
Com_commit 139153
Com_create_db 0
Com_create_event 0
Com_create_function 0
Com_create_index 0
Com_create_procedure 0
Com_create_role 0
Com_create_server 0
Com_create_table 0
Com_create_trigger 0
Com_create_udf 0
Com_create_user 0
Com_create_view 0
Com_dealloc_sql 0
Com_delete 9944
Com_delete_multi 4
Com_do 0
Com_drop_db 0
Com_drop_event 0
Com_drop_function 0
Com_drop_index 0
Com_drop_procedure 0
Com_drop_role 0
Com_drop_server 0
Com_drop_table 0
Com_drop_trigger 0
Com_drop_user 0
Com_drop_view 0
Com_empty_query 0
Com_execute_sql 0
Com_flush 8
Com_get_diagnostics 0
Com_grant 0
Com_grant_role 0
Com_ha_close 0
Com_ha_open 0
Com_ha_read 0
Com_help 0
Com_insert 45177
Com_insert_select 0
Com_install_plugin 0
Com_kill 0
Com_load 0
Com_lock_tables 0
Com_optimize 0
Com_preload_keys 0
Com_prepare_sql 0
Com_purge 0
Com_purge_before_date 1
Com_release_savepoint 3
Com_rename_table 0
Com_rename_user 0
Com_repair 0
Com_replace 0
Com_replace_select 0
Com_reset 0
Com_resignal 0
Com_revoke 0
Com_revoke_all 0
Com_revoke_role 0
Com_rollback 11
Com_rollback_to_savepoint 216
Com_savepoint 3
Com_select 1331400
Com_set_option 23013
Com_show_authors 0
Com_show_binlog_events 0
Com_show_binlogs 597
Com_show_charsets 0
Com_show_client_statistics 0
Com_show_collations 0
Com_show_contributors 0
Com_show_create_db 0
Com_show_create_event 0
Com_show_create_func 3
Com_show_create_proc 0
Com_show_create_table 602
Com_show_create_trigger 0
Com_show_databases 4
Com_show_engine_logs 0
Com_show_engine_mutex 0
Com_show_engine_status 613
Com_show_errors 0
Com_show_events 0
Com_show_explain 0
Com_show_fields 296
Com_show_function_status 0
Com_show_grants 0
Com_show_index_statistics 0
Com_show_keys 20
Com_show_master_status 0
Com_show_open_tables 0
Com_show_plugins 0
Com_show_privileges 0
Com_show_procedure_status 0
Com_show_processlist 0
Com_show_profile 0
Com_show_profiles 11
Com_show_relaylog_events 0
Com_show_slave_hosts 0
Com_show_slave_status 1194
Com_show_status 652
Com_show_storage_engines 0
Com_show_table_statistics 0
Com_show_table_status 216
Com_show_tables 11
Com_show_triggers 222
Com_show_user_statistics 0
Com_show_variables 623
Com_show_warnings 0
Com_shutdown 0
Com_signal 0
Com_start_all_slaves 0
Com_start_slave 0
Com_stmt_close 1567132
Com_stmt_execute 1567132
Com_stmt_fetch 0
Com_stmt_prepare 1567132
Com_stmt_reprepare 0
Com_stmt_reset 0
Com_stmt_send_long_data 0
Com_stop_all_slaves 0
Com_stop_slave 447015
Com_truncate 0
Com_uninstall_plugin 0
Com_unlock_tables 3
Com_update 365053
Com_update_multi 0
Com_xa_commit 0
Com_xa_end 0
Com_xa_prepare 0
Com_xa_recover 0
Com_xa_rollback 0
Com_xa_start 0
Compression OFF
Connection_errors_accept 0
Connection_errors_internal 0
Connection_errors_max_connections 0
Connection_errors_peer_address 0
Connection_errors_select 0
Connection_errors_tcpwrap 0
Connections 451580
Cpu_time 0.000000
Created_tmp_disk_tables 557
Created_tmp_files 13
Created_tmp_tables 95668
Delayed_errors 0
Delayed_insert_threads 0
Delayed_writes 0
Empty_queries 326408
Executed_events 0
Executed_triggers 0
Feature_dynamic_columns 0
Feature_fulltext 0
Feature_gis 0
Feature_locale 0
Feature_subquery 166933
Feature_timezone 3
Feature_trigger 0
Feature_xml 0
Flush_commands 5
Handler_commit 1481805
Handler_delete 12085
Handler_discover 0
Handler_external_lock 0
Handler_icp_attempts 412884
Handler_icp_match 229663
Handler_mrr_init 0
Handler_mrr_key_refills 0
Handler_mrr_rowid_refills 0
Handler_prepare 730949
Handler_read_first 4687
Handler_read_key 2827569
Handler_read_last 271
Handler_read_next 6265552
Handler_read_prev 17163099
Handler_read_rnd 949454
Handler_read_rnd_deleted 5
Handler_read_rnd_next 66999805
Handler_rollback 331
Handler_savepoint 6
Handler_savepoint_rollback 432
Handler_tmp_update 52
Handler_tmp_write 794786
Handler_update 187721
Handler_write 45178
Innodb_available_undo_logs 128
Innodb_background_log_sync 174887
Innodb_buffer_pool_bytes_data 497696768
Innodb_buffer_pool_bytes_dirty 966656
Innodb_buffer_pool_dump_status not started
Innodb_buffer_pool_load_status not started
Innodb_buffer_pool_pages_data 30377
Innodb_buffer_pool_pages_dirty 59
Innodb_buffer_pool_pages_flushed 219751
Innodb_buffer_pool_pages_free 1024
Innodb_buffer_pool_pages_lru_flushed 0
Innodb_buffer_pool_pages_made_not_young 7802825
Innodb_buffer_pool_pages_made_young 111036
Innodb_buffer_pool_pages_misc 1366
Innodb_buffer_pool_pages_old 11193
Innodb_buffer_pool_pages_total 32767
Innodb_buffer_pool_read_ahead 46582
Innodb_buffer_pool_read_ahead_evicted 0
Innodb_buffer_pool_read_ahead_rnd 0
Innodb_buffer_pool_read_requests 108881491
Innodb_buffer_pool_reads 102472
Innodb_buffer_pool_wait_free 0
Innodb_buffer_pool_write_requests 1815500
Innodb_checkpoint_age 14294
Innodb_checkpoint_max_age 108005254
Innodb_data_fsyncs 331128
Innodb_data_pending_fsyncs 1
Innodb_data_pending_reads 0
Innodb_data_pending_writes 0
Innodb_data_read 2470580224
Innodb_data_reads 150873
Innodb_data_writes 503833
Innodb_data_written 7447897088
Innodb_dblwr_pages_written 219751
Innodb_dblwr_writes 25874
Innodb_deadlocks 9
Innodb_have_atomic_builtins ON
Innodb_history_list_length 3284
Innodb_ibuf_discarded_delete_marks 0
Innodb_ibuf_discarded_deletes 0
Innodb_ibuf_discarded_inserts 0
Innodb_ibuf_free_list 143
Innodb_ibuf_merged_delete_marks 3383
Innodb_ibuf_merged_deletes 1866
Innodb_ibuf_merged_inserts 2124
Innodb_ibuf_merges 2091
Innodb_ibuf_segment_size 145
Innodb_ibuf_size 1
Innodb_log_waits 0
Innodb_log_write_requests 232924
Innodb_log_writes 236506
Innodb_lsn_current 60890507015
Innodb_lsn_flushed 60890506525
Innodb_lsn_last_checkpoint 60890492721
Innodb_master_thread_active_loops 80742
Innodb_master_thread_idle_loops 94160
Innodb_max_trx_id 181302712
Innodb_mem_adaptive_hash 31235792
Innodb_mem_dictionary 2745710
Innodb_mem_total 549453824
Innodb_mutex_os_waits 45236
Innodb_mutex_spin_rounds 7714968
Innodb_mutex_spin_waits 340407
Innodb_oldest_view_low_limit_trx_id 0
Innodb_os_log_fsyncs 249496
Innodb_os_log_pending_fsyncs 1
Innodb_os_log_pending_writes 0
Innodb_os_log_written 236351488
Innodb_page_size 16384
Innodb_pages_created 618
Innodb_pages_read 150787
Innodb_pages_written 219751
Innodb_purge_trx_id 181302710
Innodb_purge_undo_no 0
Innodb_read_views_memory 552
Innodb_row_lock_current_waits 0
Innodb_row_lock_time 42761
Innodb_row_lock_time_avg 90
Innodb_row_lock_time_max 1150
Innodb_row_lock_waits 474
Innodb_rows_deleted 12085
Innodb_rows_inserted 44260
Innodb_rows_read 93001360
Innodb_rows_updated 187721
Innodb_s_lock_os_waits 23138
Innodb_s_lock_spin_rounds 699885
Innodb_s_lock_spin_waits 23671
Innodb_truncated_status_writes 0
Innodb_x_lock_os_waits 2877
Innodb_x_lock_spin_rounds 88806
Innodb_x_lock_spin_waits 169
Key_blocks_not_flushed 0
Key_blocks_unused 53583
Key_blocks_used 2
Key_blocks_warm 0
Key_read_requests 1560
Key_reads 8
Key_write_requests 0
Key_writes 0
Last_query_cost 0.000000
Max_used_connections 18
Memory_used 242496560
Not_flushed_delayed_rows 0
Open_files 17
Open_streams 0
Open_table_definitions 74
Open_tables 124
Opened_files 40476
Opened_plugin_libraries 0
Opened_table_definitions 240
Opened_tables 609
Opened_views 0
Performance_schema_accounts_lost 0
Performance_schema_cond_classes_lost 0
Performance_schema_cond_instances_lost 0
Performance_schema_digest_lost 0
Performance_schema_file_classes_lost 1
Performance_schema_file_handles_lost 0
Performance_schema_file_instances_lost 0
Performance_schema_hosts_lost 0
Performance_schema_locker_lost 0
Performance_schema_mutex_classes_lost 0
Performance_schema_mutex_instances_lost 0
Performance_schema_rwlock_classes_lost 0
Performance_schema_rwlock_instances_lost 0
Performance_schema_session_connect_attrs_lost 0
Performance_schema_socket_classes_lost 0
Performance_schema_socket_instances_lost 0
Performance_schema_stage_classes_lost 0
Performance_schema_statement_classes_lost 0
Performance_schema_table_handles_lost 0
Performance_schema_table_instances_lost 0
Performance_schema_thread_classes_lost 0
Performance_schema_thread_instances_lost 0
Performance_schema_users_lost 1
Prepared_stmt_count 0
Qcache_free_blocks 5234
Qcache_free_memory 18581136
Qcache_hits 967185
Qcache_inserts 283158
Qcache_lowmem_prunes 38515
Qcache_not_cached 77005
Qcache_queries_in_cache 13744
Qcache_total_blocks 32764
Queries 6092219
Questions 2954038
Rows_read 92962071
Rows_sent 15134564
Rows_tmp_read 815425
Rpl_status AUTH_MASTER
Select_full_join 3
Select_full_range_join 2
Select_range 73422
Select_range_check 60
Select_scan 11567
Slave_heartbeat_period 1800.000
Slave_open_temp_tables 0
Slave_received_heartbeats 0
Slave_retried_transactions 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 42
Sort_merge_passes 3
Sort_range 185365
Sort_rows 1010314
Sort_scan 19624
Ssl_accept_renegotiates 0
Ssl_accepts 0
Ssl_callback_cache_hits 0
Ssl_cipher
Ssl_cipher_list
Ssl_client_connects 0
Ssl_connect_renegotiates 0
Ssl_ctx_verify_depth 0
Ssl_ctx_verify_mode 0
Ssl_default_timeout 0
Ssl_finished_accepts 0
Ssl_finished_connects 0
Ssl_server_not_after
Rpl_status AUTH_MASTER
Select_full_join 3
Select_full_range_join 2
Select_range 73422
Select_range_check 60
Select_scan 11567
Slave_heartbeat_period 1800.000
Slave_open_temp_tables 0
Slave_received_heartbeats 0
Slave_retried_transactions 0
Slave_running OFF
Slow_launch_threads 0
Slow_queries 42
Sort_merge_passes 3
Sort_range 185365
Sort_rows 1010314
Sort_scan 19624
Ssl_accept_renegotiates 0
Ssl_accepts 0
Ssl_callback_cache_hits 0
Ssl_cipher
Ssl_cipher_list
Ssl_client_connects 0
Ssl_connect_renegotiates 0
Ssl_ctx_verify_depth 0
Ssl_ctx_verify_mode 0
Ssl_default_timeout 0
Ssl_finished_accepts 0
Ssl_finished_connects 0
Ssl_server_not_after
Ssl_server_not_before
Ssl_session_cache_hits 0
Ssl_session_cache_misses 0
Ssl_session_cache_mode NONE
Ssl_session_cache_overflows 0
Ssl_session_cache_size 0
Ssl_session_cache_timeouts 0
Ssl_sessions_reused 0
Ssl_used_session_cache_entries 0
Ssl_verify_depth 0
Ssl_verify_mode 0
Ssl_version
Subquery_cache_hit 172108
Subquery_cache_miss 16734
Syncs 177196
Table_locks_immediate 926927
Table_locks_waited 0
Tc_log_max_pages_used 0
Tc_log_page_size 0
Tc_log_page_waits 0
Threadpool_idle_threads 0
Threadpool_threads 0
Threads_cached 14
Threads_connected 4
Threads_created 18
Threads_running 3
Uptime 178882
Uptime_since_flush_status 178882
Subject
Views
Written By
Posted
sync_binlog=1 and innodb_flush_log_at_trx_commit = 1 killing write performance
6326
June 23, 2014 04:52PM
1623
June 26, 2014 06:19PM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.