The slave I/O thread stops
Posted by:
Flavian C
Date: April 27, 2012 09:58PM
Hi,
Im using SLES SP1 and MySQL 5.5.19 x64 communication edition.
I have around 50 Masters spreaded all over the country and 1 system with mysqld_multi installed running 50 slave instance of mysql running all on diff ports, datadir, tmpdir to its respective masters.
The problem here is today i was monitoring my slaves status and in one of them it gave an ERROR: The slave I/O thread stops because SET @master_heartbeat_period on master failed. Error:
i couldnt figure what was the exact problem.
here is the whole day slave error log
120427 8:39:26 [Note] Slave: connected to master 'test_slave@123.238.1.10:3306',replication resumed in log 'mysql-bin.000072' at position 1237539
120427 16:36:05 [ERROR] Slave I/O: error reconnecting to master 'test_slave@123.238.1.10:3306' - retry-time: 20 retries: 0, Error_code: 2003
120427 16:37:51 [Note] Slave: connected to master 'test_slave@123.238.1.10:3306',replication resumed in log 'mysql-bin.000073' at position 510026
120427 16:38:11 [ERROR] Slave I/O: The slave I/O thread stops because SET @master_heartbeat_period on master failed. Error: , Error_code: 1593
120427 16:38:11 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000073', position 510026
here is the whole day master error log
Version: '5.5.19-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)
120427 8:39:26 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000072, 1237539)
120427 16:19:24 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:22:24 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:26:14 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:28:00 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:29:35 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:30:35 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
120427 16:34:25 [Note] Start binlog_dump to slave_server(27), pos(mysql-bin.000073, 510026)
Here is the status on slave:
mysql> SHOW STATUS LIKE '%heartbeat%';
+---------------------------+--------+
| Variable_name | Value |
+---------------------------+--------+
| Slave_heartbeat_period | 10.000 |
| Slave_received_heartbeats | 7171 |
+---------------------------+--------+
Kindly suggest,
Regards.