Re: missed heartbeat Error.....

[Alex Davies]

Please email me or post here the output of a SHOW in the managment client, as well as the .err and log files on each storage node.

It looks like storage node # 24 has problems but unless I can see its error log I cant be very helpful!

Alex
[e-mail]

Tony JARRIAULT wrote:
> Hi,
>
> I've 4 node on my mysql cluster. When i trie to
> start the second node, i'll kill the thirst and
> second node.
> The error message on the manager is :
> 2005-09-01 15:00:27 INFO -- Node 23: Node 22
> Connected
> 2005-09-01 15:00:27 INFO -- Node 22: Node 23
> Connected
> 2005-09-01 15:00:27 INFO -- Node 22:
> CM_REGCONF president = 23, own Node = 22, our
> dynamic id = 2
> 2005-09-01 15:00:27 INFO -- Node 23: Node 22:
> API version 4.1.8
> 2005-09-01 15:00:27 INFO -- Node 22: Node 23:
> API version 4.1.8
> 2005-09-01 15:00:27 INFO -- Node 22: Start
> phase 1 completed
> 2005-09-01 15:00:27 WARNING -- Node 22: Node 23
> missed heartbeat 2
> 2005-09-01 15:00:28 WARNING -- Node 22: Node 23
> missed heartbeat 3
> 2005-09-01 15:00:28 WARNING -- Node 22: Node 23
> missed heartbeat 2
> 2005-09-01 15:00:29 WARNING -- Node 22: Node 23
> missed heartbeat 3
> 2005-09-01 15:00:29 ALERT -- Node 11: Node 22
> Disconnected
> 2005-09-01 15:00:29 ALERT -- Node 11: Node 23
> Disconnected
> 2005-09-01 15:00:29 INFO -- Mgmt server
> state: nodeid 22 freed, m_reserved_nodes
> 0000000100800800.
> 2005-09-01 15:00:29 INFO -- Mgmt server
> state: nodeid 23 freed, m_reserved_nodes
> 0000000100000800.
> 2005-09-01 15:00:35 INFO -- Mgmt server
> state: nodeid 25 reserved for ip 10.198.163.203,
> m_reserved_nodes 0000000102000800.
> 2005-09-01 15:00:36 INFO -- Mgmt server
> state: nodeid 35 reserved for ip 10.198.163.203,
> m_reserved_nodes 0000000902000800.
> 2005-09-01 15:00:36 INFO -- Node 11: Node 25
> Connected
> 2005-09-01 15:00:40 INFO -- Mgmt server
> state: nodeid 24 reserved for ip 10.198.163.202,
> m_reserved_nodes 0000000903000800.
> 2005-09-01 15:00:40 INFO -- Node 11: Node 24
> Connected
> 2005-09-01 15:00:40 INFO -- Node 24: Node 25
> Connected
> 2005-09-01 15:00:41 INFO -- Node 25: Node 24
> Connected
> 2005-09-01 15:01:11 INFO -- Node 24: Start
> phase 1 completed
> 2005-09-01 15:01:13 INFO -- Node 25:
> CM_REGCONF president = 24, own Node = 25, our
> dynamic id = 2
> 2005-09-01 15:01:13 INFO -- Node 24: Node 25:
> API version 4.1.8
> 2005-09-01 15:01:13 INFO -- Node 25: Node 24:
> API version 4.1.8
> 2005-09-01 15:01:13 INFO -- Node 25: Start
> phase 1 completed
> 2005-09-01 15:01:15 WARNING -- Node 25: Node 24
> missed heartbeat 2
> 2005-09-01 15:01:16 WARNING -- Node 24: Node 25
> missed heartbeat 2
> 2005-09-01 15:01:17 WARNING -- Node 25: Node 24
> missed heartbeat 3
> 2005-09-01 15:01:18 WARNING -- Node 25: Node 24
> missed heartbeat 2
> 2005-09-01 15:01:18 WARNING -- Node 25: Node 24
> missed heartbeat 3
> 2005-09-01 15:01:18 WARNING -- Node 24: Node 25
> missed heartbeat 3
> 2005-09-01 15:01:19 WARNING -- Node 24: Node 25
> missed heartbeat 2
> 2005-09-01 15:01:20 WARNING -- Node 24: Node 25
> missed heartbeat 3
> 2005-09-01 15:01:20 WARNING -- Node 25: Node 24
> missed heartbeat 2
> 2005-09-01 15:01:22 WARNING -- Node 25: Node 24
> missed heartbeat 2
> 2005-09-01 15:01:24 WARNING -- Node 25: Node 24
> missed heartbeat 3
> 2005-09-01 15:01:26 WARNING -- Node 24: Node 25
> missed heartbeat 2
> 2005-09-01 15:01:27 WARNING -- Node 24: Node 25
> missed heartbeat 3
> 2005-09-01 15:01:29 WARNING -- Node 25: Node 24
> missed heartbeat 2
> 2005-09-01 15:01:29 WARNING -- Node 25: Node 24
> missed heartbeat 3
> 2005-09-01 15:01:29 ALERT -- Node 11: Node 25
> Disconnected
> 2005-09-01 15:01:30 ALERT -- Node 11: Node 24
> Disconnected
> 2005-09-01 15:01:30 INFO -- Mgmt server
> state: nodeid 24 freed, m_reserved_nodes
> 0000000902000800.
> 2005-09-01 15:01:30 INFO -- Mgmt server
> state: nodeid 25 freed, m_reserved_nodes
> 0000000900000800.
>
>
> Could 'you help me please ?
>
>
>
> Thanks,
>
> Tony

Alex Davies
http://www.davz.net | [e-mail]