Re: Failed to allocate nodeid, error: 'Error: Could not alloc node id at .. : Connection done from wrong host
Posted by: Lars Holmström
Date: July 12, 2017 08:56AM
Date: July 12, 2017 08:56AM
The log files contain a lot of information even before I started to work on this,so I have limited the output foryesterday and also removed alarge number of duplicates,which is represented as holes in the log.
First Mysql errorlog
====================
2017-05-18T08:13:49.565035Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2017-05-18T08:13:49.565038Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2017-05-18T08:13:49.565041Z 0 [Note] InnoDB: Using Linux native AIO
2017-05-18T08:13:49.565274Z 0 [Note] InnoDB: Number of pools: 1
2017-05-18T08:13:49.565367Z 0 [Note] InnoDB: Using CPU crc32 instructions
2017-05-18T08:13:49.566717Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2017-05-18T08:13:49.573959Z 0 [Note] InnoDB: Completed initialization of buffer pool
2017-05-18T08:13:49.576387Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be change
d. See the man page of setpriority().
2017-05-18T08:13:49.587949Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2017-05-18T08:13:49.654504Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2017-05-18T08:13:49.654562Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait .
..
2017-05-18T08:13:49.784475Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2017-05-18T08:13:49.785215Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2017-05-18T08:13:49.785223Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2017-05-18T08:13:49.785903Z 0 [Note] InnoDB: Waiting for purge to start
2017-05-18T08:13:49.836019Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 2541190
2017-05-18T08:13:49.836480Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2017-05-18T08:13:49.836686Z 0 [Note] Plugin 'FEDERATED' is disabled.
2017-05-18T08:13:49.836768Z 0 [Note] Plugin 'ndbcluster' is disabled.
2017-05-18T08:13:49.837859Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170518 8:13:49
2017-05-18T08:13:49.840257Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL suppo
rt using them.
2017-05-18T08:13:49.840466Z 0 [Warning] CA certificate ca.pem is self signed.
2017-05-18T08:13:49.842254Z 0 [Note] Server hostname (bind-address): '127.0.0.1'; port: 3306
2017-05-18T08:13:49.842278Z 0 [Note] - '127.0.0.1' resolves to '127.0.0.1';
2017-05-18T08:13:49.842299Z 0 [Note] Server socket created on IP: '127.0.0.1'.
2017-05-18T08:13:49.848301Z 0 [Note] Event Scheduler: Loaded 0 events
2017-05-18T08:13:49.848458Z 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.7.18-ndb-7.5.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 MySQL Cluster Community Server (GPL)
2017-05-18T08:13:49.848479Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the depreca
ted partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check.
2017-05-18T08:13:49.848482Z 0 [Note] Beginning of list of non-natively partitioned tables
2017-05-18T08:13:49.855740Z 0 [Note] End of list of non-natively partitioned tables
2017-05-23T07:45:09.957535Z 4 [Note] Access denied for user 'slmv10'@'localhost' (using password: NO)
2017-07-12T08:44:20.243671Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_tim
estamp server option (see documentation for more details).
2017-07-12T08:44:20.244996Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.18-ndb-7.5.6) starting as process 19014 ...
2017-07-12T08:44:20.249297Z 0 [Note] InnoDB: PUNCH HOLE support available
2017-07-12T08:44:20.249314Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2017-07-12T08:44:20.249318Z 0 [Note] InnoDB: Uses event mutexes
2017-07-12T08:44:20.249322Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2017-07-12T08:44:20.249325Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2017-07-12T08:44:20.249328Z 0 [Note] InnoDB: Using Linux native AIO
2017-07-12T08:44:20.249572Z 0 [Note] InnoDB: Number of pools: 1
2017-07-12T08:44:20.249659Z 0 [Note] InnoDB: Using CPU crc32 instructions
2017-07-12T08:44:20.250980Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2017-07-12T08:44:20.257765Z 0 [Note] InnoDB: Completed initialization of buffer pool
2017-07-12T08:44:20.259274Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be change
d. See the man page of setpriority().
2017-07-12T08:44:20.270673Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2017-07-12T08:44:20.271579Z 0 [Note] InnoDB: Log scan progressed past the checkpoint lsn 2541209
2017-07-12T08:44:20.271587Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 2541218
2017-07-12T08:44:20.271712Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 2541218
2017-07-12T08:44:20.271716Z 0 [Note] InnoDB: Database was not shutdown normally!
2017-07-12T08:44:20.271720Z 0 [Note] InnoDB: Starting crash recovery.
2017-07-12T08:44:20.420074Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2017-07-12T08:44:20.420095Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2017-07-12T08:44:20.420127Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait .
..
2017-07-12T08:44:20.525941Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2017-07-12T08:44:20.526756Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2017-07-12T08:44:20.526765Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2017-07-12T08:44:20.527369Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 2541218
2017-07-12T08:44:20.527639Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2017-07-12T08:44:20.527751Z 0 [Note] Plugin 'FEDERATED' is disabled.
2017-07-12T08:44:20.528974Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170712 8:44:20
2017-07-12T08:44:51.538620Z 0 [Warning] NDB: server id set to zero - changes logged to bin log with server id zero will be logged w
ith another server id by slave mysqlds
2017-07-12T08:44:51.538723Z 0 [Note] NDB Util: Starting...
2017-07-12T08:44:51.538737Z 0 [Note] NDB Binlog: Starting...
2017-07-12T08:44:51.541127Z 2 [Note] NDB Binlog: Started
2017-07-12T08:44:51.541132Z 2 [Note] NDB Binlog: Setting up
2017-07-12T08:44:51.541187Z 2 [Note] NDB Binlog: Created schema Ndb object, reference: 0x0, name: 'Ndb Binlog schema change monitor
ing'
2017-07-12T08:44:51.541213Z 2 [Note] NDB Binlog: Created injector Ndb object, reference: 0x0, name: 'Ndb Binlog data change monitor
ing'
2017-07-12T08:44:51.541222Z 2 [Note] NDB Binlog: Setup completed
2017-07-12T08:44:51.541225Z 2 [Note] NDB Binlog: Wait for server start completed
2017-07-12T08:44:51.538791Z 1 [Note] NDB Util: Wait for server start completed
2017-07-12T08:44:51.541239Z 0 [Note] NDB Index Stat: Starting...
2017-07-12T08:44:51.541245Z 0 [Note] NDB Index Stat: Wait for server start completed
2017-07-12T08:44:51.597473Z 0 [ERROR] Too many arguments (first extra is 'ndb-connectstring=10.215.2.74').
2017-07-12T08:44:51.597494Z 0 [Note] Use --verbose --help to get a list of available options!
2017-07-12T08:44:51.597497Z 0 [ERROR] Aborting
2017-07-12T08:44:51.597505Z 0 [Note] Binlog end
2017-07-12T08:44:51.597509Z 0 [Note] NDB Binlog: Stop
2017-07-12T08:44:51.597512Z 0 [Note] NDB Binlog: Wakeup
2017-07-12T08:44:52.541314Z 2 [Note] NDB Binlog: Shutting down
2017-07-12T08:44:52.541357Z 2 [Note] NDB Binlog: Stopping...
2017-07-12T08:44:52.541387Z 0 [Note] NDB Binlog: Stopped
2017-07-12T08:44:52.541428Z 0 [Note] NDB Binlog: Stop completed
2017-07-12T08:44:52.541493Z 0 [Note] Shutting down plugin 'ngram'
2017-07-12T08:44:52.541498Z 0 [Note] Shutting down plugin 'partition'
2017-07-12T08:44:52.541501Z 0 [Note] Shutting down plugin 'ndb_transid_mysql_connection_map'
2017-07-12T08:44:52.541504Z 0 [Note] Shutting down plugin 'ndbinfo'
2017-07-12T08:44:52.541861Z 0 [Note] Shutting down plugin 'ndbcluster'
2017-07-12T08:44:52.541871Z 0 [Note] NDB Index Stat: Stop
2017-07-12T08:44:52.541874Z 0 [Note] NDB Index Stat: Wakeup
2017-07-12T08:44:53.541406Z 0 [Note] NDB Index Stat: Stopping...
2017-07-12T08:44:53.541428Z 0 [Note] NDB Index Stat: Stopped
2017-07-12T08:44:53.541473Z 0 [Note] NDB Index Stat: Stop completed
2017-07-12T08:44:53.541479Z 0 [Note] NDB Util: Stop
2017-07-12T08:44:53.541482Z 0 [Note] NDB Util: Wakeup
2017-07-12T08:44:54.541541Z 0 [Note] NDB Util: Stopped
2017-07-12T08:44:54.541600Z 0 [Note] NDB Util: Stop completed
2017-07-12T08:44:55.541945Z 0 [Note] Shutting down plugin 'BLACKHOLE'
2017-07-12T08:44:55.541973Z 0 [Note] Shutting down plugin 'ARCHIVE'
2017-07-12T08:44:55.541976Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
2017-07-12T08:44:55.542017Z 0 [Note] Shutting down plugin 'CSV'
2017-07-12T08:44:55.542021Z 0 [Note] Shutting down plugin 'MEMORY'
2017-07-12T08:44:55.542025Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
2017-07-12T08:44:55.542028Z 0 [Note] Shutting down plugin 'MyISAM'
2017-07-12T08:44:55.542044Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
2017-07-12T08:44:55.542047Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
2017-07-12T08:44:55.542049Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
2017-07-12T08:44:55.542052Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
2017-07-12T08:44:55.542055Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
2017-07-12T08:44:55.542057Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
2017-07-12T08:44:55.542060Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
2017-07-12T08:44:55.542062Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
2017-07-12T08:44:55.542065Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
2017-07-12T08:44:55.542067Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
2017-07-12T08:44:55.542070Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
2017-07-12T08:44:55.542072Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
2017-07-12T08:44:55.542075Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
2017-07-12T08:44:55.542077Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
2017-07-12T08:44:55.542080Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
2017-07-12T08:44:55.542082Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
2017-07-12T08:44:55.542085Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
2017-07-12T08:44:55.542087Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
2017-07-12T08:44:55.542090Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
2017-07-12T08:44:55.542092Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
2017-07-12T08:44:55.542103Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
2017-07-12T08:44:55.542105Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
2017-07-12T08:44:55.542107Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
2017-07-12T08:44:55.542110Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
2017-07-12T08:44:55.542112Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
2017-07-12T08:44:55.542114Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
2017-07-12T08:44:55.542116Z 0 [Note] Shutting down plugin 'INNODB_CMP'
2017-07-12T08:44:55.542119Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
2017-07-12T08:44:55.542121Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
2017-07-12T08:44:55.542123Z 0 [Note] Shutting down plugin 'INNODB_TRX'
2017-07-12T08:44:55.542126Z 0 [Note] Shutting down plugin 'InnoDB'
2017-07-12T08:44:55.542172Z 0 [Note] InnoDB: FTS optimize thread exiting.
2017-07-12T08:44:55.542268Z 0 [Note] InnoDB: Starting shutdown...
2017-07-12T08:44:55.642455Z 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2017-07-12T08:44:55.642638Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 170712 8:44:55
2017-07-12T08:44:57.142003Z 0 [Note] InnoDB: Shutdown completed; log sequence number 2541246
2017-07-12T08:44:57.143785Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2017-07-12T08:44:57.143802Z 0 [Note] Shutting down plugin 'sha256_password'
2017-07-12T08:44:57.143806Z 0 [Note] Shutting down plugin 'mysql_native_password'
2017-07-12T08:44:57.143975Z 0 [Note] Shutting down plugin 'binlog'
2017-07-12T08:44:57.144096Z 0 [Note] /usr/sbin/mysqld: Shutdown complete
Second the cluster log
======================
2017-07-11 09:30:38 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:51:04 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:59410' to transporter: line: 554 : Incorr
ect state for node 3 state: does nothing (2)
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5: Node 3 Connected
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:51:06 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:09 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:12 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:14 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:51:15 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:18 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:20 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34054' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34056' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31
gmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34058' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34060' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34062' to transporter: line: 545 : Incorr
ect reply from client: >3 1
:
:
:
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34338' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34340' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Nodeid 1 allocated for NDB at 10.215.2.70
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34342' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34344' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34346' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34348' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Start phase 0 completed
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 opened
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Waiting 30 sec for nodes 2 to connect, nodes [ all: 1 and 2 connected: 1 no-wait
: ]
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34350' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:15 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35006' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:15 [MgmtSrvr] INFO -- Alloc node id 2 failed, no new president yet
2017-07-11 09:54:15 [MgmtSrvr] INFO -- Nodeid 2 allocated for NDB at 10.215.2.71
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35008' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35010' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35012' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Buffering maximum epochs 100
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Start phase 0 completed
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35014' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Communication to Node 1 opened
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Waiting 30 sec for nodes 1 to connect, nodes [ all: 1 and 2 connected: 2 no-wait
: ]
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35016' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Node 1 Connected
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: Node 2 Connected
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: Start with all nodes 1 and 2
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: CM_REGCONF president = 1, own Node = 1, our dynamic id = 0/1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35018' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35020' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35022' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35024' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:17 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35026' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35074' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35076' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: CM_REGCONF president = 1, own Node = 2, our dynamic id = 0/2
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Node 2: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Node 1: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 1 completed
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 1 completed
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: System Restart: master node: 2, num starting: 1, gci: 1695282
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: CNTR_START_CONF: started: 0000000000000000
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: CNTR_START_CONF: starting: 0000000000000006
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35078' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 2 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 2 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 3 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 3 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Restarting cluster to GCI: 1695282
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35080' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Restore dictionary information from disk Starting
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Starting to restore schema
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35082' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35084' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35086' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35088' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35090' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore of schema complete
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Starting to restore schema
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35092' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35094' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Restore of schema complete
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore dictionary information from disk Completed
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore Database from disk Starting
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node: 1 StartLog: [GCI Keep: 1689184 LastCompleted: 1695282 NewestRestorable: 16
95282]
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node: 2 StartLog: [GCI Keep: 1689184 LastCompleted: 1695004 NewestRestorable: 16
95282]
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: LDM instance 0: Restored LCP : 4 fragments, 2050 rows, 5 millis, 410000 rows/s
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node 5: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Node 5: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 4 opened
2017-07-11 09:54:21 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35108' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Node 3 Connected
2017-07-11 09:54:21 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35118' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 4 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0001f6c2a6e8]
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown completed. Occured during startphase 1. Caused by error 230
2: 'node id in the configuration has the wrong type, (i.e. not an NDB node)(Configuration error). Permanent error, external action
needed'.
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 closed
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 closed
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0001f6c2a6e8]
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 2: Node 3 Disconnected
2017-07-11 09:54:25 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 opened
2017-07-11 09:54:25 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 opened
2017-07-11 09:55:01 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:55:17 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:57:36 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.71:42246' to transporter: line: 554 : Incorr
ect state for node 2 state: does nothing (2)
2017-07-11 09:57:36 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.70:51914' to transporter: line: 554 : Incorr
ect state for node 1 state: does nothing (2)
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:58:32 [MgmtSrvr] WARNING -- Failed to allocate nodeid for NDB at 10.215.2.71. Returned error: 'No free node id found
for ndbd(NDB).'
2017-07-11 09:59:18 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:59:23 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Loaded config from '/usr/mysql-cluster/ndb_5_config.bin.1'
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:59:37 [MgmtSrvr] INFO -- MySQL Cluster Management Server mysql-5.7.18 ndb-7.5.6 started
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:59:38 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.70:52484' to transporter: line: 554 : Incorr
ect state for node 1 state: does nothing (2)
2017-07-11 09:59:38 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.71:42832' to transporter: line: 554 : Incorr
ect state for node 2 state: does nothing (2)
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0003f6c74334]
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0003f6c74334]
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Local checkpoint 112 started. Keep GCI = 1695004 oldest restorable GCI = 1695282
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 5: Node 2 Disconnected
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: LDM(0): Completed LCP, #frags = 4 #records = 2050, #bytes = 65680
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Node 2 Disconnected
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 closed
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Network partitioning - arbitration required
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: President restarts arbitration thread [state=7]
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 2: Forced node shutdown completed. Caused by error 2341: 'Internal program error (f
ailed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Arbitration won - positive reply from node 5
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: NR Status: node=2,OLD=Initial state,NEW=Node failed, fail handling ongoing
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Local checkpoint 112 completed
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: NR Status: node=2,OLD=Node failed, fail handling ongoing,NEW=Node failure handli
ng complete
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0004f8ba4fbd]
2017-07-11 19:04:47 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 opened
First Mysql errorlog
====================
2017-05-18T08:13:49.565035Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2017-05-18T08:13:49.565038Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2017-05-18T08:13:49.565041Z 0 [Note] InnoDB: Using Linux native AIO
2017-05-18T08:13:49.565274Z 0 [Note] InnoDB: Number of pools: 1
2017-05-18T08:13:49.565367Z 0 [Note] InnoDB: Using CPU crc32 instructions
2017-05-18T08:13:49.566717Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2017-05-18T08:13:49.573959Z 0 [Note] InnoDB: Completed initialization of buffer pool
2017-05-18T08:13:49.576387Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be change
d. See the man page of setpriority().
2017-05-18T08:13:49.587949Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2017-05-18T08:13:49.654504Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2017-05-18T08:13:49.654562Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait .
..
2017-05-18T08:13:49.784475Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2017-05-18T08:13:49.785215Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2017-05-18T08:13:49.785223Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2017-05-18T08:13:49.785903Z 0 [Note] InnoDB: Waiting for purge to start
2017-05-18T08:13:49.836019Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 2541190
2017-05-18T08:13:49.836480Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2017-05-18T08:13:49.836686Z 0 [Note] Plugin 'FEDERATED' is disabled.
2017-05-18T08:13:49.836768Z 0 [Note] Plugin 'ndbcluster' is disabled.
2017-05-18T08:13:49.837859Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170518 8:13:49
2017-05-18T08:13:49.840257Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL suppo
rt using them.
2017-05-18T08:13:49.840466Z 0 [Warning] CA certificate ca.pem is self signed.
2017-05-18T08:13:49.842254Z 0 [Note] Server hostname (bind-address): '127.0.0.1'; port: 3306
2017-05-18T08:13:49.842278Z 0 [Note] - '127.0.0.1' resolves to '127.0.0.1';
2017-05-18T08:13:49.842299Z 0 [Note] Server socket created on IP: '127.0.0.1'.
2017-05-18T08:13:49.848301Z 0 [Note] Event Scheduler: Loaded 0 events
2017-05-18T08:13:49.848458Z 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.7.18-ndb-7.5.6' socket: '/var/run/mysqld/mysqld.sock' port: 3306 MySQL Cluster Community Server (GPL)
2017-05-18T08:13:49.848479Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the depreca
ted partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check.
2017-05-18T08:13:49.848482Z 0 [Note] Beginning of list of non-natively partitioned tables
2017-05-18T08:13:49.855740Z 0 [Note] End of list of non-natively partitioned tables
2017-05-23T07:45:09.957535Z 4 [Note] Access denied for user 'slmv10'@'localhost' (using password: NO)
2017-07-12T08:44:20.243671Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_tim
estamp server option (see documentation for more details).
2017-07-12T08:44:20.244996Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.18-ndb-7.5.6) starting as process 19014 ...
2017-07-12T08:44:20.249297Z 0 [Note] InnoDB: PUNCH HOLE support available
2017-07-12T08:44:20.249314Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2017-07-12T08:44:20.249318Z 0 [Note] InnoDB: Uses event mutexes
2017-07-12T08:44:20.249322Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2017-07-12T08:44:20.249325Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.3
2017-07-12T08:44:20.249328Z 0 [Note] InnoDB: Using Linux native AIO
2017-07-12T08:44:20.249572Z 0 [Note] InnoDB: Number of pools: 1
2017-07-12T08:44:20.249659Z 0 [Note] InnoDB: Using CPU crc32 instructions
2017-07-12T08:44:20.250980Z 0 [Note] InnoDB: Initializing buffer pool, total size = 128M, instances = 1, chunk size = 128M
2017-07-12T08:44:20.257765Z 0 [Note] InnoDB: Completed initialization of buffer pool
2017-07-12T08:44:20.259274Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be change
d. See the man page of setpriority().
2017-07-12T08:44:20.270673Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2017-07-12T08:44:20.271579Z 0 [Note] InnoDB: Log scan progressed past the checkpoint lsn 2541209
2017-07-12T08:44:20.271587Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 2541218
2017-07-12T08:44:20.271712Z 0 [Note] InnoDB: Doing recovery: scanned up to log sequence number 2541218
2017-07-12T08:44:20.271716Z 0 [Note] InnoDB: Database was not shutdown normally!
2017-07-12T08:44:20.271720Z 0 [Note] InnoDB: Starting crash recovery.
2017-07-12T08:44:20.420074Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2017-07-12T08:44:20.420095Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2017-07-12T08:44:20.420127Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait .
..
2017-07-12T08:44:20.525941Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2017-07-12T08:44:20.526756Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2017-07-12T08:44:20.526765Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2017-07-12T08:44:20.527369Z 0 [Note] InnoDB: 5.7.18 started; log sequence number 2541218
2017-07-12T08:44:20.527639Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2017-07-12T08:44:20.527751Z 0 [Note] Plugin 'FEDERATED' is disabled.
2017-07-12T08:44:20.528974Z 0 [Note] InnoDB: Buffer pool(s) load completed at 170712 8:44:20
2017-07-12T08:44:51.538620Z 0 [Warning] NDB: server id set to zero - changes logged to bin log with server id zero will be logged w
ith another server id by slave mysqlds
2017-07-12T08:44:51.538723Z 0 [Note] NDB Util: Starting...
2017-07-12T08:44:51.538737Z 0 [Note] NDB Binlog: Starting...
2017-07-12T08:44:51.541127Z 2 [Note] NDB Binlog: Started
2017-07-12T08:44:51.541132Z 2 [Note] NDB Binlog: Setting up
2017-07-12T08:44:51.541187Z 2 [Note] NDB Binlog: Created schema Ndb object, reference: 0x0, name: 'Ndb Binlog schema change monitor
ing'
2017-07-12T08:44:51.541213Z 2 [Note] NDB Binlog: Created injector Ndb object, reference: 0x0, name: 'Ndb Binlog data change monitor
ing'
2017-07-12T08:44:51.541222Z 2 [Note] NDB Binlog: Setup completed
2017-07-12T08:44:51.541225Z 2 [Note] NDB Binlog: Wait for server start completed
2017-07-12T08:44:51.538791Z 1 [Note] NDB Util: Wait for server start completed
2017-07-12T08:44:51.541239Z 0 [Note] NDB Index Stat: Starting...
2017-07-12T08:44:51.541245Z 0 [Note] NDB Index Stat: Wait for server start completed
2017-07-12T08:44:51.597473Z 0 [ERROR] Too many arguments (first extra is 'ndb-connectstring=10.215.2.74').
2017-07-12T08:44:51.597494Z 0 [Note] Use --verbose --help to get a list of available options!
2017-07-12T08:44:51.597497Z 0 [ERROR] Aborting
2017-07-12T08:44:51.597505Z 0 [Note] Binlog end
2017-07-12T08:44:51.597509Z 0 [Note] NDB Binlog: Stop
2017-07-12T08:44:51.597512Z 0 [Note] NDB Binlog: Wakeup
2017-07-12T08:44:52.541314Z 2 [Note] NDB Binlog: Shutting down
2017-07-12T08:44:52.541357Z 2 [Note] NDB Binlog: Stopping...
2017-07-12T08:44:52.541387Z 0 [Note] NDB Binlog: Stopped
2017-07-12T08:44:52.541428Z 0 [Note] NDB Binlog: Stop completed
2017-07-12T08:44:52.541493Z 0 [Note] Shutting down plugin 'ngram'
2017-07-12T08:44:52.541498Z 0 [Note] Shutting down plugin 'partition'
2017-07-12T08:44:52.541501Z 0 [Note] Shutting down plugin 'ndb_transid_mysql_connection_map'
2017-07-12T08:44:52.541504Z 0 [Note] Shutting down plugin 'ndbinfo'
2017-07-12T08:44:52.541861Z 0 [Note] Shutting down plugin 'ndbcluster'
2017-07-12T08:44:52.541871Z 0 [Note] NDB Index Stat: Stop
2017-07-12T08:44:52.541874Z 0 [Note] NDB Index Stat: Wakeup
2017-07-12T08:44:53.541406Z 0 [Note] NDB Index Stat: Stopping...
2017-07-12T08:44:53.541428Z 0 [Note] NDB Index Stat: Stopped
2017-07-12T08:44:53.541473Z 0 [Note] NDB Index Stat: Stop completed
2017-07-12T08:44:53.541479Z 0 [Note] NDB Util: Stop
2017-07-12T08:44:53.541482Z 0 [Note] NDB Util: Wakeup
2017-07-12T08:44:54.541541Z 0 [Note] NDB Util: Stopped
2017-07-12T08:44:54.541600Z 0 [Note] NDB Util: Stop completed
2017-07-12T08:44:55.541945Z 0 [Note] Shutting down plugin 'BLACKHOLE'
2017-07-12T08:44:55.541973Z 0 [Note] Shutting down plugin 'ARCHIVE'
2017-07-12T08:44:55.541976Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
2017-07-12T08:44:55.542017Z 0 [Note] Shutting down plugin 'CSV'
2017-07-12T08:44:55.542021Z 0 [Note] Shutting down plugin 'MEMORY'
2017-07-12T08:44:55.542025Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
2017-07-12T08:44:55.542028Z 0 [Note] Shutting down plugin 'MyISAM'
2017-07-12T08:44:55.542044Z 0 [Note] Shutting down plugin 'INNODB_SYS_VIRTUAL'
2017-07-12T08:44:55.542047Z 0 [Note] Shutting down plugin 'INNODB_SYS_DATAFILES'
2017-07-12T08:44:55.542049Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESPACES'
2017-07-12T08:44:55.542052Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN_COLS'
2017-07-12T08:44:55.542055Z 0 [Note] Shutting down plugin 'INNODB_SYS_FOREIGN'
2017-07-12T08:44:55.542057Z 0 [Note] Shutting down plugin 'INNODB_SYS_FIELDS'
2017-07-12T08:44:55.542060Z 0 [Note] Shutting down plugin 'INNODB_SYS_COLUMNS'
2017-07-12T08:44:55.542062Z 0 [Note] Shutting down plugin 'INNODB_SYS_INDEXES'
2017-07-12T08:44:55.542065Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLESTATS'
2017-07-12T08:44:55.542067Z 0 [Note] Shutting down plugin 'INNODB_SYS_TABLES'
2017-07-12T08:44:55.542070Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_TABLE'
2017-07-12T08:44:55.542072Z 0 [Note] Shutting down plugin 'INNODB_FT_INDEX_CACHE'
2017-07-12T08:44:55.542075Z 0 [Note] Shutting down plugin 'INNODB_FT_CONFIG'
2017-07-12T08:44:55.542077Z 0 [Note] Shutting down plugin 'INNODB_FT_BEING_DELETED'
2017-07-12T08:44:55.542080Z 0 [Note] Shutting down plugin 'INNODB_FT_DELETED'
2017-07-12T08:44:55.542082Z 0 [Note] Shutting down plugin 'INNODB_FT_DEFAULT_STOPWORD'
2017-07-12T08:44:55.542085Z 0 [Note] Shutting down plugin 'INNODB_METRICS'
2017-07-12T08:44:55.542087Z 0 [Note] Shutting down plugin 'INNODB_TEMP_TABLE_INFO'
2017-07-12T08:44:55.542090Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_POOL_STATS'
2017-07-12T08:44:55.542092Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE_LRU'
2017-07-12T08:44:55.542103Z 0 [Note] Shutting down plugin 'INNODB_BUFFER_PAGE'
2017-07-12T08:44:55.542105Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX_RESET'
2017-07-12T08:44:55.542107Z 0 [Note] Shutting down plugin 'INNODB_CMP_PER_INDEX'
2017-07-12T08:44:55.542110Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM_RESET'
2017-07-12T08:44:55.542112Z 0 [Note] Shutting down plugin 'INNODB_CMPMEM'
2017-07-12T08:44:55.542114Z 0 [Note] Shutting down plugin 'INNODB_CMP_RESET'
2017-07-12T08:44:55.542116Z 0 [Note] Shutting down plugin 'INNODB_CMP'
2017-07-12T08:44:55.542119Z 0 [Note] Shutting down plugin 'INNODB_LOCK_WAITS'
2017-07-12T08:44:55.542121Z 0 [Note] Shutting down plugin 'INNODB_LOCKS'
2017-07-12T08:44:55.542123Z 0 [Note] Shutting down plugin 'INNODB_TRX'
2017-07-12T08:44:55.542126Z 0 [Note] Shutting down plugin 'InnoDB'
2017-07-12T08:44:55.542172Z 0 [Note] InnoDB: FTS optimize thread exiting.
2017-07-12T08:44:55.542268Z 0 [Note] InnoDB: Starting shutdown...
2017-07-12T08:44:55.642455Z 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2017-07-12T08:44:55.642638Z 0 [Note] InnoDB: Buffer pool(s) dump completed at 170712 8:44:55
2017-07-12T08:44:57.142003Z 0 [Note] InnoDB: Shutdown completed; log sequence number 2541246
2017-07-12T08:44:57.143785Z 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2017-07-12T08:44:57.143802Z 0 [Note] Shutting down plugin 'sha256_password'
2017-07-12T08:44:57.143806Z 0 [Note] Shutting down plugin 'mysql_native_password'
2017-07-12T08:44:57.143975Z 0 [Note] Shutting down plugin 'binlog'
2017-07-12T08:44:57.144096Z 0 [Note] /usr/sbin/mysqld: Shutdown complete
Second the cluster log
======================
2017-07-11 09:30:38 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:51:04 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:59410' to transporter: line: 554 : Incorr
ect state for node 3 state: does nothing (2)
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Node 5: Node 3 Connected
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:51:04 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:51:06 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:09 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:12 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:14 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:51:15 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:18 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 1, 2 and 4 to connect, nodes [ all: 1, 2, 3 and 4 co
nnected: 3 no-wait: ]
2017-07-11 09:51:20 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:53:30 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34054' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:53:31 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34056' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31
gmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34058' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34060' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:31 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34062' to transporter: line: 545 : Incorr
ect reply from client: >3 1
:
:
:
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34338' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34340' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Nodeid 1 allocated for NDB at 10.215.2.70
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34342' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34344' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34346' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34348' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Start phase 0 completed
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 opened
2017-07-11 09:53:44 [MgmtSrvr] INFO -- Node 1: Waiting 30 sec for nodes 2 to connect, nodes [ all: 1 and 2 connected: 1 no-wait
: ]
2017-07-11 09:53:44 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:34350' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:15 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35006' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:15 [MgmtSrvr] INFO -- Alloc node id 2 failed, no new president yet
2017-07-11 09:54:15 [MgmtSrvr] INFO -- Nodeid 2 allocated for NDB at 10.215.2.71
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35008' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35010' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35012' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Buffering maximum epochs 100
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Start phase 0 completed
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35014' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Communication to Node 1 opened
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Waiting 30 sec for nodes 1 to connect, nodes [ all: 1 and 2 connected: 2 no-wait
: ]
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35016' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 2: Node 1 Connected
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: Node 2 Connected
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: Start with all nodes 1 and 2
2017-07-11 09:54:16 [MgmtSrvr] INFO -- Node 1: CM_REGCONF president = 1, own Node = 1, our dynamic id = 0/1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35018' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35020' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35022' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:16 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35024' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:17 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35026' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35074' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35076' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: CM_REGCONF president = 1, own Node = 2, our dynamic id = 0/2
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Node 2: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Node 1: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 1 completed
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 1 completed
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: System Restart: master node: 2, num starting: 1, gci: 1695282
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: CNTR_START_CONF: started: 0000000000000000
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: CNTR_START_CONF: starting: 0000000000000006
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35078' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 2 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 2 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Start phase 3 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 2: Start phase 3 completed (system restart)
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Restarting cluster to GCI: 1695282
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35080' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Restore dictionary information from disk Starting
2017-07-11 09:54:19 [MgmtSrvr] INFO -- Node 1: Starting to restore schema
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35082' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35084' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35086' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:19 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35088' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35090' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore of schema complete
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Starting to restore schema
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35092' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35094' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Restore of schema complete
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore dictionary information from disk Completed
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Restore Database from disk Starting
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node: 1 StartLog: [GCI Keep: 1689184 LastCompleted: 1695282 NewestRestorable: 16
95282]
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node: 2 StartLog: [GCI Keep: 1689184 LastCompleted: 1695004 NewestRestorable: 16
95282]
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: LDM instance 0: Restored LCP : 4 fragments, 2050 rows, 5 millis, 410000 rows/s
ect reply from client: >3 1
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 1: Node 5: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:20 [MgmtSrvr] INFO -- Node 2: Node 5: API mysql-5.7.18 ndb-7.5.6
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 4 opened
2017-07-11 09:54:21 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35108' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Node 3 Connected
2017-07-11 09:54:21 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.72:35118' to transporter: line: 545 : Incorr
ect reply from client: >3 1
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 4 opened
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0001f6c2a6e8]
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 3: Forced node shutdown completed. Occured during startphase 1. Caused by error 230
2: 'node id in the configuration has the wrong type, (i.e. not an NDB node)(Configuration error). Permanent error, external action
needed'.
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 1: Node 3 Disconnected
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 closed
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 closed
2017-07-11 09:54:21 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0001f6c2a6e8]
2017-07-11 09:54:21 [MgmtSrvr] ALERT -- Node 2: Node 3 Disconnected
2017-07-11 09:54:25 [MgmtSrvr] INFO -- Node 1: Communication to Node 3 opened
2017-07-11 09:54:25 [MgmtSrvr] INFO -- Node 2: Communication to Node 3 opened
2017-07-11 09:55:01 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:55:17 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Got initial configuration from '/var/lib/mysql-cluster/config.ini', will try to set it w
hen all ndb_mgmd(s) started
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:57:35 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:57:36 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.71:42246' to transporter: line: 554 : Incorr
ect state for node 2 state: does nothing (2)
2017-07-11 09:57:36 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.70:51914' to transporter: line: 554 : Incorr
ect state for node 1 state: does nothing (2)
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Starting initial configuration change
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Configuration 1 commited
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Config change completed! New generation: 1
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:57:36 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0002f6c382c1]
2017-07-11 09:58:32 [MgmtSrvr] WARNING -- Failed to allocate nodeid for NDB at 10.215.2.71. Returned error: 'No free node id found
for ndbd(NDB).'
2017-07-11 09:59:18 [MgmtSrvr] INFO -- Shutting down server...
2017-07-11 09:59:23 [MgmtSrvr] INFO -- Shutdown complete
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Loaded config from '/usr/mysql-cluster/ndb_5_config.bin.1'
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Id: 5, Command port: *:1186
2017-07-11 09:59:37 [MgmtSrvr] INFO -- MySQL Cluster Management Server mysql-5.7.18 ndb-7.5.6 started
2017-07-11 09:59:37 [MgmtSrvr] INFO -- Node 5: Node 5 Connected
2017-07-11 09:59:38 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.70:52484' to transporter: line: 554 : Incorr
ect state for node 1 state: does nothing (2)
2017-07-11 09:59:38 [MgmtSrvr] WARNING -- Failed to convert connection from '10.215.2.71:42832' to transporter: line: 554 : Incorr
ect state for node 2 state: does nothing (2)
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5 connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5: Node 1 Connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 5: Node 2 Connected
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 2: Prepare arbitrator node 5 [ticket=1b8a0003f6c74334]
2017-07-11 09:59:38 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0003f6c74334]
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Local checkpoint 112 started. Keep GCI = 1695004 oldest restorable GCI = 1695282
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 5: Node 2 Disconnected
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: LDM(0): Completed LCP, #frags = 4 #records = 2050, #bytes = 65680
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Node 2 Disconnected
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 closed
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Network partitioning - arbitration required
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: President restarts arbitration thread [state=7]
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 2: Forced node shutdown completed. Caused by error 2341: 'Internal program error (f
ailed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
2017-07-11 19:04:44 [MgmtSrvr] ALERT -- Node 1: Arbitration won - positive reply from node 5
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: NR Status: node=2,OLD=Initial state,NEW=Node failed, fail handling ongoing
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Local checkpoint 112 completed
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: NR Status: node=2,OLD=Node failed, fail handling ongoing,NEW=Node failure handli
ng complete
2017-07-11 19:04:44 [MgmtSrvr] INFO -- Node 1: Started arbitrator node 5 [ticket=1b8a0004f8ba4fbd]
2017-07-11 19:04:47 [MgmtSrvr] INFO -- Node 1: Communication to Node 2 opened
Subject
Views
Written By
Posted
10046
July 10, 2017 05:02AM
2346
July 10, 2017 06:41AM
1945
July 10, 2017 09:52AM
1569
July 11, 2017 03:31AM
1537
July 12, 2017 04:07AM
1465
July 11, 2017 03:33AM
1070
July 11, 2017 05:01AM
1019
July 12, 2017 01:36AM
953
July 12, 2017 04:55AM
1006
July 12, 2017 06:57AM
Re: Failed to allocate nodeid, error: 'Error: Could not alloc node id at .. : Connection done from wrong host
2872
July 12, 2017 08:56AM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.