NDB Cluster Error: 899 Rowid already allocated
We are running a Mysql NDB Cluster System, 2 mgm nodes, 2 data nodes. Got some 899 "Rowid already allocated" errors when insert data, "retry it" can be successful, what cause this error?
Connected to Management Server at: localhost:1186
Cluster Configuration
---------------------
[ndbd(NDB)] 2 node(s)
id=27 @169.254.100.1 (mysql-5.6.31 ndb-7.4.12, Nodegroup: 0)
id=28 @169.254.100.2 (mysql-5.6.31 ndb-7.4.12, Nodegroup: 0, *)
[ndb_mgmd(MGM)] 2 node(s)
id=1 @169.254.100.1 (mysql-5.6.31 ndb-7.4.12)
id=2 @169.254.100.2 (mysql-5.6.31 ndb-7.4.12)
[mysqld(API)] 24 node(s)
id=3 (not connected, accepting connect from SC-1)
id=4 @169.254.100.2 (mysql-5.6.31 ndb-7.4.12)
id=5 @169.254.100.6 (mysql-5.6.31 ndb-7.4.12)
id=6 @169.254.100.5 (mysql-5.6.31 ndb-7.4.12)
id=7 @169.254.100.3 (mysql-5.6.31 ndb-7.4.12)
id=8 @169.254.100.4 (mysql-5.6.31 ndb-7.4.12)
id=9 @169.254.100.6 (mysql-5.6.31 ndb-7.4.12)
id=10 @169.254.100.5 (mysql-5.6.31 ndb-7.4.12)
id=11 @169.254.100.3 (mysql-5.6.31 ndb-7.4.12)
id=12 @169.254.100.4 (mysql-5.6.31 ndb-7.4.12)
id=13 (not connected, accepting connect from any host)
id=14 (not connected, accepting connect from any host)
id=15 (not connected, accepting connect from any host)
id=16 (not connected, accepting connect from any host)
id=17 (not connected, accepting connect from any host)
id=18 (not connected, accepting connect from any host)
id=19 (not connected, accepting connect from any host)
id=20 (not connected, accepting connect from any host)
id=21 (not connected, accepting connect from any host)
id=22 (not connected, accepting connect from any host)
id=23 (not connected, accepting connect from any host)
id=24 (not connected, accepting connect from any host)
id=25 (not connected, accepting connect from any host)
id=26 (not connected, accepting connect from any host)
The network condition between data nodes:
64 bytes from SC-2 (169.254.100.2): icmp_seq=14061 ttl=64 time=6.73 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14062 ttl=64 time=4.69 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14063 ttl=64 time=0.946 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14064 ttl=64 time=2.75 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14065 ttl=64 time=8.28 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14066 ttl=64 time=6.10 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14067 ttl=64 time=0.722 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14068 ttl=64 time=0.595 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14069 ttl=64 time=0.698 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14070 ttl=64 time=1.66 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14071 ttl=64 time=1.99 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14072 ttl=64 time=1.66 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14073 ttl=64 time=1.13 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14074 ttl=64 time=4.39 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14075 ttl=64 time=2.73 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14076 ttl=64 time=4.02 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14077 ttl=64 time=1.44 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14078 ttl=64 time=1.77 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14079 ttl=64 time=0.527 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14080 ttl=64 time=4.65 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14081 ttl=64 time=0.148 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14082 ttl=64 time=6.54 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14083 ttl=64 time=0.272 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14084 ttl=64 time=0.547 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14085 ttl=64 time=0.177 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14086 ttl=64 time=7.70 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14087 ttl=64 time=7.59 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14088 ttl=64 time=0.155 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14089 ttl=64 time=2.57 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14090 ttl=64 time=6.03 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14091 ttl=64 time=2.85 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14092 ttl=64 time=2.24 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14093 ttl=64 time=6.21 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14094 ttl=64 time=5.04 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14095 ttl=64 time=0.571 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14096 ttl=64 time=5.51 ms
64 bytes from SC-2 (169.254.100.2): icmp_seq=14097 ttl=64 time=3.88 ms