Re: No Limits - Memory Engine
Currently I am getting 18.3K inserts per min. I think this can hold more, the application that generates this kind of data was down intermittently so this number might be skewed. The problem I am seeing is that after 29M records, the mysql instance restarts itself. Max table heap size is set to 256MB, innodb buffer pool size is set to 24GB. So when it hits 29M records (with a row size of 500bytes), the total memory consumption is about 14GB, causing mysql to crash. However there is no crash information in the error logs, just says mysql restarted. Here is the trace -
130305 14:14:05 [ERROR] Error reading packet from server: Lost connection to MySQL server during query ( server_errno=2013)
130305 14:14:05 [Note] Slave I/O thread killed while reading event
130305 14:14:05 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000046', position 830867049
130305 17:49:07 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000045' at position 158034763, relay log './relay-bin.000046' position: 1580
34909
130305 17:49:07 [Note] Slave I/O thread: connected to master 'repl@localhost:3306',replication started in log 'mysql-bin.000046' at position 830867049
130306 09:10:21 mysqld_safe Number of processes running now: 0
130306 09:10:21 mysqld_safe mysqld restarted
130306 9:10:21 [Note] Plugin 'FEDERATED' is disabled.
130306 9:10:21 InnoDB: The InnoDB memory heap is disabled
130306 9:10:21 InnoDB: Mutexes and rw_locks use GCC atomic builtins
130306 9:10:21 InnoDB: Compressed tables use zlib 1.2.3
130306 9:10:21 InnoDB: Using Linux native AIO
130306 9:10:21 InnoDB: Initializing buffer pool, size = 24.0G
130306 9:10:23 InnoDB: Completed initialization of buffer pool
130306 9:10:23 InnoDB: highest supported file format is Barracuda.
InnoDB: Log scan progressed past the checkpoint lsn 144695644663
130306 9:10:23 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery....
Can you please help me, to understand why mysql is restarting? Is it because of memory?
Thanks and Regards,
Raghu