MySQL Forums :: InnoDB :: Growth of .ibd and .ibdata files


Advanced Search

Re: Growth of .ibd and .ibdata files
Posted by: Tiago 504 ()
Date: October 11, 2016 10:36AM

Hello,

Thanks for answering.

The question is, there are two distinct events when innodb access the related files: commits on the redo log files, and checkpoints.
By reading many mysql documentation and some blogs of innodb (many of them provided at the beginning of this forum), as well as by reading some parts of the source code and seeing some practical examples, I found that a checkpoint ends when there is a write access in the ib_logfile0 file at the offset 512 or 1536 (which is where is stored the information about the place in the log where the latest MLOG_CHEKCPOINT record is).

I also learned that, in case of a crash, the log records subsequent to the latest MLOG_CHEKCPOINT record (found on the offset 512 or 1536 of ib_logfile0) are executed to recover the state of the database.

The problem is that, imagine that i save the database state after the finish of a checkpoint, i.e., after a write access to the offset 512 or 1536 of ib_logfile0, and after that I only save the commits to the redo log files (i.e., i don't save any .ibdata and .idb file I/O). After a while I introduce a disk crash and then try to perform recover.

This kind of test only works sometimes. When it does not work I found an error in the log error of mysql saying that, while doing the recovery, it tries to access a page (of a .ibd file) that does not exist. I suspect that this is because the growth of the file that I mentioned in the first post isn't reflected on the redo log files.

Note that each time I run recover with the latest checkpoint it always works.

I just would like to understand why it does not work in that specific cases since the redo logs supposedly have information to perform all the updates performed since the last checkpoint.

PS: My test is not so small since i'm catching all the disk I/O performed by mysql when loaded with a TPC-C workload.

Thanks in advance,
Best regards,
Tiago Oliveira

Options: ReplyQuote


Subject Views Written By Posted
Growth of .ibd and .ibdata files 531 Tiago 504 10/06/2016 08:38AM
Re: Growth of .ibd and .ibdata files 352 Rick James 10/08/2016 12:00PM
Re: Growth of .ibd and .ibdata files 297 Peter Brawley 10/08/2016 06:18PM
Re: Growth of .ibd and .ibdata files 387 Tiago 504 10/11/2016 10:36AM
Re: Growth of .ibd and .ibdata files 251 Rick James 10/16/2016 03:29PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.