MySQL Forums :: Performance :: word index - is there a better solution?


Advanced Search

word index - is there a better solution?
Posted by: Craig Logan ()
Date: June 03, 2010 01:36PM

hi there,

I'm currently working on a system that allows users to search in about 500M documents (+5M every month).

now the standard approach would of course be to create a word index. this would, however, result in a table of about 100B rows, which kinda scares me because of the performance and maintenance implications (for example, file size limits and how we're going to backup this beast).

I have had mySQL tables with several billion rows that worked fine performance wise, but I guess 100B rows could be a different story.

so basically, I am wondering if there's a different approach for this (even though I'm pretty sure there isn't).

thanks.
craig.

Options: ReplyQuote


Subject Views Written By Posted
word index - is there a better solution? 3948 Craig Logan 06/03/2010 01:36PM
Re: word index - is there a better solution? 1293 Rick James 06/04/2010 07:40PM
Re: word index - is there a better solution? 1256 Craig Logan 06/04/2010 08:49PM
Re: word index - is there a better solution? 1256 Rick James 06/04/2010 11:33PM
Re: word index - is there a better solution? 1182 Craig Logan 06/05/2010 12:21AM
Re: word index - is there a better solution? 1128 Rick James 06/05/2010 12:41PM
Re: word index - is there a better solution? 1204 Craig Logan 06/05/2010 01:45PM
Re: word index - is there a better solution? 1162 Rick James 06/05/2010 09:13PM
Re: word index - is there a better solution? 969 Craig Logan 06/06/2010 10:13AM
Re: word index - is there a better solution? 1156 Rick James 06/06/2010 07:36PM
Re: word index - is there a better solution? 1164 Craig Logan 06/06/2010 08:29PM
Re: word index - is there a better solution? 1109 Rick James 06/07/2010 09:29AM
Re: word index - is there a better solution? 979 Craig Logan 06/07/2010 01:02PM
Re: word index - is there a better solution? 771 Rick James 08/27/2010 08:37PM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.