MySQL Forums
Forum List  »  Data Warehouse

mysql or hadoop?
Posted by: sanjo cole
Date: March 08, 2010 09:54AM


i'm working on a data warehouse and am deciding whether to use hadoop or mysql.

the dataset is currently likely to be no bigger than 40gb for the first year, then perhaps 80gb for the next year, and possibly 120gb the year after.

we want to be able to query all of the data at any point in the future - we aren't interested in throwing data away since we can't envisage how we might want to use it.

so, would mysql be the right choice? i don't need high availability since this will be a back-office application, and the number of different queries won't be problematic - if staff want to perform queries, they don't really need real-time results.

how large can mysql scale for this kind of thing? should i perhaps look at something like hadoop instead? i'm feeling it'd be overkill today, but how would mysql deal with a dataset of ~ 300gb?

any help would be appreciated.


Options: ReplyQuote

Written By
mysql or hadoop?
March 08, 2010 09:54AM

Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.