Tell me more ×
Database Administrators Stack Exchange is a question and answer site for database professionals who wish to improve their database skills and learn from others in the community. It's 100% free, no registration required.
up vote 0 down vote favorite

What would be an appropriate / suitable database sans Oracle that would be suitable for the following conditions?

  1. data mining includes but does not limit to the following: a. clicking on links b. capture geolocation data, platform details c. user behaviours

  2. there will be a foreseen exponential surge of data being captured as more apps / sites being deployed

  3. for now, there are on average 60,000 ~ 80,000 data being captured every 15 minutes for 2 main sites / apps

  4. In the near future, we are also planning to release all these data to the various parties involved where they can use it for their own apps / sites.

As of now, we are using mySQL but we found that it becomes very costly as we started to scale up. As such, any advice would be good as a starting point.

share|improve this question
maybe you should start with what budget is available and what storage solution fits that. – ik_zelf Feb 5 at 17:39
I'm not sure about storage solution, hence I'm asking that question. As for budget, as low as possible if not 0. Mainly because we are investing most of our resources on bandwidth and we already have 2 racks of server space available for our own use – Gino Feb 6 at 6:57

1 Answer

up vote 0 down vote accepted

Mahout with HBase is probably a good option for very large datasets.

It is designed to run on many cheap commodity servers.

Also, monetDB is an open-source column-wise database which is very fast for data warehouses.

share|improve this answer
Ok, I'll take a look at that. I have read up hadoop briefly. Will that also be appropriate in our requirements? – Gino Feb 6 at 6:59
Hadoop is a distributed file system and parallel processing framework. It could do what you want to do. HBase and Mahout build on top of Hadoop. HBase allows for random access reads (it's a database on top of Hadoop), and Mahout is a distributed data mining library that can use Hadoop or HBase. – Neil McGuigan Feb 6 at 19:07

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.