Tagged Questions
1
vote
2answers
263 views
How to handle large amounts of data in MySQL database?
Background
I have spent couple of days trying to figure out how I should handle large amounts of data in MySQL. I have selected some programs and techniques for the new server for the software. I am ...
0
votes
2answers
68 views
When to use horizontal partitioning and when to use database sharding?
I'm reading this article on Wikipedia: http://en.wikipedia.org/wiki/Shard_(database_architecture) trying to find the major difference between these 2 techniques. Here is what I found:
Horizontal ...
1
vote
1answer
177 views
Best way to deal with Big data in mysql
Current Design
Previously my co-worker designed a databse which had tables like customer_0, customer_1.... to customer_9 wherby all the customer ids are split into 10 different tables based on the ...
2
votes
2answers
3k views
Database partitioning - Horizontal vs Vertical - Difference between Normalization and Row Splitting?
I am trying to grasp the different concepts of Database Partitioning and this is what I understood of it:
Horizontal Partitioning/Sharding: Splitting a table into different table that will contain a ...
1
vote
1answer
89 views
Strategy to maintain large table of backup catalogs per project in MySQL or PostgreSQL
I am developing an LTO backup/restore solution based on gnu tar.
We either keep the tapes inhouse, or the customer might buy these backups from us.
Hence the choice of a widely available, and free ...
0
votes
2answers
323 views
Performance in a 1 million row MySQL-table in a chess game scenario
Say I run a game website where the users play chess to each other. I have a MySQL-table that contain all the games with their individual chess moves:
Games table (psuedo syntax):
gameId INT
...
10
votes
8answers
736 views
Storing changes on entities: Is MySQL the proper solution?
i want to store changes that i do on my "entity" table. This should be like a log. Currently it is implemented with this table in MySQL:
CREATE TABLE `entitychange` (
`id` int(11) unsigned NOT NULL ...
2
votes
3answers
690 views
Table scaling with partitions or with separate databases?
Let's say I have a table (let's call it BigTable) which could experience 5,000,000 INSERTS per day (with possibly just as many SELECTs). Each row inserted is about 50kb.
These daily INSERTs are ...
6
votes
1answer
334 views
One large table partitioned and then subpartitioned or several smaller partitioned tables?
I currently have several audit tables that audit specific tables data.
e.g. ATAB_AUDIT, BTAB_AUDIT and CTAB_AUDIT auditing inserts, updates and deletes from ATAB, BTAB and CTAB respectively.
These ...
8
votes
8answers
3k views
Mysql improve SELECT speed
I'm currently trying to improve the speed of SELECTS for a MySQL table and would appreciate any suggestions on ways to improve it.
We have over 300 million records in the table and the table has the ...
2
votes
1answer
178 views
database partioning explanation
I just read about database partitioning and still have some confusion about it.
So anybody please give me some explanations about what were changed in term of disk storage(like data file, index file, ...
5
votes
4answers
1k views
Too many columns to index - use mySQL Partitions?
We have an application with a table with 20+ columns that are all searchable. Building indexes for all these columns would make write queries very slow; and any really useful index would often have to ...
1
vote
1answer
466 views
Design recommendations for a history/audit table
I need to keep track of many items and their states throughout time.
Example
ItemId Location DateTime State
1 Mall A 2010-02-03 07:00 on_sale
1 Mall A 2010-02-20 08:22 ...
3
votes
1answer
254 views
Way to map partioned data using NHibernate
We have a scenario where active records are stored in one table and over time old records are archived. The table structures for the two tables - active and archive are exactly the same.
E.g
...
0
votes
1answer
200 views
MySQL performance with partition option
I've designed mysql tables for bookings. One of them has hotels_id, rt_id, -> (room_type_id), date .....
Every rt_id has 365 rows (date). And every hotels_id has some rt_id (room types)
for example ...
0
votes
1answer
720 views
Database Design - when to split data into multiple tables?
I have a table of Animals:
Animals
Id Name
1 Dog
2 Cat
3 Rabbit
Each animal has a portfolio therefore I have two methods of defining the database tables.
METHOD 1:
Portfolio
...
2
votes
3answers
109 views
Is it OK to re-create many SQL connections (SQL 2008)
When performing many inserts into a database I would usually have code like this:
using (var connection = new SqlConnection(connStr))
{
connection.Open();
foreach (var item in items)
{
var ...
0
votes
1answer
2k views
mySQL KEY Partitioning using three table fields (columns)
I am writing a data warehouse, using MySQL as the back-end. I need to partition a table based on two integer IDs and a name string. I have read (parts of) the mySQL documentation regarding ...
3
votes
2answers
2k views
Partitioning a database table in MySQL
I am writing a data warehouse, using MySQL as the back-end. I need to partition a table based on two integer IDs and a name string.
A more concrete example would be to assume that I am storing data ...
3
votes
5answers
706 views
Partition by Date and PK
I am designing a new laboratory database.
My primary data tables will have at least id (PK NUMBER) and created_on (DATE). Also, for any two entries, the entry with a higher id will have a later ...
