This tag is for general database questions; if you question is specific to SQL use that tag instead.
1
vote
2answers
59 views
Design question - storing data twice
I have a polyglot database solution that includes the following components:
a management interface that consists of a web application and a document based database (either rethinkdb or mongo)
a ...
4
votes
1answer
46 views
Best strategy for creating/updating CI build database
I was wondering what the best practice is regarding databases for integration tests on the build server. If there is a best practice.
Currently, our build will create a new database from scratch for ...
0
votes
1answer
25 views
Redundancy in object data storage
In the relational database world, we would tend to store unique pieces of data uniquely (e.g., in a single table, for example). However, now, with object stores (e.g., Firebase) it seems like storing ...
0
votes
1answer
38 views
Transferring changes to production database
I have a website that's running on a production server, backed by mongodb. Every hour or so, some new data becomes available that I want to add to the db, inserting new documents, and updating old ...
0
votes
2answers
53 views
Notifications in a microservice architecture: In Application Logic vs. Database Triggers
Context
Our group builds and is responsible for maintaining multiple apps for a larger institution. We are in the process of breaking up our monoliths into reusable microservices (hooray!). When we ...
1
vote
1answer
62 views
How to use object oriented principles to design a system that trims, selects, and formats values based on business rules, and unit measuring system?
TL;DR:
I have bad, no .. horrible, horrendous code that kind of works but is a mess and is not easily maintainable.
I want to redesign it and repackage it to where objects are well defined and ...
4
votes
1answer
52 views
Fast Upload/Retrieval For Blob Data Solutions
Problem
I am currently investigating a solution to allow fast upload (and retrieval) of data that can be implemented via NoSQL/SQL or a file system on a Centos server with 64 core cpu with 529GB of ...
4
votes
3answers
148 views
How to DRY with calls to a database to execute?
I'm writing a python app that instructs a database to perform various processing instructions on partitioned tables. The processing can take long enough that there might be a timeout, so I surround my ...
1
vote
2answers
87 views
Evaluating the cost of a query in database
We are working on a project using Google App Engine + Google Cloud Datastore. The language used is Python.
At some points of our API, we check if some arg is passed in request, and we make some query ...
0
votes
2answers
119 views
How to handle fast data generation vs slow data storage efficiently
I'm working on a project that generates massive amount of data and store that data in a SQL database. I'm talking about like 1 thousand records per second. Next I've to push that data to a database. ...
31
votes
6answers
4k views
Why is SQL the only database query language? [duplicate]
For general-purpose programming there are literally hundreds of programming languages. But for interacting/querying the databases, why is SQL pretty much the only used language?
-3
votes
1answer
67 views
Is there any benifit to using a PHP class to handle MySQL queries?
I know several frameworks have this functionality built in where you can use their special methods to make DB queries. I also know this is (partially) to ensure that everything is handled correctly to ...
0
votes
0answers
26 views
Best method in order to search, filter, or load items in a mobile application?
I want to design a mobile application in which users who have already registered are able to add/delete some human skills in their profile page. Skills are categorized hierarchically as a tree: each ...
0
votes
0answers
21 views
A proposed method to handle some specific requirements of a mobile application
I want to design and implement a mobile application in which:
Users who have already registered are able to add/delete some human
skills in their profile page. Skills are categorized hierarchically:
...
-1
votes
2answers
67 views
Relational or non relational database for my described application?
I want to design and implement a mobile application in which:
Every user who have already registered is able to add new news
(including title: text plus a picture, and content: long text,
pictures or ...
-2
votes
0answers
53 views
Store the entire video in database or just its file name? [duplicate]
I have an web application to develop that I will have to save all videos the users uploads and reproduce them at some point.
This application must deal with extreme internet's delays since it will be ...
0
votes
1answer
55 views
Where to format number strings? Server or browser?
I am storing numbers in my database without formatting (e.g., 1434587). But I need a formatted string in the UX (e.g., $1,434,587).
Is it better to store the raw number AND the formatted value in the ...
1
vote
0answers
26 views
Should I implement an intermediate Profile table now, or wait until if/when I need it?
Traditionally the schema is very simple:
User <- Post
I have written the code for a Profile model to be an intermediate:
User <- ProfileUser -> Profile <- Post
When registering for the ...
0
votes
0answers
22 views
Modeling database to store files and search its content
I have a functionality which I must deal.
The requirement of a project is to transform papers to pdf and store this files.
The main functionality is that the user is being able to search words in the ...
-1
votes
1answer
95 views
How to handle legacy versions of DAL and Database?
Lets say you have a Database, and a Data Access Layer (DAL)
The DAL will be consumed by a various number of products which access the Database.
As time goes on, you add new fields and tables to the ...
0
votes
0answers
28 views
Best practices in finding nearest features vectors for OpenFace representations
I am trying to implement a face grouping application that will group faces based on similarities using OpenFace.
OpenFace generates a 128D unit hypershpere representation vector that represents the ...
3
votes
1answer
85 views
Should I have a single Microservice Instance when there are several versions of the same database
We have 25 instances of the same database facilitating different production plants in our organization. Basically, location X uses it's own copy of the database, location Y uses it's own copy, etc. ...
-3
votes
0answers
40 views
How to update mobile application using a web-portal database server (content management system)?
We would like to develop a mobile application that will have a web-based for administrator or Content Management System. All database will be saved at the CMS, like all input informations from mobile ...
1
vote
2answers
107 views
Use (numeric) IDs over names as unique key?
I have a set of data (assume they are objects) with unique immutable names, like this:
class Datum {
final string name
// other fields
}
Considering that:
I don't need to support rename. (...
-2
votes
0answers
23 views
Getting started with an angularJS app, need help creating a database and querying it
I'm trying to learn AngularJS by creating a small app which will require users to register/log in. I understand that I will need a server side language and I'd like to use NodeJS along with MongoDB ...
4
votes
2answers
117 views
Why are dependencies typically reversed when representing complex objects as relational tables?
I'm going through some sort of phase where I over analyze and second guess every single decision I make when attempting to write software that has preventing me from getting anything done.
I recently ...
0
votes
2answers
74 views
Receiving lots of records and storing them in a database in a short time frame
A colleague has challenged me with an interesting question. To be honest I have no idea how to deal with it.
Suppose the following:
Every 5 minutes you get a new file with one hundred thousand ...
1
vote
2answers
64 views
General approach to an interface that will resolve a dependency to a database library
Background
I often write software for systems that are responsible for testing manufactured products. For every product that gets tested, we have to generate a report for the test-results. The way ...
1
vote
3answers
196 views
In-memory data collection object(s) vs database
I have a couple of questions about the practicality of developing a WPF application that loads data into memory from a text file and then manipulates the resulting object(s) instead of transactions ...
-2
votes
1answer
94 views
I'm trying to create a file with all possible outcomes of tic tac toe and store it using java. How do i do it?
I'm trying to store more than 512 combinations of a game somewhere locally on my hard drive as a single file permanently unlike the temorary nature of arrays. If I store it in a text file like I ...
1
vote
2answers
65 views
A good way to program for closing a long running MySQL connection and re-open it at intervals?
I'm running a Java application that creates 50 threads as part of a threadpool; each thread running in an object that reads 1000 unique rows at a time from a MySQL table. So each object has it's own ...
0
votes
0answers
18 views
Which managed database service from AWS should be used to store/ query spatial data?
I'm wanting to store & query PointsOfInterests at(in 'x' km radius of) any location. Plan to use a managed database service from Amazon without any other backend service for the app.
How do I ...
0
votes
0answers
33 views
Reaction Time Test Website Advice
For my Peace and Conflicts study class research paper, I want to make a website similar to this one: https://implicit.harvard.edu/implicit/ which tests people on reaction time.
The basic way this ...
0
votes
0answers
41 views
What happens when adding/deleting a column in a Database?
I've been working with Postgres through the Django ORM, but how it works is a mystery to me. I'd like to start learning by first understanding how it behaves, which will likely be useful information ...
13
votes
1answer
522 views
What is a realistic, real-world, maximum size for a SQLite database?
According to this article on Appropriate Uses For SQLite it says that, while SQLite is limited to 140 terabytes, a client/server RDBMS may work better:
An SQLite database is limited in size to 140 ...
2
votes
1answer
58 views
Best way to store ListView Data(ListView.Items) into file
I just came across this question telling how to store ListView Data(basically ListView.Items) into a text file but it got me thinking that, is it the best way to do it? In terms of efficiency, ...
3
votes
2answers
120 views
How would you keep databases synced and versioned across multiple environments?
We're multiple users working on multiple apps using one same database. The database schema is used in production, preproduction and development environments.
Right now, we're keeping it updated using ...
2
votes
2answers
112 views
Where to store many files?
I have 500.000 files with the combined size of 350GB. So an average file has 0.7MB size. Each file has metadata: 1 to 100 keywords and optionally a short description. I need to filter the files and ...
0
votes
3answers
183 views
Best way to query data from database and then modify it
I'm working on a software using VB.Net which retrieves string packets through a TCP socket. The problem is it receives hundreds of packets per second. For each incoming packet the software should ...
2
votes
2answers
81 views
How to maintain a database structure when there are multiple instance of the DB?
I've created an application that can create and update documents. A document is a relational database (it's a SQLite database).
I'm planning to update the structure of the database (add fields, add ...
0
votes
1answer
66 views
Need help creating a database of map polygons
As a side project with my coworkers -- we are oil and gas geologists -- we have been creating an interactive map-based learning tool for other geologists.
We are having trouble building the database, ...
1
vote
2answers
110 views
How to update a player's money count every second
I'm in the process of analysis for a browser-based game I'm making, and I have question about programming the economy system. I'll use a simplified system to ask my question.
Each user as GameState ...
39
votes
6answers
7k views
Why not return dates as a string from the database?
In a typical web application, dates are retrieved from the database layer strongly typed (e.g. in c# as a System.DateTime as opposed System.String).
When a date needs to be expressed as a string (e....
0
votes
1answer
55 views
How to store keys for an encrypted storage in .NET in-house service
In the company I'm working for we have a certain service where users can upload documents (text, sometimes document scans), it's nothing confidential but if those documents will be leaked, I'll get a ...
0
votes
0answers
26 views
Is mixed collation in a database a problem?
I have a database where some tables are Collation utf8_general_ci and some tables are Collation utf8_bin. Is this an issue that will cause unexpected behavior, or is it just a matter of performance?
1
vote
1answer
64 views
Loading all DB entries each time vs loading only new ones (and how to identify them)
I have a JSF Page (Primefaces) with a datatable that contains entries from a Database. Thoes entries represent transactions created by users.
Each time this page is loaded, I do this:
Clear the ...
1
vote
3answers
119 views
Is there a design pattern which describes separated join-only views and format-only views
When I'm building views in SQL, I tend to do one of the following:
Views that contain logic and criteria for selecting and joining records. I.e. "what records am I interested in and how do they fit ...
2
votes
2answers
94 views
How to improve version control on database structure when migrations take long?
I am working with a team of web developers. We are already using Git for version control of our code and it works well. However, while we are changing our code, it is also common to change the ...
0
votes
1answer
18 views
Using DB migration tools within a Virtual Machine with Vagrant
I am setting up Vagrant with multiple developers using ScotchBox (v2.5) in our workplace, I have got the initial vagrantfile working ok however I'm unsure of how best to handle Database migrations.
...
1
vote
3answers
144 views
Is it OK to create and drop databases during unit tests
I am working with EntityFramework 6 code first approach and SQL Server 2014 Express. However, the DBMS may change in future.
That setup allows easily to create a database and add some dummy data for ...
