The data tag has no wiki summary.
0
votes
0answers
33 views
mapping data with a spike to a heat map [migrated]
I have the following data set that I need to display on the heat map:
[ 30, 15, 66, 7, 9999, 78, 42, 132 ]
So if I map the values to the color scale using a linear function I only see the spike ...
3
votes
1answer
120 views
How to process an endless XML data stream
There is an endless data stream of XML messages (and "heartbeats"), that I receive via a telnet connection and through a site-to-site VPN IPsec tunnel.
I'm still pondering. What is the best/most ...
0
votes
0answers
17 views
Extracting data point locations from a postscript/pdf plot [closed]
There are a number of tools available for manually extracting the x/y coordinates of points in a data plot, such as WebPlotDigitizer and digitize.
They work well when there are only a few ...
0
votes
0answers
22 views
How are data types related to information theory? [migrated]
I was just reading from wikipedia the following about information:
From the stance of information theory, information is taken as a
sequence of symbols from an alphabet, say an input alphabet χ, ...
-1
votes
3answers
92 views
How would I create a program in python that would pull data from the web [closed]
Like my title says I'm wondering how to do so. I have a little idea by using the Requests library. I also want to know is this a little ambitious of a programmer with little experience.
8
votes
3answers
209 views
Is a single object to be preferred over multiple variables?
It was quite hard to put what I meant into a title, but it's easy to put into code.
C++
Is this
int offset_x = 10;
int offset_y = 40;
...
element.move(offset_x, offset_y);
To be preferred over ...
-1
votes
0answers
44 views
Where can I find data on class diagram's usage and popularity? [closed]
Where can I find information or statistics on the popularity of "Class diagrams"? I'm researching information concerning:
Are class diagrams popular or not?
Does people actually use them outside of ...
3
votes
2answers
75 views
What's a good format for documenting hundreds of data feeds?
Several governments are starting to publish open data: datasets generated by the goverment, made freely available for citizens to use for value-added app development, analysis, and feedback. For ...
8
votes
2answers
305 views
Why build data models in a dynamic language?
Background
This question stems out of an architectural discussion we had at work.
For the current project we are using Python and an object oriented database. There are input services that we ...
8
votes
11answers
3k views
Why do “data types” in computers exist, if it's really all just bits? [closed]
I am confused with the wide array of ways to implement existing data types in hardware as it all seems a bit illusory.
For example:
There's no such thing as a software stack or a hardware stack; a ...
3
votes
2answers
90 views
Design strategies for storing and validating serial numbers
We are writing software to track Foo Widgets. Each Foo Widget has a serial number. The serial number is an 32-character alphanumeric string. The string is separated into five sets. Each set is ...
1
vote
1answer
105 views
Storing 'sensitive' data in settings file
I'm writing a small utility in AutoIt that connects to Twitter. I would like to store the username and password in the programs setting file, but I know that it needs to be encrypted obviously. ...
1
vote
1answer
22 views
Multiple Display of a Document and persist each viewer change in a single document
i have a scenario where i have to make available a document for viewing and editing to multiple users, the users can edit and view the document at the same time. Now the problem arises here if for ...
1
vote
0answers
35 views
How to organize integration tests and test data for different environments when using Maven Failsafe
I have started to separate my unit tests from my integration tests by using Maven Surefire and Failsafe.
Now I'm wondering what good ways there are to deal with separate environments. Take for ...
5
votes
1answer
130 views
Terminology: Really Delete vs set IsDeleted (“soft delete”) flag
I have a site where a regular user can delete records, where what happens is that an IsDeleted flag gets set. On administrative pages, a privileged user can delete records where an actual SQL DELETE ...
1
vote
0answers
55 views
What will be the better way for data retrieval on application that needs to handle limited amount of data?
Just moved this question from Stack Overflow. Since, adding my code snippets itself would make this question really long. Instead, I am pretty interested in knowing a better ways for data retrieval on ...
0
votes
1answer
108 views
How best to merge/sort/page through tons of JSON arrays?
Here's the scenario: Say you have millions of JSON documents stored as text files. Each JSON document is an array of "activity" objects, each of which contain a "created_datetime" attribute. What is ...
2
votes
0answers
71 views
Is there a canonical book on data integration? [closed]
I am currently interested in learning more about using Hadoop to create scalable ETL scripts. As part of that, I want to build a solid understanding of data integration best practices, and the ...
1
vote
2answers
128 views
Referential integrity in a database where tuples are not physically deleted
Many modern Relational Database Management Systems automatically support referential integrity, i.e. when you try to delete a tuple which has a reference (in the form of foreign key, for example), the ...
2
votes
1answer
77 views
Pattern for mobile app data synchronisation using HTTP over 3G networks
I have a mobile app built using jquerymobile, PhoneGap and some custom CSS and JavaScript. The data objects are received in JSON and used to display different forms to the user. For example
{ id: 1, ...
0
votes
1answer
93 views
Design patterns to avoiding breaking the SRP while performing heavy data logging
A class that performs both computations and data logging seems to have at least two responsibilities. Given a system for which the specifications require heavy data logging, what kind of design ...
3
votes
5answers
187 views
make-like build tools for data?
Make is a standard tools for building software. But
make decides whether a target needs to be regenerated by comparing file modification times.
Are there any proven, preferably small tools that ...
10
votes
7answers
546 views
Are there examples of non CRUD approaches?
I'm a programmer but also have worked as an archivist. As archivist it's a lot about keeping data.
I often get into arguments with colleagues when it comes to operations on data. I don't like the U ...
5
votes
4answers
324 views
Am I sending large amounts of data sensibly?
I am about to design a video conversion service, that is scalable on the conversion side.
The architecture is as follows:
Webpage for video upload
When done, a message gets sent out to one of ...
1
vote
3answers
145 views
Inter-process and inter-thread data sharing [closed]
I know that operating systems facilitate inter-process and inter-thread data sharing. I want to know about the mechanisms used to facilitate such sharing. I read about "pipes". What are the other ...
4
votes
1answer
85 views
Isolating test data in acceptance tests
I'm looking for guidance on how to keep my acceptance tests isolated. Right now the issue I'm having with being able to run the tests in parallel is the database records that are manipulated in the ...
-1
votes
3answers
143 views
I need some help creating a non-binary tree (or some other data structure that will better solve my problem)
I have about ten lists of numbers and some strings. Each list has about <= 30K lines. Each line on a list has a distinct number.
I need to build an efficient way of finding all the lines in each ...
1
vote
1answer
129 views
How to use OO for data analysis? [closed]
In which ways could object-orientation (OO) make my data analysis more efficient and let me reuse more of my code? The data analysis can be broken up into
get data (from db or csv or similar)
...
0
votes
2answers
164 views
Do I need to know databases like Oracle or SQL Server for a data analyst role? [closed]
I know only MySQL and do web application programming and Linux system administration. I have also started learning AI and machine learning.
I want to go into data analysis.
Do I need to know MS SQL ...
6
votes
4answers
216 views
Can data classes contain methods for validation?
OK, say I have a data class for a user:
public class User {
private String firstName;
private String lastName;
private long personCode;
private Date birthDate;
private Gender gender;
private String ...
-1
votes
2answers
141 views
Can non-IT people learn and take advantage of regular expressions? [closed]
Often times, not-IT people has to deal with massive text data, clean it, filter it, modify it. Often times normal office tools like Excel lack the tools to make complex search and replace operations ...
2
votes
1answer
57 views
Enforcing Constraints Upon Data Documents of Various Formats
This seems like the sort of problem that must have been solved elegantly long ago, but I haven't the foggiest how to google it and find it.
Suppose you're maintaining a large legacy system, which has ...
8
votes
5answers
366 views
What's the proper term for a function inverse to a constructor - to unwrap a value from a data type?
Edit: I'm rephrasing the question a bit. Apparently I caused some confusion because I didn't realize that the term destructor is used in OOP for something quite different - it's a function invoked ...
3
votes
1answer
162 views
Having a generic data type for a database table column, is it “good” practice?
I'm working on a PHP project where some object (class member) may contain different data type. For example :
class Property {
private $_id; // (PK)
private $_ref_id; // the object ...
9
votes
8answers
566 views
When does 'optimizing code' == 'structuring data'?
A recent article by ycombinator lists a comment with principles of a great programmer.
#7. Good programmer: I optimize code. Better programmer: I structure data. Best programmer: What's the ...
2
votes
3answers
119 views
Having two sets of infrequently changing data or converting on the fly
I am currently working on a small project in which I work with some "static data", which is extracted from one source. The data might change from time to time (up to once a week).
I don't need all of ...
0
votes
2answers
145 views
How should I track approval workflow when users at every security level can create a request?
I am writing a new application that allows users to enter requests.
Once a request is entered, it must follow an approval workflow to be finally approved by a user the highest security level.
So, ...
0
votes
2answers
863 views
Passing the data of a certain page to another page. Windows Phone 7
The user will fill out information in page 1, and the data will be seen in the other page listed in a listbox.
Is it advisable to use data binding?
I've been studying/researching about data binding ...
4
votes
1answer
157 views
Data service API design
We're designing a data service that will store a large number of statistics about stocks, including historical data. The client will be a web application, which will need to pull various bits of data ...
1
vote
1answer
126 views
Developing an analytics's system processing large amounts of data - where to start
Imagine you're writing some sort of Web Analytics system - you're recording raw page hits along with some extra things like tagging cookies etc and then producing stats such as
Which pages got most ...
2
votes
2answers
106 views
What is the best strategy for transforming unicode strings into filenames?
I have a bunch (thousands) of resources in an RDF/XML file. I am writing a certain subset of the resources to files -- one file for each, and I'm using the resource's title property as the file name. ...
1
vote
1answer
170 views
Countour Mapping API
I have done some searching on Google, but haven't come up with much as of yet. I am wanting to take a set of point data, which I had previously been using to create weighted points for a heat map ...
6
votes
5answers
1k views
Getting data from a webpage in a stable and efficient way
Recently I've learned that using a regex to parse the HTML of a website to get the data you need isn't the best course of action.
So my question is simple: What then, is the best / most efficient and ...
1
vote
2answers
256 views
Almost Realtime Data and Web application
I have a computer that is recording 100 different data points into an OPC server.
I've written a simple OPC client that can read all of this data.
I have a front-end website on a different network ...
0
votes
3answers
179 views
From where do financial firms obtain the stock data to analyze [closed]
I've been thinking about the subject and I've always wondered, from where do they obtain the data that is analized in applications, I've looked at Nasdaq's website and they do not seem to have any ...
0
votes
2answers
204 views
What companies hire data scientists? [closed]
What kind of data jobs are there in the software industry for someone with a B.S.
in pure mathematics and a minor in statistics but with little experience in programming?
I want to work on the data ...
0
votes
1answer
201 views
How to get a list of valid addresses?
I need to get a list of valid addresses in 4 or 5 clusters (cities) in both the UK and US. It's to generate sample data for an application that will do geolocation and searching. At the moment I'm ...
20
votes
6answers
2k views
Why the static data members have to be defined outside the class separately in C++ (unlike Java)?
class A {
static int foo () {} // ok
static int x; // <--- needed to be defined separately in .cpp file
};
I don't see a need of having A::x defined separately in a .cpp file (or same file ...
2
votes
4answers
121 views
Data migration to a single shared SQL table
We have three internal web applications we use at my company. Unfortunately none of my predecessors had the foresight of sharing tables amongst those apps.
It has become necessary to share some ...
2
votes
4answers
434 views
Data Structures usage and motivational aspects
For long student life I was always wondering why there are so many of them yet there seems to be lack of usage at all in many of them. The opinion didn't really change when I got a job.
We have ...
