Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.
3
votes
2answers
66 views
Scalability of using environment variables
I just moved into the Ruby on Rails world and with it I am being introduced to much more liberal use of environment variables than what I have been exposed to in the past. Specifically, it appears ...
2
votes
1answer
199 views
PHP high traffic default page
I have a php website that will be experiencing high levels of traffic in a few weeks. We scaled the servers to accept the traffic, but want some sort of fallback page in the event that something ...
3
votes
2answers
139 views
Handling multiple clients using single application
We are developing an ERP web application using Vaadin framework where each of the potential client companies will have their own data and file storage. Current implementation only allows having one ...
-4
votes
1answer
251 views
Is there any “Set” database? [closed]
Is there any "set" database? For example Neo4j is a "graph" database. What I'm looking for is database which can be used to organize "items" into "sets" and then be able to query them with set ...
3
votes
3answers
266 views
Is the database the bottleneck or not? High Scalability talk
I found an interesting article on high scalability web site where it talks about EBay scalability and especially a specific passage struck me:
"(Ebay strategies)...Move work out of the database ...
10
votes
1answer
256 views
How much does the data model affect scalability and performance in so called “NoSQL” database?
You can't ever have a talk about so called "NoSQL" database without bringing the CAP theorem (Consistency, Availability, Partition : pick two). If you have to pick say, between MongoDB (Partition, ...
6
votes
6answers
227 views
When to start thinking about scalability?
I'm having a funny but also terrible problem. I'm about to launch a new (iPhone) app. It's a turn-based multiplayer game running on my own custom backend. But I'm afraid to launch.
For some reason, I ...
0
votes
3answers
304 views
Creating an email notification system based on polling database rows
I have to design an email notification system based on the following requirements:
The email notifications would be created based on polling rows in a Mysql 5.5 DB table when they are in a ...
0
votes
0answers
61 views
Is OpenStack suitable as a fault tolerant DB host?
I am trying to design a fault tolerant DB cluster (schema does not matter) that would not require much maintenance. After looking at almost everything from MySQL to MongoDB to HBase I still find that ...
0
votes
0answers
47 views
How to implement a distributed proxy with quotas?
I'm in the process of developing a scalable proxy (Linux/C/C++, Nginx modules or custom HTTP server) handling incoming HTTP requests, and re-routing them to others locations based on parameters ...
4
votes
1answer
435 views
Is Node.js correct choice for JSON parsing and IO driven
My program should perform following task:
It listen on http port after getting request it does following things.
Connect to gearman
Parse gearman payload to JSON (Upto 100 bytes)
Connect to Redis ...
4
votes
1answer
469 views
Designing an scalable message queue architecture
I have recently started learning the nuances of scalable and enterprise computer architecture, and one of the central components is a messaging queue. In order to learn the most I can from any ...
8
votes
2answers
428 views
Is this solution RESTful and secure?
Our product registers new players on our service, and we've chosen to host it on Azure (we're using .NET) and we wanted it to be stateless (for scalability) and relatively secure.
Since this is the ...
-1
votes
1answer
524 views
How do you write scalable Java? [duplicate]
I like to think I write good maintainable Java code, using best practices, design patterns and try and get good test coverage with unit tests.
Recently whilst looking for a job, I came across a ...
3
votes
1answer
303 views
Thinking pragmatically about scalability
I was recently asked as an exercise to design a scalable graph.
My first intuition was how to seperate the graph and distribute it (sharding,consistent hashing..etc)
Turns out my thinking was on ...
4
votes
4answers
2k views
why are noSQL databases more scalable than SQL? [duplicate]
Recently I read a lot about noSQL DBMSs. I understand CAP theorem, ACID rules, BASE rules and the basic theory. But didn't find any resources on why is noSQL scalable more easily than RDBMS (e.g. in ...
2
votes
4answers
232 views
How concerned about load balancing do I need to be?
I'm currently working on a project which will have client applications (desktop & android & web) communicate with varies processes running on a server(s).
My question is how much should I be ...
2
votes
2answers
387 views
Why OTServs have an item cloning problem if the server crashes? [closed]
OTServs are open source MMORPGs with a huge community. Mostly all of them have a serious problem: if the server crashes, people can clone items. This is a dirty trick that can be executed because the ...
-1
votes
1answer
181 views
What are techniques used to make scalable, fast databases? [duplicate]
I'm studying the differences between NoSQL and SQL. If I understood correctly, there are two main techniques to optimize a database:
Indexing rows. Say you wanted to make a query such as WHERE x = 1 ...
1
vote
1answer
583 views
Is map-reduce the basic factor that makes NoSQL more scalable than SQL?
I'm studying the differences between NoSQL and SQL, and what makes the first more scalable. I think I got the point, so I'll try to explain:
Suppose an app has a list of billions of users, each with ...
19
votes
4answers
791 views
Is BDD scalable for medium to large projects?
In every Website you read about BDD (Behaviour Driven Development) you find a very simple nice example showing you how obvious and easy is it to define your requirements. But trying to implement this ...
4
votes
1answer
405 views
How can I scale spring application context?
I'm currently working on a project that need to be dynamically scaled on demand according to the need.
My question is about scaling spring context. My web application has a classical multi module ...
2
votes
2answers
1k views
How to design a scalable notification system? [closed]
I need to write a notification system manager.
Here is my requirements:
I need to be able to send a Notification on different platforms, which may be totally different (for exemple, I need to be ...
2
votes
0answers
103 views
Open Grid Engine or Akka/Something more fault tolerant?
My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages.
The ...
3
votes
3answers
382 views
Splitting big request in multiple small ajax requests
I am unsure regarding the scalability of the following model. I have no experience at all with large systems, big number of requests and so on but I'm trying to build some features considering ...
2
votes
2answers
196 views
How can I distribute a unique database already in production?
Let's assume a successful web Spring application running on a MySQL or PostgreSQL database. The traffic is becoming so high and the amount of data is becoming so big that a distributed database ...
10
votes
3answers
6k views
Why would more CPU cores on virtual machine slow compile times?
[edit#2] If anyone from VMWare can hit me up with a copy of VMWare Fusion, I'd be more than happy to do the same as a VirtualBox vs VMWare comparison. Somehow I suspect the VMWare hypervisor will be ...
14
votes
3answers
3k views
How to design highly scalable web services in Java?
I am creating some Web Services that would have 2000 concurrent users. The services are offered for free and are hence expected to get a large user base. In the future it may be required to scale up ...
1
vote
2answers
316 views
Centrally managing 100+ websites without bankrupting a small company [closed]
I'm mainly interested in opinions on the trade-offs between having a single central server all the websites connect to as opposed to each website mirroring a subset of the master database with all the ...
8
votes
4answers
585 views
scalablity of Scala over Java
I read an article that says Scala handles concurrency better than Java.
http://www.theserverside.com/feature/Solving-the-Scalability-Paradox-with-Scala-Clojure-and-Groovy
...the scalability ...
1
vote
2answers
94 views
How to handle file access transactions properly?
I'm looking for good practices or any advice regarding file access transaction mechanisms. We will have multiple instances of an application spread over a redundant network (cloud) watching a ...
3
votes
3answers
773 views
A Huge Database: Picking the right schema and data model
We want to store some genomic variant data but there are some problems, more important ones like problem of the data's immense size and variability.
Variant data can be huge. For example, a single ...
3
votes
5answers
726 views
Structuring database for multi-object “activity” and “following” functionalities
I am working on a web application which operate with different types of objects such as user, profiles, pages etc. All objects have unique object_id.
When objects interact it may produce "activity", ...
1
vote
2answers
188 views
Proper way to measure the scalability of web Application
Let's say that I have a web Application where i'm going to have 300 users and each one have to see data on real time, imagine that each client make an ajax call to the server to see in real time ...
3
votes
4answers
680 views
Scaling Scrum within a group of 100s of programmers
Most Scrum teams lean toward 7-15 people **, though it's not clear how to scale Scrum among 100s of people, or how the effectiveness of a given team might be compared to another team within the group; ...
1
vote
4answers
634 views
What are some good tips for a developer trying to design a scalable MySQL database?
As the question states, I am a developer, not a DBA. I have experience with designing good ER schemas and am fairly knowledgeable about normalization and good schema design. I have also worked with ...
3
votes
4answers
1k views
JSF for an internet facing, high traffic web application
I, perhaps, made a wrong choice of going with a Component-based Framework like JSF for an internet facing, high traffic web application.
Development with JSF has although been easier but what I fear ...
7
votes
5answers
480 views
Most common website scalability pitfalls
We are designing a website/web application where we hope to to achieve high user counts and, in general, lots of use. More specifically, we intend to be using PHP as the programming/scripting language ...
2
votes
2answers
262 views
Dealing with large amounts of web service requests and storing that data
I have a desktop application that sends a POST request to my website every 5 minutes. This post request can contain a variable amount of data about the PC sending the request, but typically it ...
4
votes
1answer
709 views
How is Scala scalable? [duplicate]
Possible Duplicate:
Why is Scala more scalable than other languages?
The Wikipedia page on Scala says:
The name Scala is a portmanteau of "scalable" and "language", signifying that it ...
4
votes
3answers
229 views
What is “Scalable Integrated Systems”?
I've come across a job posting that asks for experience with "Scalable Integrated Systems", but honestly that sounds like "generic buzzword," and I'm trying to figure out what the actual work behind ...
5
votes
3answers
375 views
Work load balance/Task distribution algorithm
I'm looking for an algorithm to either use or as a jump point for load balancing.
Environment:
We have ~7 job types that can be scheduled at any time by our users. Some jobs are fast, others are ...
3
votes
3answers
121 views
migrating product and team from startup race to quality development [duplicate]
Possible Duplicate:
A simple ways to improve the release quality in RAD environment
This is year 3 and product is selling good enough. Now we need to enforce good software development ...
7
votes
1answer
431 views
How can I gather client's data on Google App Engine without using Datastore/Backend Instances too much?
One of the projects I'm working on is online survey engine. It's my first big commercial project on Google App Engine.
I need your advice on how to collect stats and efficiently record them in ...
5
votes
4answers
1k views
Why scalability issues cannot be solved by more servers ?
I know that big websites suffer from scalability issues and I guess that more servers (hardware) can help to handle scalabililty issues but I see that big websites are stuck about scalability even if ...
16
votes
2answers
5k views
Does Node.js actually increase scalability?
I've been reading about the C10K Problem, and of particular note is the part that refers to asynchronous server I/O. http://www.kegel.com/c10k.html#aio
I believe this pretty much summarises what ...
2
votes
3answers
1k views
Are there any non-blocking web servers for Java?
I was studying about the infrastructure being used by Facebook, as I was developing a website based on social interaction for a university project.
Facebook is using Tornado Web Server as its ...
5
votes
2answers
160 views
Storing stop/start points in a database
Let's say I am storing start and stop points per user into a database table.
For example... let's say in a chat system, a user only needs to see lines 24-293, and 500-512. (Let's say he logged off ...
4
votes
3answers
234 views
Developing scalable applications using Agile methods
Maybe someone can share from his experience about developing an application that is meant to scale big time where just throwing more money at better hardware isn't a realistic option using development ...
13
votes
8answers
2k views
What is the best way to design a web site to be highly scalable?
For websites that need to be highly scalable, such as social networks like facebook, what's the best way to design the website?
Should I have a web service which the site queries to get data that it ...
