The distributed-computing tag has no wiki summary.
2
votes
1answer
104 views
Does map-reduce transmit the data and executable instructions?
When map-reduce divides a task and sends the data to each worker process, does it also transmit the instructions for how to operate on the data?
For example, let's say Google has some huge array of ...
0
votes
1answer
197 views
What is meant by Distributed Systems Coding interview questions
I was told that I will be asked coding questions in my interview and that the context will be related to Distributed Systems (I took ONE Distributed Systems course and I don't even remember much from ...
0
votes
1answer
52 views
Distributing cron-like tasks over multiple servers
Currently I'm using something like a master-cron server, which starts the tasks on the slave-worker servers.
But there are so many tasks, that the timing gets lost entirely.
Is there a an algorithm, ...
3
votes
1answer
130 views
Is it possible to modify Lamport's mutual exclusion algorithm to work without a FIFO guarantee?
I'm trying to implement a modified version of the Lamport Mutual Exclusion algorithm. The original algorithm assumes FIFO message ordering between connected systems, but I would like to use UDP a ...
-4
votes
0answers
79 views
what is the fastest way for two servers to talk [closed]
I am beginning to architect a new system. I'm going a bit different than my norm on this one as I am splitting services apart into different servers. One handles authentication, one handles ...
0
votes
0answers
104 views
STAF/STAX and python alternative
We are looking into replacing some homegrown pieces and the candidates are:
STAF (http://staf.sourceforge.net/)
anything mature in python
My colleague Kevin has looked into STAF so I am ...
2
votes
2answers
152 views
Open Source Cloud Computing
Recently I realized that the most popular social platforms on the net are in the hand of just a few companies, Google, Twitter, Facebook, to name just a few. Taking into account the world changing ...
2
votes
0answers
65 views
Open Grid Engine or Akka/Something more fault tolerant?
My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages.
The ...
1
vote
1answer
148 views
Building a Redundant / Distributed Application
This is more of a "point me in the right direction" question.
My team of three and I have built a hosted web app that queues and routes customer chat requests to available customer service agents (It ...
3
votes
2answers
1k views
Amazon Interview Question — Design a load balancer to keep track of hostnames
Imagine you have a distributed system where requests go through a load balancer which is effectively a switch. Machines are connected to the load balancer and requests are passed on to them with some ...
5
votes
1answer
41 views
Is there any technology for dynamic assignment of execution context for programs that target many platforms with widely varying runtime performance?
This may very well be nothing new and probably exists, but I've never learned about it and would like to.
The simplest way to be more specific is just to give an example.
I was on the bus and ...
1
vote
2answers
86 views
Exclusive use of a Jini server during long-running call
I'm trying to use Jini, in a "Masters/Workers" arrangement, but the Worker jobs may be long running. In addition, each worker needs to have exclusive access to a singleton resource on that machine.
...
1
vote
3answers
336 views
Can an issue tracking system be distributed?
I was thinking about issue tracking software like Redmine, Trac or even the one that is in Fossil and something hit me:
Is there a reason why Redmine and Trac are not possible to be distributed?
Or ...
0
votes
1answer
62 views
Question for Enterprise control language(HPCC) [closed]
does anyone got some idea about ECL which is Enterprise control language used in HPCC(high performance cluster computing) used for distributed computing? i got some problem and not getting any answer ...
0
votes
2answers
369 views
why are transaction monitors on decline? or are they?
http://www.itjobswatch.co.uk/jobs/uk/cics.do
http://www.itjobswatch.co.uk/jobs/uk/tuxedo.do
Look at the demand for programmers (% of job ads that the keyword appears), first graph under the table. ...
3
votes
3answers
159 views
How to rewrite a TCP MMOG server designed to run in a single machine, in a distributed way?
I have a MMOG server running on C++, using winsockets. My server won't support more than 200 players. I had the idea of redesigning it so it will use multiple servers instead of one, so, maybe, for ...
2
votes
3answers
353 views
Synchronizing local and remote cache in distributed caching
With a distributed cache, a subset of the cache is kept locally while the rest is held remotely.
In a get operation, if the entry is not available locally, the remote cache will be used and and the ...
2
votes
1answer
55 views
Any reference doc /model/ implementation of enforcing events dependency/ordering in distributed computing?
For example, Process P is listening to events E(A) and E(B), but to process either of the events, P needs the other event available too. Naively, when P receives either of the events, it will check if ...
0
votes
1answer
547 views
Suggestions for final year project (something in cloud) [closed]
I'm interested in cloud and distributed computing. I recently heard about Apache Hadoop. Also checked HBase, Hive, Cloudera and other extensions. Can i take any of these topic, extend it further for ...
7
votes
3answers
248 views
Optimistic work sharing on sparsely distributed systems
What would a system like BOINC look like if it were written today?
At the time BOINC was written, databases were the primary choice for maintaining a shared state and concurrency among nodes.
Since ...
5
votes
3answers
833 views
Good books to learn distributed computing
Are there any good books to learn about distributed computing ? I work on large scale java applications. Recently my colleagues started talking about things like distributed cache, load balancing, ...
13
votes
8answers
637 views
What exactly is distributed computing?
So I'm a senior in college and a couple of weeks ago, I interviewed at Microsoft for an entry-level SDE position. While most of the interviews (out of the total 7) were on the general principles of ...
2
votes
2answers
257 views
Scalable distributed file system for blobs like images and other documents
Cassandra & HBase both do not efficiently support storage of blobs like images. Storing directly on HDFS stresses the Namenode because of huge number of files. Facebook uses Haystack for images ...
5
votes
4answers
290 views
How to effectively (but minimally) *simulate* a distributed computing environment?
I am doing some personal research on Byzantine Faults. I am trying out algorithms from various research papers which present algorithms for consensus in distributed systems like this one. For this i ...
4
votes
2answers
293 views
How to implement a lightweight clustered architecture for a distributed application
I currently have a distributed application that runs on multiple embedded PCs. The whole application is composed of one master server and several nodes. Each node is an embedded PC that runs Windows 7 ...
2
votes
3answers
207 views
Promoting scalability in small business applications
I am part of a small software company that specializes in small to medium-sized business applications and my experience with distributed architectures/SOA is limited. Please let me know if I'm going ...
3
votes
1answer
126 views
List of good (and freely available) papers on distributed systems [closed]
I was wondering if any body could point me to some relevant papers on designing distributed systems. I am looking for literature in the league of Amazon's Dynamo paper and Google's MapReduce.
I am ...
9
votes
3answers
299 views
Is there a canonical book on distributing computing in Java?
I have spent the last 2-1/2 years building a distributed application. We started testing it a couple months ago and we're moving it into production. Everything runs fairly well, but it could ...
0
votes
1answer
182 views
I need help understanding what the goal of my project is, and what some possible implementation options are
I am tasked with deploying the Java Pet Store in a distributed system, using two or three computers. However, I am not sure how to do this. Suppose I wanted to just add RMI functionality so one system ...
2
votes
1answer
234 views
Client–server models and Client-centric models
For distributed applications, emphasis mine:
Where classic software systems of the past century were mostly based
on Client–server models and Client-centric application development,
both ...
1
vote
3answers
211 views
Does the new field of “Autonomic Computing” strike you as an achievable goal with current computing power?
Autonomic Computing is mainly studied in academia. IBM does have a fairly advanced DB2 system with fail-safe capability. What do you think is the main challenge with Autonomic Computing? And what PL ...
1
vote
1answer
90 views
How do you control nodes in a server farm?
I've been reading about hadoop and multi-node setups, and it says in the documentation that you must have a JVM and hadoop software already running on those nodes.
My question is, do people install ...
2
votes
6answers
136 views
Distributed/Network application development that is user focused but NOT web application development
I was curious, what other architectures exist for business or user focused development that aren't written using web applications. Are these architectures used today?
If you are or were in the ...
5
votes
4answers
506 views
How do I get into a career in distributed systems?
I am enamored by reliable distributed systems and want to spend my career improving them rather than merely using them to write the same CRUD applications over and over.
What experience will convince ...
3
votes
3answers
362 views
Making a virtual supercomputer with distributed P2P computing
I was just having this idea once and wondering if there's any possibility to harness the power of p2p distributed computing to make a virtual supercomputer with the following features:
Works like a ...
1
vote
1answer
116 views
PGAS Systems in the wild [closed]
Has anyone had any experiences with developing a Partitioned Global Address Space product or system, or an application that used PGAS, or anything PGAS-like? I'm looking for insights, warstories, and ...
2
votes
2answers
491 views
cloud computing certification
I have been working in java for 3+ years and I would like to be certified in Cloud Computing. Like Sun Java certification, do we have one standard recognition that provides cloud computing ...
1
vote
1answer
376 views
Research paper on distributed computing - Advice?
I am writing my first research paper on distributed storage systems. We also have a prototype working (partially). The project was a complete implementation based project where we envisage to take ...
5
votes
1answer
282 views
Gossip protocol in a Ring topology
I am implementing a gossip based membership detection mechanism. Lets say we have a ring topology, i.e. node1 only knows about the 2 nodes (node4 and node2) around it.
node1
...
9
votes
1answer
1k views
What are the solutions to the Distributed Queue problem?
I am trying to learn more about the various ways that the problem of a Distributed Queue may be solved. So I would like know what products, services, implementations and research papers that are ...
7
votes
3answers
1k views
MapReduce explained with diagrams?
I'm searching for an explanation of how MapReduce works with visuals. Specifically, a flow chart of actions and pictures of how it deals with information on the stack/memory in parallel to return.
...
