Tagged Questions
1
vote
0answers
14 views
How to parallelise scipy sparse matrix multiplication
I have a large sparse matrix X in scipy.sparse.csr_matrix format and I would like to multiply this by a numpy array W making use of parallelism. After some research I discovered I need to use Array in ...
0
votes
0answers
20 views
Chaining Multiple Map-Reduce jobs using Mincemeat.py
I am trying to work out a large program using Map-Reduce framework which needs the entire process be split into three Map-Reduce jobs which should happen sequentially.
I am using mincemeat.py because ...
1
vote
0answers
34 views
CPU and GPU operations parallelization
I have an application that has 3 main functionalities which are running sequentially at the moment:
1) Loading data to memory and perform preprocesssing on it.
2) Perform some computations on the ...
5
votes
4answers
119 views
Which C++ libraries should I use for a large parallel computing number-crunching project exploiting third-party applications
Introduction
I want to request a lot of advice on a new programming project I am going to start on my own. I am going to be very precise in what I would like to accomplish and in what my basic ...
3
votes
1answer
38 views
Python: How split a string keyspace (id) for parallel processing of data in a mongoDB
Intro
I have a mongo cluster with several million documents in it. Each document have a string id that looks like this:
00072312e0761c6554c3606b50a21119773f2f7d
And I have a way of retrieving from ...
2
votes
1answer
36 views
Byte limit when transferring Python objects between Processes using a Pipe?
I have a custom simulator (for biology) running on a 64-bit Linux (kernel
version 2.6.28.4) machine using a 64-bit Python 3.3.0 CPython interpreter.
Because the simulator depends on many independent ...
0
votes
1answer
60 views
Combining CUDA with Python's ODEInt and Parallel Reduction
I'm a graduate student in biophysics, trying to program a protein aggregation model using PyCUDA and Scipy's ODEInt. Within the past two weeks, I've gotten the code running, but it's very slow. Let ...
cuda
0
votes
3answers
60 views
Parallelize a list consolidation in Python
I have a sorted list of "box definitions" that I would like to consolidate. The list looks something like:
big_list = [\
# ...
# ...
[3, 4, 5, 4, 5, 6, 65],\
[3, 4, 5, 4, 5, 6, 60],\
[3, 4, 5, 4, 5, ...
0
votes
0answers
36 views
why error when searching for nodes in parallel python?
I really need some help so please answer. I installed pp on my laptop an on my virtual machine both use ubuntu.
i can ssh to the virtual machine so the connection to it is fine but still i am not able ...
0
votes
0answers
32 views
Parallelized copying of Python objects
We have 100 large Python objects in memory (each object is mix of dictionaries, Python standard values (e.g., integers), NumPy objects, Python classes), and we need to copy the most of them "by ...
-2
votes
0answers
30 views
default connection information for ipython parallel computing?
I am looking at this one: http://ipython.org/ipython-doc/stable/parallel/parallel_multiengine.html
, which "assumes that the default connection information (stored in ipcontroller-client.json found in ...
0
votes
0answers
11 views
Parallel nosetests with test generators
I'm trying to get my tests to run in parallel with nosetests --processes=2, however I have several generated tests. These seem to error with
Failure: TypeError (Can't make a test from <module ...
3
votes
2answers
173 views
Little hardcore: Do you know any parallel modified moving average algorithm?
Do you know any parallel modified moving average algorithm?
I want quickly calculate moving average but not with sequential algorithms. I want use parallel algorithms but I have still not found ...
0
votes
1answer
45 views
how do I parallelize a simple python def with multiple argument [duplicate]
I would like to parallelize a python script. I've create a definition:
def dummy(list1,list2):
do usefull calculations ...
The list1 and list2 contain a list of files name that I should read and ...
5
votes
1answer
135 views
Parallelism in Julia. Features and Limitations
In their arXiv paper, the original authors of Julia mention the following:
2.14 Parallelism.
Parallel execution is provided by a message-based multi-processing system implemented in Julia in ...
