Tagged Questions
0
votes
2answers
57 views
Clustering Algorithm (in Python) for Data
I have thousands of data entries that looks similar to the following:
08 00 00 00 c3 85 20 65 6e 61 62 6c 65 64 2e 0d 0a 45 78 70
5c 72 88 74 80 83 82 79 68 8d 7b 73 90 7c 60 84 80 74 00 00
5d 77 84 ...
0
votes
2answers
174 views
Clustering Based On Distance Matrix
My objective is to cluster words based on how similar they are with respect to a corpus of text documents. I have computed Jaccard Similarity between every pair of words. In other words, I have a ...
-1
votes
4answers
46 views
Declare a list of user defined class in python
I have:
class Cluster:
# some attributes
c = Cluster()
where c should be an list of type Cluster()
Can be be done something like c= Cluster[] ?
I am a beginner at python.
0
votes
1answer
40 views
qsub python import
I'm running a job on the cluster for the first time. I run it with the following command:
qsub -cwd -S /usr/bin/python myScript.py
I have a python script that starts with:
import time
import ...
0
votes
0answers
73 views
Failed to update the root certificat : cacert.pem
I use devstack to install openstack now, but unfortunately, i met a problem:
/home/my/devstack/tools/create_userrc.sh -PA --target-dir /home/my/devstack/accrc
ERROR: The server has either erred or is ...
0
votes
1answer
37 views
Cluster job scheduler: tools
we are trying to solve a problem related to cluster job scheduler.
The problem is the following we have a set of python scripts which are executed in a cluster, the launching process is currently ...
0
votes
1answer
72 views
Are all cluster computing libraries compatible with starcluster?
I have a highly threaded application running on amazon EC2. I would to convert this application to a cluster on EC2. I would like to use starcluster for this as its easy to manage the cluster.
...
0
votes
1answer
114 views
“Global array” parallel programming on distributed memory clusters with python
I am looking for a python library which extends the functionality of numpy to operations on a distributed memory cluster: i.e. "a parallel programming model in which the programmer views an array as a ...
0
votes
1answer
74 views
Handling various resource requirements in an IPython cluster
I am using a PBS-based cluster and running IPython parallel over a set of nodes, each with either 24 or 32 cores and memory ranging from 24G to 72G; this heterogeneity is due to our cluster having ...
2
votes
1answer
300 views
How fast can one submit consecutive and independent jobs with qsub?
This question is related to pbs job no output when busy. i.e Some of the jobs I submit produce no output when PBS/Torque is 'busy'. I imagine that it is busier when many jobs are being submitted one ...
2
votes
3answers
641 views
parallel python, or MPI?
I have a code with heavy symbolic calculations (many multiple symbolic integrals). Also I have access to both an 8-core cpu computer (with 18 GB RAM) and a small 32 cpu cluster. I prefer to remain on ...
0
votes
1answer
155 views
K-Means plus plus implementation [closed]
My score was to get the most frequent color in a image, so I implemented a k-means algorithm.
The algorithm works good, but the result is not the one I was waiting for.
So now I'm trying to do some ...
1
vote
1answer
63 views
Python Popen and communicate result in OSError related to memory allocation?
I am submitting jobs to a queue on a cluster and want to check if the job is done. The way I do it is to see if the jobID is present in the output of a command (called jobs) that lists all the jobs ...
0
votes
1answer
166 views
How to structure code that distributes jobs to threads/nodes in Python?
I have python code that takes a bunch of tasks and distributes them to either different threads or different nodes on a cluster. I always end up writing a main script driver.py, that takes two command ...
0
votes
1answer
248 views
Cluster qsub check when job is done. python
I'm building a python pipeline and in that pipeline script I call for another python script which uses qsub to submit a job to a cluster (this job consist op 70 jobs)
Now I need the output of those ...
