dask

Repositories

• dask

  Parallel computing with task scheduling

  python numpy scikit-learn pydata pandas scipy dask
  Python BSD-3-Clause 1,207 7,798 644 (19 issues need help) 69 Updated Jan 24, 2021

• dask-jobqueue

  Deploy Dask on job schedulers like PBS, SLURM, and SGE

  python hpc distributed dask slurm-cluster sge-cluster pbs-cluster
  Python 87 144 48 (4 issues need help) 9 Updated Jan 24, 2021

• dask-mpi

  Deploy Dask using MPI4Py
  Python BSD-3-Clause 15 27 7 (1 issue needs help) 2 Updated Jan 24, 2021

• distributed

  A distributed task scheduler for Dask

  python pydata distributed-computing dask
  Python 506 1,136 604 (7 issues need help) 109 Updated Jan 24, 2021

• helm-chart

  Helm charts for Dask
  HTML 47 42 16 5 Updated Jan 23, 2021

• dask-docker

  Docker images for dask
  Jupyter Notebook BSD-3-Clause 112 130 14 3 Updated Jan 23, 2021

• dask-examples

  Easy-to-run example notebooks for Dask
  Jupyter Notebook CC-BY-SA-4.0 159 242 17 (2 issues need help) 10 Updated Jan 22, 2021

• gcsfs

  Pythonic file-system interface for Google Cloud Storage
  Python 63 156 53 4 Updated Jan 22, 2021

• fastparquet

  Forked from jcrobak/parquet-python

  python implementation of the parquet columnar file format.
  Python Apache-2.0 208 473 44 4 Updated Jan 22, 2021

• dask-image

  Distributed image processing
  Python BSD-3-Clause 28 108 41 7 Updated Jan 21, 2021

• dask-cloudprovider

  Cloud provider cluster managers for dask distributed
  Python BSD-3-Clause 43 59 53 (5 issues need help) 4 Updated Jan 20, 2021

• dask-gateway

  A multi-tenant server for securely deploying and managing Dask clusters.
  Python BSD-3-Clause 30 78 51 6 Updated Jan 19, 2021

• dask-kubernetes

  Native Kubernetes integration for dask
  Python BSD-3-Clause 61 201 38 (8 issues need help) 8 Updated Jan 19, 2021

• dask-lightgbm
  Python BSD-3-Clause 25 76 0 2 Updated Jan 17, 2021

• adlfs

  fsspec-compatible Azure Datake and Azure Blob Storage access
  Python 34 37 12 1 Updated Jan 15, 2021

• s3fs

  S3 Filesystem
  Python 131 374 42 4 Updated Jan 15, 2021

• dask-labextension

  JupyterLab extension for Dask
  Python BSD-3-Clause 33 203 23 (3 issues need help) 1 Updated Jan 15, 2021

• dask-tutorial

  Dask tutorial
  Jupyter Notebook 517 1,369 6 1 Updated Jan 14, 2021

• .github
  1 0 0 1 Updated Jan 11, 2021

• dask-ml

  Scalable Machine Learning with Dask
  Python BSD-3-Clause 185 684 161 (10 issues need help) 29 Updated Jan 11, 2021

• dask-stories
  Python 17 38 1 0 Updated Jan 6, 2021

• dask.github.io

  Dask Website
  HTML 11 5 3 2 Updated Dec 21, 2020

• dask-yarn

  Deploy dask on YARN clusters
  Python 25 49 19 1 Updated Nov 17, 2020

• partd

  Concurrent appendable key-value storage
  Python 21 82 2 1 Updated Nov 18, 2020

• zict

  Useful Mutable Mappings
  Python 14 42 2 1 Updated Nov 17, 2020

• cachey

  Caching based on computation time and storage space
  Python 19 104 7 1 Updated Nov 17, 2020

• dask-glm
  Python 34 71 25 11 Updated Nov 17, 2020

• dask-blog

  Dask development blog
  HTML 20 20 3 1 Updated Nov 14, 2020

• dask-gateway-helm-repo

  Repository holding published dask-gateway helm charts
  1 1 1 0 Updated Nov 5, 2020

• dask-ec2 Archived

  Start a cluster in EC2 for dask.distributed

  aws dask
  Python 35 104 24 2 Updated Nov 3, 2020