Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

Modin: Scale your Pandas workflows by changing a single line of code

A hyperparameter optimization framework

Redis-based components for Scrapy.

💖 High available distributed ip proxy pool, powerd by Scrapy and Redis

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Lingvo

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Fast job queuing and RPC in python with asyncio and redis.

Official Implementation of 'Fast AutoAugment' in PyTorch.

MLBox is a powerful Automated Machine Learning python library.

[unmaintained] An open-source convolutional neural networks platform for research in medical image analysis and image-guided therapy

High-Performance Symbolic Regression in Python and Julia

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Representations of Code"

Open source SQL engine in Python

Advanced evolutionary computation library built directly on top of PyTorch, created at NNAISENSE.

Redis for humans. 🌎🌍🌏

Bagua Speeds up PyTorch