distributed-training

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Fast and flexible AutoML with learning guarantees.

A high performance and generic framework for distributed DNN training

FedML - The federated learning and analytics library enabling secure and collaborative machine learning on decentralized data anywhere at any scale. Supporting large-scale cross-silo federated learning, cross-device federated learning on smartphones/IoTs, and research simulation. MLOps and App Marketplace are also enabled (https://open.fedml.ai).

Determined: Deep Learning Training Platform

Library for Fast and Flexible Human Pose Estimation

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

Training and serving large-scale neural networks

DeepRec is a recommendation engine based on TensorFlow.

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文认知智能的基础设施。

Resource-adaptive cluster scheduler for deep learning training.

Fast and Adaptive Distributed Machine Learning for TensorFlow, PyTorch and MindSpore.

Distributed Deep Learning on AWS Using CloudFormation (CFN), MXNet and TensorFlow

HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.

How to use Cross Replica / Synchronized Batchnorm in Pytorch

A full pipeline AutoML tool for tabular data

YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud (ECCV 2018)

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training

Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)