An Automatic Model Compression (AutoMC) framework for developing smaller and faster AI applications.

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

NLP DNN Toolkit - Building Your NLP DNN Models Like Playing Lego

[CVPR2020] GhostNet: More Features from Cheap Operations

model compression and deploy. compression: 1、quantization: quantization-aware-training, 16/8/4/2-bit(dorefa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、ternary/binary value(twn/bnn/xnor-net); post-training-quantization, 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization folding for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

Channel Pruning for Accelerating Very Deep Neural Networks (ICCV'17)

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

A curated list of neural network pruning resources.

A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2020)。

A list of high-quality (newest) AutoML works and lightweight models including 1.) Neural Architecture Search, 2.) Lightweight Structures, 3.) Model Compression, Quantization and Acceleration, 4.) Hyperparameter Optimization, 5.) Automated Feature Engineering.

Lightweight and Scalable framework that combines mainstream algorithms of Click-Through-Rate prediction based computational DAG, philosophy of Parameter Server and Ring-AllReduce collective communication.

PaddleSlim is an open-source library for deep model compression and architecture search.

[CVPR2020] GhostNet: More Features from Cheap Operations

knowledge distillation papers

Pytorch implementation of various Knowledge Distillation (KD) methods.

Data Efficient Model Compression

Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration (CVPR 2019 Oral)

Papers for deep neural network compression and acceleration

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks

Infrastructures™ for Machine Learning Training/Inference in Production.

Deep Face Model Compression

Java interface for fastText

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

PyTorch Implementation of Weights Pruning

Model Compression CLI Tool for Keras.

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Awesome machine learning model compression research papers, tools, and learning material.