quantization

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

The next-generation platform to monitor and optimize your AI costs in one place 🚀

Lossy PNG compressor — pngquant command based on libimagequant library

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

[🔥updating ...] AI 自动量化交易机器人 Qbot is an AI-oriented quantitative investment platform, which aims to realize the potential, empower AI technologies in quantitative investment. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Faster Whisper transcription with CTranslate2

Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception, SqueezeNet)

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…

Inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

PaddleSlim is an open-source library for deep model compression and architecture search.

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

OpenMMLab Model Compression Toolbox and Benchmark.

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™

Fast inference engine for Transformer models