gpt

The Reliable USB Formatting Utility

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

LightSeq: A High Performance Library for Sequence Processing and Generation

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Transformer related optimization, including BERT, GPT

🦄 State-of-the-Art Conversational AI with Transfer Learning

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型集合

🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models

Modern, advanced, portable, multiprotocol bootloader.

💽 Build Bespoke OS Images

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

RWKV is a RNN with transformer-level performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

Super UEFIinSecureBoot Disk: Boot any OS or .efi file without disabling UEFI Secure Boot

embiggden-disk live-resizes a filesystem after first live-resizing any necessary layers below it: an optional LVM LV and PV, and an MBR or GPT partition table

An easy to use Natural Language Processing library and framework for predicting, training, fine-tuning, and serving up state-of-the-art NLP models.