Pinned

1. Chinese-LLaMA-Alpaca Public

   中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

   Python 12k 1.3k

2. Chinese-BERT-wwm Public

   Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

   Python 8.5k 1.3k

3. LERT Public

   LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）

   Python 153 11

4. MacBERT Public

   Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

   530 50

5. airaria/TextBrewer Public

   A PyTorch-based knowledge distillation toolkit for natural language processing

   Python 1.4k 229

6. PERT Public

   PERT: Pre-training BERT with Permuted Language Model

   303 22