EleutherAI

gpt-neox Public
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

Python 1,593 Apache-2.0 174 30 (1 issue needs help) 13 Updated Feb 12, 2022
lm-evaluation-harness Public
A framework for few-shot evaluation of autoregressive language models.

Python 184 MIT 60 63 (9 issues need help) 9 Updated Feb 11, 2022
DeeperSpeed Public
DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Python 46 MIT 717 0 3 Updated Feb 11, 2022
magiCARP Public
One stop shop for all things carp

Python 11 GPL-3.0 2 3 2 Updated Feb 11, 2022
gpt-neo Public
An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Python 6,117 MIT 496 12 4 Updated Feb 10, 2022
DALLE-mtf Public
Open-AI's DALL-E for large scale training in mesh-tensorflow.

Python 376 MIT 41 2 3 Updated Feb 10, 2022
project-menu Public
See the issue board for the current status of active and prospective projects!

34 3 29 (9 issues need help) 0 Updated Feb 9, 2022
knowledge-neurons Public
A library for finding knowledge neurons in pretrained transformer models.

Python 72 MIT 7 1 0 Updated Feb 9, 2022
pyfra Public
Python Research Framework

Python 91 MIT 9 10 0 Updated Feb 9, 2022
cheese Public
Used for adaptive human in the loop evaluation of language and embedding models.

0 MIT 1 0 2 Updated Feb 9, 2022

Pinned