#

transformers

Here are 874 public repositories matching this topic...

lucidrains / vit-pytorch

Star

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

computer-vision transformers artificial-intelligence image-classification attention-mechanism

Updated Oct 6, 2021
Python

EleutherAI / gpt-neo

Star

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

transformers gpt language-model gpt-2 gpt-3

Updated Oct 6, 2021
Python

annotated_deep_learning_paper_implementations

labmlai / annotated_deep_learning_paper_implementations

Star

🧑‍🏫 47 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

machine-learning reinforcement-learning deep-learning transformers pytorch transformer gan neural-networks deep-learning-tutorial optimizers

Updated Oct 9, 2021
Jupyter Notebook

tokenizers

huggingface / tokenizers

Star

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

nlp natural-language-processing transformers gpt language-model bert natural-language-understanding

Updated Oct 7, 2021
Rust

lucidrains / deep-daze

Star

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

deep-learning transformers artificial-intelligence siren text-to-image multi-modality implicit-neural-representation

Updated Sep 12, 2021
Python

lucidrains / DALLE-pytorch

Star

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

deep-learning transformers artificial-intelligence multi-modal attention-mechanism text-to-image

Updated Sep 29, 2021
Python

speechbrain / speechbrain

Star

A PyTorch-based Speech Toolkit

audio transformers pytorch voice-recognition speech-recognition speech-to-text language-model speaker-recognition speaker-verification speech-processing audio-processing asr speaker-diarization speechrecognition speech-separation speech-enhancement spoken-language-understanding huggingface speech-toolkit speechbrain

Updated Oct 13, 2021
Python

bentrevett / pytorch-sentiment-analysis

Star

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

nlp natural-language-processing tutorial sentiment-analysis word-embeddings transformers cnn pytorch recurrent-neural-networks lstm rnn fasttext bert sentiment-classification pytorch-tutorial pytorch-tutorials cnn-text-classification lstm-sentiment-analysis pytorch-nlp torchtext

Updated Jul 15, 2021
Jupyter Notebook

nlp-architect

IntelLabs / nlp-architect

Star

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

nlp deep-learning tensorflow nlu transformers pytorch deeplearning quantization bert dynet

Updated Sep 12, 2021
Python

simpletransformers

ThilinaRajapakse / simpletransformers

Star

Transformers for Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

text-classification transformers named-entity-recognition question-answering conversational-ai

Updated Oct 4, 2021
Python

spark-nlp

JohnSnowLabs / spark-nlp

Star

State of the Art Natural Language Processing

nlp natural-language-processing spark sentiment-analysis text-classification tensorflow machine-translation transformers language-detection pyspark named-entity-recognition seq2seq lemmatizer spell-checker albert bert part-of-speech-tagger entity-extraction spark-ml xlnet

Updated Oct 13, 2021
Scala

CLUEbenchmark / CLUE

Star

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

Updated Oct 13, 2021
Python

salesforce / TransmogrifAI

Star

Open

Improve test coverage for transformers & estimators

4

tovbinm commented Apr 11, 2019

Problem
Some of our transformers & estimators are not thoroughly tested or not tested at all.

Solution
Use OpTransformerSpec and OpEstimatorSpec base test specs to provide tests for all existing transformers & estimators.

Read more

enhancement good first issue

Open

Geolocation to Country transformer

8

Open

Allow adding/getting metadata on the model level

8

Find more good first issues

fast-bert

utterworks / fast-bert

Star

Super easy library for BERT based NLP models

transformers fastai bert fast-bert

Updated Sep 23, 2021
Python

lucidrains / reformer-pytorch

Star

Reformer, the efficient Transformer, in Pytorch

machine-learning transformers pytorch artificial-intelligence attention-mechanism

Updated Aug 25, 2021
Python

BERTopic

MaartenGr / BERTopic

Star

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

nlp machine-learning topic transformers topic-modeling bert topic-models sentence-embeddings topic-modelling ldavis

Updated Oct 13, 2021
Python

nyu-mll / jiant

Star

jiant is an nlp toolkit

nlp transformers transfer-learning bert multitask-learning sentence-representation

Updated Jul 26, 2021
Python

combust / mleap

Star

MLeap: Deploy ML Pipelines to Production

python scala spark tensorflow scikit-learn transformers data-pipelines

Updated Oct 13, 2021
Scala

EleutherAI / gpt-neox

Star

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

transformers language-model gpt-3 deepspeed-library

Updated Oct 13, 2021
Python

lucidrains / x-transformers

Star

A simple but complete full-attention transformer with a set of promising experimental features from various papers

deep-learning transformers artificial-intelligence attention-mechanism

Updated Oct 4, 2021
Python

NLP-Knowledge-Graph

lihanghang / NLP-Knowledge-Graph

Star

自然语言处理、知识图谱、对话系统三大技术研究与应用。

nlp machine-learning deep-learning transformers knowledge-graph event-driven ner bert kbqa ernie

Updated Jan 3, 2021

cevek / ttypescript

Star

Open

How to use with mocha & ts-node/register?

4

bradennapier commented Mar 11, 2020

Hey! Thanks for the work on this.

Wondering how we can use this with mocha? tsconfig-paths has its own tsconfig-paths/register to make this work

https://github.com/dividab/tsconfig-paths#with-mocha-and-ts-node

Basically with mocha we have to run mocha -r ts-node/register -- but that wouldnt have the compiler flag.

Would be worthwhile to have the ability to do it which looks like

Read more

good first issue

dorarad / gansformer

Star

Generative Adversarial Transformers

transformers attention image-generation gans generative-adversarial-networks compositionality scene-generation

Updated Sep 25, 2021
Python

NielsRogge / Transformers-Tutorials

Star

This repository contains demos I made with the Transformers library by HuggingFace.

transformers pytorch bert

Updated Sep 27, 2021
Jupyter Notebook

KoBERT

SKTBrain / KoBERT

Star

Korean BERT pre-trained cased (KoBERT)

nlp transformers pytorch language-model bert korean-nlp

Updated Jul 22, 2021
Jupyter Notebook

lucidrains / performer-pytorch

Star

An implementation of Performer, a linear attention-based transformer, in Pytorch

deep-learning transformers artificial-intelligence attention attention-mechanism

Updated Oct 3, 2021
Python

turtlesoupy / this-word-does-not-exist

Star

This Word Does Not Exist

machine-learning natural-language-processing transformers natural-language-generation natural-language-understanding gpt-2

Updated Jan 12, 2021
Python

self-attention-cv

The-AI-Summer / self-attention-cv

Star

Implementation of various self-attention mechanisms focused on computer vision. Ongoing repository.

machine-learning deep-learning machine-learning-algorithms transformers artificial-intelligence transformer attention attention-mechanism self-attention

Updated Sep 14, 2021
Python

lonePatient / Bert-Multi-Label-Text-Classification

Star

This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.

nlp text-classification transformers pytorch multi-label-classification albert bert fine-tuning pytorch-implmention xlnet

Updated Jun 2, 2021
Python

Adapter-Hub / adapter-transformers

Star

Huggingface Transformers + Adapters = ❤️

nlp natural-language-processing transformers pytorch adapters bert

Updated Oct 12, 2021
Python

Improve this page

Add a description, image, and links to the transformers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformers topic, visit your repo's landing page and select "manage topics."