#

transformer

Here are 889 public repositories matching this topic...

graykode / nlp-tutorial

Star

Natural Language Processing Tutorial for Deep Learning Researchers

nlp natural-language-processing tutorial tensorflow paper pytorch transformer attention bert

Updated Oct 20, 2020
Jupyter Notebook

google / trax

Star

Open

Bidirectional RNN

4

jonatasgrosman commented Oct 7, 2020

Is there a way to train a bidirectional RNN (like LSTM or GRU) on trax nowadays?

Read more

enhancement good first issue

codertimo / BERT-pytorch

Star

Open

chooses 15% of token

1

makcedward commented Feb 22, 2019

From paper, it mentioned

Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.

It means that 15% of token will be choose for sure.

From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.

Read more

good first issue

Open

PositionalEmbedding

3

Open

Question about the loss of Masked LM

4

openai / jukebox

Star

Code for the paper "Jukebox: A Generative Model for Music"

audio music paper pytorch transformer generative-model vq-vae

Updated Nov 20, 2020
Python

Morizeyao / GPT2-Chinese

Star

Chinese version of GPT2 training code, using BERT tokenizer.

nlp text-generation transformer chinese gpt-2

Updated Nov 7, 2020
Python

Kyubyong / transformer

Star

A TensorFlow Implementation of the Transformer: Attention Is All You Need

translation transformer implementation attention-mechanism attention-is-all-you-need

Updated Nov 13, 2020
Python

xmuSistone / ViewpagerTransition

Star

viewpager with parallax pages, together with vertical sliding (or click) and activity transition

parallax transition viewpager transformer

Updated May 3, 2017
Java

posthtml / posthtml

Star

PostHTML is a tool to transform HTML/XML with JS plugins

html parser xml transformer html-parser xml-parser posthtml

Updated Dec 14, 2020
JavaScript

bentrevett / pytorch-seq2seq

Star

Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.

tutorial pytorch transformer lstm gru rnn seq2seq attention neural-machine-translation sequence-to-sequence encoder-decoder pytorch-tutorial pytorch-tutorials encoder-decoder-model pytorch-implmention pytorch-nlp torchtext pytorch-implementation pytorch-seq2seq cnn-seq2seq

Updated Dec 9, 2020
Jupyter Notebook

huggingface / pytorch-openai-transformer-lm

Star

🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI

pytorch transformer openai neural-networks language-model

Updated Feb 7, 2019
Python

yangjianxin1 / GPT2-chitchat

Star

GPT2 for Chinese chitchat/用于中文闲聊的GPT2模型(实现了DialoGPT的MMI思想)

nlp text-generation transformer gpt-2 gpt2 dialogpt chichat dialogue-model

Updated May 16, 2020
Python

microsoft / DialoGPT

Star

Large-scale pretraining for dialogue

machine-learning dialogue text-generation pytorch transformer data-processing text-data gpt-2 dialogpt

Updated Dec 4, 2020
Python

awslabs / sockeye

Star

Sequence-to-sequence framework with a focus on Neural Machine Translation based on Apache MXNet

machine-learning deep-neural-networks translation deep-learning mxnet machine-translation transformer seq2seq neural-machine-translation sequence-to-sequence gluon attention-mechanism encoder-decoder attention-model sequence-to-sequence-models attention-alignment-visualization attention-is-all-you-need sockeye transformer-architecture transformer-network

Updated Dec 14, 2020
Python

MikaelZero / mojito

Star

微信、bilibili大图、长图、gif、视频、自定义view的转场效果，The transition effect of wechat, bilibili large image, long image, GIF, video and custom view

android video drag gif transformer longimage photoview bigimageviewer bigimage dragimageview dragvideo

Updated Sep 24, 2020
Java

yongzhuo / Keras-TextClassification

Star

中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（embeddings）和网络层（graph）构建基类，FastText，TextCNN，CharCNN，TextRNN, RCNN, DCNN, DPCNN, VDCNN, CRNN, Bert, Xlnet, Albert, Attention, DeepMoji, HAN, 胶囊网络-CapsuleNet, Transformer-encode, Seq2seq, SWEM, LEAM, TextGCN

Updated Dec 11, 2020
Python

Separius / BERT-keras

Star

Keras implementation of BERT with pre-trained weights

nlp theano tensorflow keras language-modeling transformer transfer-learning pretrained-models

Updated Jul 26, 2019
Python

Tencent / TurboTransformers

Star

Open

How can I participate in this project?

3

lsy641 commented May 15, 2020

Hi, I am so interesting in your project, and wonder if you need contributor and how could I make my own contribution?

Read more

good first issue

Open

只支持huggingface训练的tensorflow模型载入么？

4

GaoQ1 / rasa_chatbot_cn

Star

building a chinese dialogue system based on the newest version of rasa(基于最新版本rasa搭建的对话系统)

python demo tensorflow policy rasa-nlu transformer chinese rasa bert slot-filling intent-classification rasa-core rasa-nlu-gao rasa-chatbot train-dialogue rasa-x

Updated Oct 10, 2020
Python

wajahatkarim3 / EasyFlipViewPager

Star

📖 The library for creating book and card flip animations in ViewPager in Android

android animation transformations android-library viewpager transformer flip pagetransformer page-transformer pageflip flip-animation viewpager-transformer viewpagertransformer

Updated May 12, 2020
Java

flugg / laravel-responder

Sponsor Star

A Laravel Fractal package for building API responses, giving you the power of Fractal with Laravel's elegancy.

api laravel lumen fractal transformer responder

Updated Dec 9, 2020
PHP

kpe / bert-for-tf2

Star

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

tensorflow keras transformer bert

Updated Nov 15, 2020
Python

curiousily / Getting-Things-Done-with-Pytorch

Star

Jupyter Notebook tutorials on solving real-world problems with Machine Learning & Deep Learning using PyTorch. Topics: Face detection with Detectron 2, Time Series anomaly detection with LSTM Autoencoders, Object Detection with YOLO v5, Build your first Neural Network, Time Series forecasting for Coronavirus daily cases, Sentiment Analysis with BERT.

nlp machine-learning tutorial computer-vision deep-learning time-series sentiment-analysis pytorch transformer lstm yolo face-recognition face-detection object-detection transfer-learning bert anomaly-detection time-series-forecasting coronavirus time-series-anomaly-detection

Updated Jun 27, 2020
Jupyter Notebook

qiaoguan / deep-ctr-prediction

Star

CTR prediction models based on deep learning(基于深度学习的广告推荐CTR预估模型)

afm transformer resnet recommendation recommendation-algorithms ctr-prediction ctr recommendation-algorithm factorization-machine deepfm xdeepfm deep-ctr ad-algorithm esmm deep-cross deep-interest-network fibinet

Updated Nov 15, 2019
Python

awesome-fast-attention

Separius / awesome-fast-attention

Star

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Nov 12, 2020
Python

yuanxiaosc / BERT_Paper_Chinese_Translation

Star

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 论文的中文翻译 Chinese Translation!

paper transformer chinese-translation paper-translate bert

Updated Jun 1, 2020

woutervh- / typescript-is

Star

typescript runtime transformer type-check

Updated Dec 11, 2020
TypeScript

geftimov / android-viewpager-transformers

Star

A collection of view pager transformers

android animation viewpager transformer android-viewpager-transformers pager-transformers

Updated May 30, 2017
Java

kaituoxu / Speech-Transformer

Star

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated May 7, 2020
Python

kristerkari / react-native-svg-transformer

Star

Import SVG files in your React Native project the same way that you would in a Web application.

svg react-native loader transformer react-native-svg

Updated Oct 8, 2020
JavaScript

cedrickchee / awesome-bert-nlp

Star

A curated list of NLP resources focused on BERT, attention mechanism, Transformer networks, and transfer learning.

nlp natural-language-processing transformer neural-networks awesome-list transfer-learning language-model attention-mechanism bert gpt-2 xlnet pre-trained-language-models gpt-3

Updated Oct 14, 2020

Improve this page

Add a description, image, and links to the transformer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.