#

self-attention

Here are 117 public repositories matching this topic...

PetarV- / GAT

Star

Graph Attention Networks (https://arxiv.org/abs/1710.10903)

python tensorflow neural-networks attention-mechanism graph-attention-networks self-attention

Updated Apr 12, 2020
Python

Diego999 / pyGAT

Star

Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)

python pytorch neural-networks attention-mechanism graph-attention-networks self-attention

Updated Nov 17, 2020
Python

github / CodeSearchNet

Star

Datasets, tools, and benchmarks for representation learning of code.

python nlp data-science data machine-learning natural-language-processing deep-learning tensorflow ml cnn open-data neural-networks rnn datasets representation-learning nlp-machine-learning bert programming-language-theory self-attention machine-learning-on-source-code

Updated Jan 28, 2021
Jupyter Notebook

speedinghzl / CCNet

Star

CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).

pytorch segmentation semantic-segmentation cityscape self-attention scene-parsing

Updated Nov 18, 2020
Python

brightmart / bert_language_understanding

Star

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

nlp text-classification question-answering document-classification transfer-learning fasttext language-model textcnn attention-is-all-you-need self-attention transformer-encoder bert-model pre-training language-understanding

Updated Jan 1, 2019
Python

prakashpandey9 / Text-Classification-Pytorch

Star

Text classification using deep learning models in Pytorch

text-classification pytorch lstm-model glove rnn-model sentiment-classification attention-model self-attention

Updated Nov 17, 2018
Python

awesome-fast-attention

Separius / awesome-fast-attention

Star

list of efficient attention modules

awesome transformer attention attention-is-all-you-need multihead-attention reformer self-attention transformer-network longformer linformer

Updated Jan 7, 2021
Python

kaituoxu / Speech-Transformer

Star

A PyTorch implementation of Speech Transformer, an End-to-End ASR with Transformer network on Mandarin Chinese.

end-to-end pytorch transformer attention asr attention-is-all-you-need self-attention

Updated May 7, 2020
Python

kaushalshetty / Structured-Self-Attention

Star

A Structured Self-attentive Sentence Embedding

visualization deep-learning python3 pytorch classification attention attention-mechanism attention-model sentence-embeddings self-attentive-rnn self-attention attention-weights

Updated Sep 22, 2019
Python

pytorch-GAT

gordicaleksa / pytorch-GAT

Star

My implementation of the original GAT paper (Veličković et al.). I've additionally included the playground.py file for visualizing the Cora dataset, GAT embeddings, an attention mechanism, and entropy histograms. I'll add an inductive example (PPI) soon as well.

python deep-learning jupyter pytorch attention attention-mechanism graph-attention-networks self-attention pytorch-implementation gat graph-attention-network pytorch-gat gat-tutorial

Updated Feb 1, 2021
Jupyter Notebook

Tixierae / deep_learning_NLP

Star

Keras, PyTorch, and NumPy Implementations of Deep Learning Architectures for NLP

nlp deep-learning numpy word2vec word-embeddings keras python3 pytorch recurrent-neural-networks attention nmt skipgram doc2vec cnn-keras saliency-map seq2seq-pytorch self-attention document-embeddings hierarchical-attention-network

Updated Mar 11, 2020
Jupyter Notebook

microsoft / DeBERTa

Star

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Feb 2, 2021
Python

leaderj1001 / Stand-Alone-Self-Attention

Star

Implementing Stand-Alone Self-Attention in Vision Models using Pytorch

pytorch self-attention stand-alone-self-attention

Updated Feb 13, 2020
Python

jayparks / transformer

Star

A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"

machine-translation attention-mechanism attention-is-all-you-need self-attention

Updated Oct 1, 2020
Python

L0SG / relational-rnn-pytorch

Star

An implementation of DeepMind's Relational Recurrent Neural Networks in PyTorch.

deep-learning language-modeling pytorch recurrent-neural-networks transformer deepmind language-model word-language-model self-attention

Updated Dec 27, 2018
Python

cbaziotis / neat-vision

Star

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

visualization nlp natural-language-processing vuejs deep-learning attention deep-learning-library attention-mechanism text-visualization attention-mechanisms deep-learning-visualization self-attentive-rnn self-attention attention-visualization attention-scores

Updated May 4, 2018
Vue

flrngel / Self-Attentive-tensorflow

Star

Tensorflow implementation of "A Structured Self-Attentive Sentence Embedding"

tensorflow attention self-attentive-rnn self-attention

Updated Sep 27, 2020
Python

daiquocnguyen / Graph-Transformer

Star

Transformer for Graph Classification (Pytorch and Tensorflow)

transformer unsupervised-learning graph-embeddings graph-classification self-attention graph-neural-networks graph-representation-learning pytorch-implementation unsupervised-graph-embedding node-embeddings unsupervised-graph-neural-network graph-transformer

Updated Dec 22, 2020
Python

shiningliang / MRC2018

Star

2018百度机器阅读理解技术竞赛

bidaf machine-reading-comprehension self-attention

Updated Feb 26, 2019
Python

alohays / awesome-visual-representation-learning-with-transformers

Star

Awesome Transformers (self-attention) in Computer Vision

computer-vision transformers awesome-list representation-learning self-attention

Updated Jan 31, 2021

kushalj001 / pytorch-question-answering

Star

Important paper implementations for Question Answering using PyTorch

nlp natural-language-processing tutorial deep-learning pytorch question-answering convolutional-neural-networks attention-mechanism nlp-machine-learning bidaf pytorch-tutorial paper-implementations drqa bidaf-pytorch self-attention pytorch-implementation qanet squad-dataset

Updated Dec 29, 2020
Jupyter Notebook

aravindsankar28 / DySAT

Star

Representation learning on dynamic graphs using self-attention networks

graph-embedding self-attention dynamic-graphs graph-neural-network

Updated Nov 13, 2020
Python

akanimax / fagan

Star

A variant of the Self Attention GAN named: FAGAN (Full Attention GAN)

deep-learning artificial-intelligence gan sagan self-attention full-attention

Updated Nov 21, 2018
Python

gmftbyGMFTBY / MultiTurnDialogZoo

Star

Multi-turn dialogue baselines written in PyTorch

Updated Mar 10, 2020
Python

foamliu / Self-Attention-Keras

Star

自注意力与文本分类

nlp self-attention

Updated Nov 3, 2018
Python

roomylee / self-attentive-emb-tf

Star

Simple Tensorflow Implementation of "A Structured Self-attentive Sentence Embedding" (ICLR 2017)

text-classification tensorflow attention attention-mechanism iclr2017 sentence-embeddings self-attention

Updated Jun 25, 2018
Python

leaderj1001 / LambdaNetworks

Star

Implementing Lambda Networks using Pytorch

pytorch image-classification self-attention lambda-networks lambda-convolution

Updated Nov 24, 2020
Python

zhouhaoyi / Informer2020

Star

The GitHub repository for the paper "Informer" accepted by AAAI 2021.

deep-learning time-series pytorch forecasting self-attention

Updated Jan 26, 2021
Python

lucidrains / global-self-attention-network

Star

A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks

artificial-intelligence image-classification attention attention-mechanism self-attention

Updated Nov 21, 2020
Python

VSainteuf / pytorch-psetae

Star

PyTorch implementation of the model presented in "Satellite Image Time Series Classification with Pixel-Set Encoders and Temporal Self-Attention"

machine-learning computer-vision deep-learning agriculture pytorch remote-sensing cvpr spatio-temporal earth-observation time-series-classification self-attention transformer-architecture satellite-image cvpr2020

Updated Sep 7, 2020
Python

Improve this page

Add a description, image, and links to the self-attention topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the self-attention topic, visit your repo's landing page and select "manage topics."