#

bert

Here are 1,150 public repositories matching this topic...

transformers

huggingface / transformers

Star

Open

[Good first issue] Documentation links in older docs versions

LysandreJik commented Oct 22, 2020

🚀 Feature request

This is a documentation request in order to make it easier to find corresponding examples in the documentation.

Good first issue if you want to get acquainted with the docs and how to build docs using Sphinx!

Current issue

Here's the issue: currently, if one goes to an older documentation version to check the "examples" page, for example, [v2.6.0](https://huggin

Read more

Documentation Good First Issue

Open

Implement PyTorch and/or TensorFlow sequence classification architectures for causal language models

15

Open

Implement a TF2 version of `GPT2ForSequenceClassification`

4

Find more good first issues →

hanxiao / bert-as-service

Star

Mapping a variable-length sentence to a fixed-length vector using BERT model

nlp machine-learning natural-language-processing deep-neural-networks ai deep-learning tensorflow bert natural-language-understanding word-embedding sentence-encoding

Updated Oct 20, 2020
Python

graykode / nlp-tutorial

Star

Natural Language Processing Tutorial for Deep Learning Researchers

nlp natural-language-processing tutorial tensorflow paper pytorch transformer attention bert

Updated Oct 20, 2020
Jupyter Notebook

brightmart / nlp_chinese_corpus

Star

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

nlp news wiki text-classification word2vec corpus dataset question-answering chinese chinese-nlp language-model bert chinese-corpus pretrain chinese-dataset

Updated Oct 22, 2020

ymcui / Chinese-BERT-wwm

Star

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

nlp tensorflow pytorch bert rbt roberta chinese-bert bert-wwm bert-wwm-ext roberta-wwm

Updated Nov 20, 2020
Python

tokenizers

huggingface / tokenizers

Star

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

nlp natural-language-processing transformers gpt language-model bert natural-language-understanding

Updated Nov 25, 2020
Rust

codertimo / BERT-pytorch

Star

Open

chooses 15% of token

1

makcedward commented Feb 22, 2019

From paper, it mentioned

Instead, the training data generator chooses 15% of tokens at random, e.g., in the sentence my
dog is hairy it chooses hairy.

It means that 15% of token will be choose for sure.

From https://github.com/codertimo/BERT-pytorch/blob/master/bert_pytorch/dataset/dataset.py#L68,
for every single token, it has 15% of chance that go though the followup procedure.

Read more

good first issue

Open

PositionalEmbedding

3

Open

Question about the loss of Masked LM

4

PaddlePaddle / ERNIE

Star

An Implementation of ERNIE For Language Understanding (including Pre-training models and Fine-tuning tools)

nlp natural-language-processing bert language-understanding ernie

Updated Nov 19, 2020
Python

macanv / BERT-BiLSTM-CRF-NER

Star

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

crf named-entity-recognition ner bert blstm bert-bilstm-crf

Updated Oct 16, 2020
Python

brightmart / albert_zh

Star

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

tensorflow pytorch albert bert pre-trained chinese-corpus roberta pre-trained-model xlnet

Updated Oct 22, 2020
Python

nlp-architect

IntelLabs / nlp-architect

Star

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

nlp deep-learning tensorflow nlu transformers pytorch deeplearning quantization bert dynet

Updated Nov 25, 2020
Python

bentrevett / pytorch-sentiment-analysis

Star

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

nlp natural-language-processing tutorial sentiment-analysis word-embeddings transformers cnn pytorch recurrent-neural-networks lstm rnn fasttext bert sentiment-classification pytorch-tutorial pytorch-tutorials cnn-text-classification lstm-sentiment-analysis pytorch-nlp torchtext

Updated Nov 16, 2020
Jupyter Notebook

jessevig / bertviz

Star

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

visualization nlp machine-learning natural-language-processing neural-network pytorch bert

Updated Nov 4, 2020
Jupyter Notebook

asyml / texar

Star

Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part of the CASL project: http://casl-project.ai/

python machine-learning natural-language-processing deep-learning tensorflow machine-translation text-generation data-processing bert text-data dialog-systems gpt-2 texar xlnet casl-project

Updated Sep 17, 2020
Python

CyberZHG / keras-bert

Star

Implementation of BERT that could load official pre-trained models for feature extraction and prediction

keras language-model bert

Updated Jul 28, 2020
Python

BrikerMan / Kashgari

Star

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

nlp machine-learning text-classification named-entity-recognition seq2seq transfer-learning ner bert sequence-labeling nlp-framework bert-model text-labeling gpt-2

Updated Nov 18, 2020
Python

pycorrector

shibing624 / pycorrector

Star

pycorrector is a toolkit for text error correction. It was developed to facilitate the designing, comparing, and sharing of deep text error correction models.

bert spelling-errors electra error-detection deep-learning-models kenlm error-correction pycorrector seq2seq-attention

Updated Oct 29, 2020
Python

spark-nlp

JohnSnowLabs / spark-nlp

Star

State of the Art Natural Language Processing

nlp natural-language-processing spark sentiment-analysis tensorflow transformers language-detection pyspark named-entity-recognition lemmatizer spell-checker language-model albert bert part-of-speech-tagger entity-extraction natural-language-understanding spark-ml xlnet tf-hub-models

Updated Nov 25, 2020
Scala

Separius / awesome-sentence-embedding

Star

A curated list of pretrained sentence and word embedding models

nlp awesome encoder paper natural-language word-embeddings evaluation awesome-list pretrained-models unsupervised-learning embedding-models language-model bert embedded-models cross-lingual wordembedding encoders sentence-embeddings pretrained-embedding sentence-representations contextualized-representation vector-map pooling-methods pretrained-language-model subword-models

Updated Aug 4, 2020
Python

Jiakui / awesome-bert

Star

bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目

nlp bert google-bert xlnet

Updated Oct 23, 2019

brightmart / roberta_zh

Star

RoBERTa中文预训练模型: RoBERTa for Chinese

chinese bert pre-trained roberta gpt2 pre-trained-language-models

Updated Jun 29, 2020
Python

fast-bert

kaushaltrivedi / fast-bert

Star

Super easy library for BERT based NLP models

transformers fastai bert fast-bert

Updated Oct 22, 2020
Python

CLUEbenchmark / CLUE

Star

中文语言理解基准测评 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

Updated Nov 6, 2020
Python

ChineseGLUE / ChineseGLUE

Star

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

nlp glue datasets albert bert chinese-corpus language-understanding pre-trained-model

Updated Mar 1, 2020
Python

github / CodeSearchNet

Star

Datasets, tools, and benchmarks for representation learning of code.

python nlp data-science data machine-learning natural-language-processing deep-learning tensorflow ml cnn open-data neural-networks rnn datasets representation-learning nlp-machine-learning bert programming-language-theory self-attention machine-learning-on-source-code

Updated Sep 18, 2020
Jupyter Notebook

synrc / n2o

Star

⭕ N2O: Distributed Application Server — https://ws.n2o.dev

mqtt tcp udp websockets bert

Updated Nov 24, 2020
Erlang

msgi / nlp-journey

Star

Documents, papers and codes related to Natural Language Processing, including Topic Model, Word Embedding, Named Entity Recognition, Text Classificatin, Text Generation, Text Similarity, Machine Translation)，etc. All codes are implemented intensorflow 2.0.

tensorflow svm word2vec crf keras similarity classification attention gensim lda fasttext ner embedding bert elmo

Updated Nov 6, 2020
Python

haystack

deepset-ai / haystack

Star

Open

Introduce QueryClassifier

3

tholor commented Nov 23, 2020

Is your feature request related to a problem? Please describe.
With the new flexible Pipelines introduced in deepset-ai/haystack#596, we can build way more flexlible and complex search routes.
One common challenge that we saw in deployments: We need to distinguish between real questions and keyword queries that come in. We only want to route questions to the Reader b

Read more

enhancement good first issue help wanted

Open

Enable GPU support for Generator

Open

Generating full-sentences context

7

nyu-mll / jiant

Star

jiant is an NLP toolkit

nlp transformers transfer-learning bert multitask-learning sentence-representation

Updated Nov 24, 2020
Python

dbiir / UER-py

Star

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

nlp natural-language-processing pytorch classification chinese gpt ner bert fine-tuning elmo pre-training

Updated Nov 14, 2020
Python

Improve this page

Add a description, image, and links to the bert topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the bert topic, visit your repo's landing page and select "manage topics."

You can’t perform that action at this time.