#

roberta

Here are 178 public repositories matching this topic...

ymcui / Chinese-BERT-wwm

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

nlp tensorflow pytorch bert rbt roberta chinese-bert bert-wwm bert-wwm-ext roberta-wwm

Updated Nov 4, 2021
Python

brightmart / albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

tensorflow pytorch albert bert pre-trained chinese-corpus roberta pre-trained-model xlnet

Updated Oct 22, 2020
Python

jessevig / bertviz

Tool for visualizing attention in the Transformer model (BERT, GPT-2, Albert, XLNet, RoBERTa, CTRL, etc.)

visualization nlp machine-learning natural-language-processing neural-network pytorch transformer bert roberta gpt2

Updated Sep 25, 2021
Python

CLUEbenchmark / CLUE

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

Updated Nov 11, 2021
Python

brightmart / roberta_zh

RoBERTa中文预训练模型: RoBERTa for Chinese

chinese bert pre-trained roberta gpt2 pre-trained-language-models

Updated Jul 8, 2021
Python

dbiir / UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Updated Nov 21, 2021
Python

FARM

deepset-ai / FARM

🏡 Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

nlp deep-learning pytorch question-answering transfer-learning pretrained-models language-models ner nlp-library bert nlp-framework roberta xlnet-pytorch germanbert

Updated Nov 12, 2021
Python

news-please

fhamborg / news-please

Sponsor

news-please - an integrated web crawler and information extractor for news that just works

Updated Aug 14, 2021
Python

Tencent / TurboTransformers

Open

How can I participate in this project?

3

lsy641 commented May 15, 2020

Hi, I am so interesting in your project, and wonder if you need contributor and how could I make my own contribution?

Read more

good first issue

Open

只支持huggingface训练的tensorflow模型载入么？

4

CLUEbenchmark / CLUENER2020

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

dataset named-entity-recognition chinese seq2seq sequence-to-sequence ner albert bert sequence-labeling chinese-ner roberta fine-grained-ner chinesener

Updated Nov 19, 2021
Python

guillaume-be / rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

nlp rust machine-learning translation deep-learning sentiment-analysis transformer rust-lang question-answering bart gpt ner bert language-generation electra roberta gpt-2

Updated Nov 22, 2021
Rust

microsoft / DeBERTa

The implementation of DeBERTa

deeplearning representation-learning language-model bert natural-language-understanding self-attention roberta transformer-encoder

Updated Nov 19, 2021
Python

asyml / texar-pytorch

Open

Loading pre-trained model checkpoint and model arch config are coupled

gpengzhi commented Jul 12, 2019

setting pretrained_model_name will not only define the model arch but also load the pre-trained checkpoint. We should have another hparam to control whether to load pre-trained checkpoint or not.

Read more

enhancement good first issue topic: modules

920232796 / bert_seq2seq

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

text-classification crf pytorch seq2seq ner bert roberta gpt2 unilm t5-model autotitle

Updated Nov 22, 2021
Python

lonePatient / awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型集合

nlp chinese zen gpt pretrained-models pangu albert bert electra roberta gpt-2 ernie xlnet nezha macbert nlu-nlg t5-pegasus simbert nezha-gen

Updated Oct 18, 2021

CLUEbenchmark / CLUEPretrainedModels

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

text-classification corpus dataset chinese semantic-similarity pretrained-models sentence-classification albert bert sentence-analysis distillation sentence-pairs roberta

Updated Jul 8, 2020
Python

grammarly / gector

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)

nlp natural-language-processing transformers bert sequence-labeling text-simplification grammatical-error-correction roberta xlnet

Updated Oct 28, 2021
Python

VinAIResearch / PhoBERT

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

deep-learning vietnamese transformers python3 named-entity-recognition language-models ner natural-language-inference bert pos-tagging vietnamese-nlp nli fairseq vncorenlp roberta bert-embeddings rdrsegmenter part-of-speech-tagging transformers-library phobert

Updated Sep 24, 2021

CLUEbenchmark / CLUECorpus2020

Large-scale Pre-training Corpus for Chinese 100G 中文预训练语料

nlp corpus chinese datasets albert bert chinese-corpus roberta pretrain

Updated Jun 4, 2021

VinAIResearch / BERTweet

BERTweet: A pre-trained language model for English Tweets (EMNLP-2020)

sentiment-analysis text-classification transformers python3 english named-entity-recognition ner language-model bert english-tweets fairseq irony-detection roberta part-of-speech-tagging covid-19 covid covid19 bertweet bertweet-covid19

Updated Oct 2, 2021
Python

rinnakk / japanese-pretrained-models

Code for producing Japanese pretrained models provided by rinna Co., Ltd.

nlp japanese roberta gpt2

Updated Nov 1, 2021
Python

KLUE-benchmark / KLUE

📖 Korean NLU Benchmark

benchmark korean bert korean-nlp roberta

Updated Nov 2, 2021

TransformerSum

HHousen / TransformerSum

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

machine-learning text-summarization summarization albert extractive-summarization automatic-summarization bert roberta transformer-models pytorch-lightning distilbert summarization-dataset

Updated Oct 12, 2021
Python

EricFillion / happy-transformer

A package built on top of Hugging Face's transformers library that makes it easy to utilize state-of-the-art NLP models

python nlp machine-learning natural-language-processing ai deep-learning text-classification transformers artificial-intelligence question-answering language-models bert roberta

Updated Nov 19, 2021
Python

brightmart / xlnet_zh

中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large

language-model bert roberta pre-train xlnet

Updated Sep 13, 2019
Python

ernie

labteral / ernie

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

nlp natural-language-processing tensorflow keras transformers sentence-classification albert bert roberta bert-model transformer-architecture tensorflow2 bert-embeddings huggingface bert-models bert-as-service transformer-tensorflow2 distilbert huggingface-transformer

Updated Nov 10, 2020
Python

brightmart / multi-label_classification

transform multi-label classification as sentence pair task, with more training data and information

text-classification multi-label-classification bert roberta sentence-pair-classification

Updated Dec 13, 2019
Python

microsoft / LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

deep-learning pytorch language-model adaptation roberta low-rank gpt-2 gpt-3 deberta

Updated Nov 6, 2021
Python

amansrivastava17 / embedding-as-service

One-Stop Solution to encode sentence to fixed length vectors from various embedding techniques

Updated Nov 10, 2021
Python

cliang1453 / BOND

BOND: BERT-Assisted Open-Domain Name Entity Recognition with Distant Supervision

nlp natural-language-processing weak-supervision dataset named-entity-recognition self-training ner bert pre-trained weakly-supervised-learning distant-supervision weakly-supervised fine-tuning roberta open-domain

Updated Jun 2, 2021
Python

Improve this page

Add a description, image, and links to the roberta topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the roberta topic, visit your repo's landing page and select "manage topics."