#

corpus

Here are 229 public repositories matching this topic...

CLUEbenchmark / CLUE

中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

benchmark tensorflow nlu glue corpus transformers pytorch dataset chinese pretrained-models language-model albert bert roberta chineseglue

Updated Jan 7, 2022
Python

CLUEbenchmark / CLUEDatasetSearch

搜索所有中文NLP数据集，附常用英文NLP数据集

nlp qa sentiment-analysis text-classification match machine-translation text-similarity corpus knowledge-graph chinese text-summarization datasets ner machine-reading-comprehension

Updated Apr 5, 2022
Python

jinfagang / weibo_terminater

Final Weibo Crawler Scrap Anything From Weibo, comments, weibo contents, followers, anything. The Terminator

scraper chatbot corpus chinese weibo sina

Updated Oct 25, 2019
Python

fendouai / Awesome-Chatbot

Awesome Chatbot Projects,Corpus,Papers,Tutorials.Chinese Chatbot =>:

awesome tutorial tensorflow chatbot corpus seq2seq seq2seq-model seq2seq-chatbot

Updated Feb 10, 2020
Python

candlewill / Dialog_Corpus

用于训练中英文对话系统的语料库 Datasets for Training Chatbot System

system chatbot dialog corpus dataset

Updated Sep 23, 2020
Python

chatopera / insuranceqa-corpus-zh

🚁 保险行业语料库，聊天机器人

machine-learning natural-language-processing insurance chatbot corpus dataset question-answering natural-language-understanding qasystem insuranceqa-corpus-zh

Updated Oct 11, 2020
Python

tensorlayer / seq2seq-chatbot

Chatbot in 200 lines of code using TensorLayer

python nlp chat bot tensorflow chatbot corpus lstm rnn tensorlayer

Updated Oct 5, 2021
Python

CLUEbenchmark / CLUEPretrainedModels

高质量中文预训练模型集合：最先进大模型、最快小模型、相似度专门模型

text-classification corpus dataset chinese semantic-similarity pretrained-models sentence-classification albert bert sentence-analysis distillation sentence-pairs roberta

Updated Jul 8, 2020
Python

OYE93 / Chinese-NLP-Corpus

Collections of Chinese NLP corpus

corpus chinese-nlp datasets

Updated Dec 28, 2020
Python

soskek / bookcorpus

Crawl BookCorpus

nlp crawler scraper corpus bookcorpus

Updated Jun 23, 2021
Python

BLKSerene / Wordless

An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation

multilingual language translation tokenizer corpus tagger literature corpus-linguistics lemmatizer corpus-tools corpus-processing corpus-statistics stopword corpus-analysis

Updated Mar 12, 2022
Python

ko-nlp / Korpora

Korean corpus repository

corpus korean-natural-language

Updated Dec 29, 2021
Python

CBLUEbenchmark / CBLUE

中文医疗信息处理基准CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark

benchmark evaluation corpus dataset chinese chineseblue biomedical-tasks

Updated Mar 29, 2022
Python

chatopera / efa.corpus.osc

❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库

natural-language-processing corpus psychology natural-language-understanding

Updated Apr 7, 2022
Python

grammarly / ua-gec

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

natural-language-processing corpus dataset corpus-data corpus-tools gec nlp-datasets grammatical-error-correction ukrainian-language

Updated Apr 8, 2022
Python

EdinburghNLP / code-docstring-corpus

Preprocessed Python functions and docstrings for automated code documentation (code2doc) and automated code generation (doc2code) tasks.

corpus code-generation neural-machine-translation documentation-generator docstrings

Updated Jul 13, 2020
Python

yc9701 / pansori

Tools for ASR Corpus Generation from Online Video

corpus speech-recognition dataset-generation data-pipeline online-video speech-corpus

Updated Feb 10, 2019
Python

yutkin / Lenta.Ru-News-Dataset

Corpus of Russian news articles collected from Lenta.Ru

python nlp parser news asynchronous corpus dataset asyncio russian lenta-ru lenta

Updated Feb 26, 2021
Python

PyThaiNLP / lexicon-thai

คลังศัพท์ภาษาไทย

corpus thai-language lexicon-thai

Updated Aug 7, 2021
Python

CLUEbenchmark / PyCLUE

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

corpus tiny language-model albert bert chinese-language xlnet evaluation-benchmark chineseglue roberta-wwm-ext

Updated Feb 9, 2022
Python

EternalFeather / Chatbot-Training-Corpus

总结了一些可以用作聊天机器人训练实作的文字语聊，包含中英文不同语言

chatbot dialogue corpus

Updated Jun 7, 2018
Python

srvk / how2-dataset

This repository contains code and metadata of How2 dataset

language video machine-translation corpus dataset speech-recognition multimodality how2-dataset

Updated Jun 12, 2020
Python

Hironsan / ja.text8

Sponsor

Japanese text8 corpus for word embedding.

machine-learning natural-language-processing deep-learning word2vec corpus

Updated Oct 4, 2017
Python

gmftbyGMFTBY / OpenDialog

An Open-Source Package for Chinese Open-domain Conversational Chatbot (中文闲聊对话系统，一键部署微信闲聊机器人)

reinforcement-learning retrieval corpus transformers pytorch wechat chinese generative bert wechat-api multi-view open-domain gpt2 gan-based

Updated Dec 7, 2020
Python

GlobalMaksimum / sadedegel

A General Purpose NLP library for Turkish

python heroku nlp data-science machine-learning natural-language-processing binder ai deep-learning neural-network corpus embeddings artificial-intelligence neural-networks bert news-summarizer acikhack2

Updated Feb 28, 2022
Python

gambolputty / german-nouns

A list of ~98,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

corpus nouns wiktionary german-language german-nouns

Updated Jan 21, 2022
Python

philipperemy / japanese-words-to-vectors

Sponsor

Word2vec (word to vectors) approach for Japanese language using Gensim and Mecab.

wikipedia japanese word2vec corpus gensim japanese-language word2vec-algorithm

Updated Jan 25, 2022
Python

writecrow / ocr2text

Convert a PDF via OCR to a TXT file in UTF-8 encoding

pdf converter ocr corpus tesseract batch

Updated Apr 6, 2022
Python

chakki-works / CoARiJ

Corpus of Annual Reports in Japan

finance natural-language-processing corpus dataset

Updated Dec 19, 2020
Python

megagonlabs / jrte-corpus

Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)

natural-language-processing corpus japanese-language sentiment-polarity textual-entailment

Updated Oct 15, 2020
Python

Improve this page

Add a description, image, and links to the corpus topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the corpus topic, visit your repo's landing page and select "manage topics."