Skip to content
#

natural-language-understanding

Star

Here are 585 public repositories matching this topic...

Language: All
Filter by language
All 585 Python 255 Jupyter Notebook 125 JavaScript 45 Java 18 HTML 13 C# 11 C++ 9 CSS 6 Go 5 R 5
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated
transformers

huggingface / transformers

Star 56.7k
Open

DeBERTa V3 Fast Tokenizer

10
ikergarcia1996
ikergarcia1996 commented Dec 10, 2021

🚀 Feature request

Fast Tokenizer for DeBERTA-V3 and mDeBERTa-V3

Motivation

DeBERTa V3 is an improved version of DeBERTa. With the V3 version, the authors also released a multilingual model "mDeBERTa-base" that outperforms XLM-R-base. However, DeBERTa V3 currently lacks a FastTokenizer implementation which makes it impossible to use with some of the example scripts (They require a Fa

Read more
Good First Issue
Find more good first issues
gluon-nlp

dmlc / gluon-nlp

Star 2.4k
Open

[Error Message] Improve error message in SentencepieceTokenizer when arguments are not expected.

6
preeyank5
preeyank5 commented Dec 3, 2020

Description

While using tokenizers.create with the model and vocab file for a custom corpus, the code throws an error and is not able to generate the BERT vocab file

Error Message

ValueError: Mismatch vocabulary! All special tokens specified must be control tokens in the sentencepiece vocabulary.

To Reproduce

from gluonnlp.data import tokenizers
tokenizers.create('spm', model_p

Read more
enhancement good first issue
Find more good first issues

JohnSnowLabs / nlu

Star 410

1 line for thousands of State of The Art NLP models in hundreds of languages The fastest and most accurate way to solve text problems.

sentiment-analysis text-classification entity-resolution nlu transformers language-detection pandas named-entity-recognition text-summarization seq2seq lemmatizer spell-checker text-translation dependency-parsing sentiment-classifier natural-language-understanding sentence-embeddings t5 streamlit bert-embedding
  • Updated Jan 6, 2022
  • Python
ArticutAPI

Droidtown / ArticutAPI

Star 347

API of Articut 中文斷詞 (兼具語意詞性標記)：「斷詞」又稱「分詞」，是中文資訊處理的基礎。Articut 不用機器學習，不需資料模型，只用現代白話中文語法規則，即能達到 SIGHAN 2005 F1-measure 94% 以上，Recall 96% 以上的成績。

nlp natural-language-processing nlu artificial-intelligence cws pos-tagging part-of-speech-tagger pos-tagger natural-language-understanding part-of-speech-embdding
  • Updated Jan 11, 2022
  • Python

Improve this page

Add a description, image, and links to the natural-language-understanding topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the natural-language-understanding topic, visit your repo's landing page and select "manage topics."

Learn more