Skip to content
#

language-classification

Star

Here are 20 public repositories matching this topic...

Language: All
Filter by language
All 20 Python 8 Go 3 Jupyter Notebook 3 Rust 2 Smalltalk 2 Kotlin 1 Scala 1
Sort: Best match
Sort options
Best match Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

oscar-corpus / ungoliant

Star 38
Open

[Feature request] Train a classifier to better classify languages

Muhtasham
Muhtasham commented Oct 5, 2021

Is your feature request related to a problem? Please describe.
Since the Oscar is limited by the fasttext language classifier which was trained on Wikipedia, the datasets contain also the sentences in other languages. For instance, Tajik (tg.txt) language contains large chunks of Uzbek sentences in Cyrillic script

Describe the solution you'd like
Train new models using other data othe

Read more
enhancement help wanted good first issue

vishnukanduri / Language-Classification-using-Naive-Bayes-in-Python

Star 0

Classified sentences into one of Slovak, Czech, and English. Implemented relevant preprocessing steps, addressed the class imbalance in training set by employing the learned theory of Naive Bayes Models, and implementing subword units.

visualization nlp natural-language-processing exploratory-data-analysis vectorization data-cleaning language-classification naive-bayes-implementation subword-units subwords
  • Updated Jun 4, 2020
  • Smalltalk

Improve this page

Add a description, image, and links to the language-classification topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the language-classification topic, visit your repo's landing page and select "manage topics."

Learn more