#

corpus-tools

Here are 62 public repositories matching this topic...

BLKSerene / Wordless

Star

An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation

multilingual language translation tokenizer corpus tagger literature corpus-linguistics lemmatizer corpus-tools corpus-processing corpus-statistics stopword corpus-analysis

Updated Oct 14, 2021
Python

bitextor

bitextor / bitextor

Star

Bitextor generates translation memories from multilingual websites

crawler dictionaries tokenizer machine-translation wget apertium neural-machine-translation warc tmx statistical-machine-translation corpus-generator httrack sentence-segmentation corpus-tools creepy corpus-processing hunalign parallel-corpora document-aligner bicleaner

Updated Oct 15, 2021
Python

grammarly / ua-gec

Star

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

natural-language-processing corpus dataset corpus-data corpus-tools gec nlp-datasets grammatical-error-correction ukrainian-language

Updated Jul 17, 2021
Python

ynop / audiomate

Star

Open

Check urls of datasets in code and documentation

3

ynop commented Oct 15, 2019

The urls used in the code and documentation should be checked for availability (As done for the readme in #87)

Places to check:

URLs in the CorpusDownloader classes
URLs in the code-doc of CorpusReader classes

Read more

help wanted good first issue

Open

Create a list of reader/writer names

Open

Dataset Collection

2

koskenni / beta

Star

An open source reimplementation of Benny Brodda's BETA in Python

open-source hyphenation beta linguistics string-manipulation corpus-tools string-rewriting benny-brodda

Updated Oct 28, 2019
Python

czcorpus / kontext

Star

An advanced, extensible web front-end for the Manatee-open corpus search engine

user-interface corpora corpus-linguistics corpus-tools

Updated Oct 14, 2021
TypeScript

silenterus / deepspeech-cleaner

Star

Multi-Language Dataset Cleaner/Creator for Mozilla's DeepSpeech Framework

machine-learning mozilla speech-recognition dataset-filtering dataset-creation dataset-manager multilanguage corpus-tools deepspeech audio-datasets

Updated Jul 25, 2019
Python

lennes / spect

Star

SpeCT - Speech Corpus Toolkit for Praat. Documentation: https://lennes.github.io/spect/

annotation analysis speech transcript corpus-linguistics transcription spoken-language praat corpus-tools speech-analysis conversational-speech speech-corpus spect

Updated Apr 12, 2021
HTML

LanguageMachines / PICCL

Star

A set of workflows for corpus building through OCR, post-correction and normalisation

nlp workflow ocr computational-linguistics corpus-linguistics folia corpus-tools

Updated Jan 12, 2021
Python

NathanDuran / Switchboard-Corpus

Star

Utilities for Processing the Switchboard Dialogue Act Corpus

dialogue corpus corpus-data corpus-tools switchboard dialogues corpus-processing dialogue-data switchboard-corpus dialogue-act

Updated Jan 24, 2021
Python

parallel-corpora-tools

M4t1ss / parallel-corpora-tools

Star

Tools for filtering and cleaning parallel and monolingual corpora for machine translation and other natural language processing tasks.

nlp language data-science natural-language-processing translation machine machine-translation natural-language neural-machine-translation corpora nmt filtering data-processing neural language-processing cleaning corpus-tools

Updated Sep 28, 2021
PHP

johnwdubois / rezonator

Star

Open

Change "GridView" to "Map View".

johnwdubois commented Sep 3, 2021

Change the old string "GridView" to "Map View". (Note the spacing.)
("GridView" still appears in the old Help section. Search for other places where it might appear as well.)

Read more

good first issue polish

Open

Enable user language option in IGT field mapping screen

Open

Don't use red for unit fields on import screen

Find more good first issues

uma-pi1 / OPIEC

Star

Reading the data from OPIEC - an Open Information Extraction corpus

nlp natural-language-processing wiki wikipedia corpus information-extraction dataset corpora corpus-data nlp-resources wikipedia-dump corpus-tools natural-language-understanding open-information-extraction dataset-interface wikipedia-corpus corpus-processing nlp-datasets

Updated Jun 12, 2019
Java

Helsinki-NLP / OpusFilter

Star

OpusFilter - Parallel corpus processing toolkit

nlp natural-language-processing machine-translation parallel-corpus corpus-tools corpus-processing

Updated Oct 12, 2021
Python

nickduran / align-linguistic-alignment

Star

Python library for extracting quantitative, reproducible metrics of multi-level alignment between two speakers in naturalistic language corpora.

python word2vec text-analysis nltk notebooks ngram-analysis corpus-tools conversation-analysis linguistic-analysis linguistic-alignment

Updated Sep 3, 2021
Python

NathanDuran / MRDA-Corpus

Star

Utilities for Processing the Meeting Recorder Dialogue Act Corpus

dialogue corpus corpus-data corpus-tools dialogues corpus-processing dialogue-act

Updated Jan 24, 2021
Python

praaline / Praaline

Star

Praaline is an open-source system to manage, annotate, visualise and analyse spoken language corpora

annotations corpus visualisation linguistics corpus-linguistics speech-processing corpus-builder corpus-tools speech-analysis spoken-language-processing

Updated Sep 25, 2021
C

jaytimm / corpuslingr

Star

A library of functions enabling complex corpus search in context (KWIC), search aggregation, bag-of-words building & keyphrase extraction.

corpus-tools corpus-processing corpus-search

Updated Jan 20, 2019
R

infraling / atomic

Star

Software for multi-level annotation of linguistic corpora

java annotation atomic corpus-linguistics eclipse-rcp corpus-tools

Updated Jan 15, 2020
Java

carlfm01 / librivox-tools

Star

Collector and speech cutter for librivox audiobooks

data-collector speech-to-text corpus-builder corpus-tools librivox

Updated Oct 11, 2019
C#

EdwardSeley / lyrics-corpora

Star

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

python music artists lyrics corpus songs python-api corpora corpus-linguistics scrapper scraping-websites corpus-tools billboard-charts

Updated Jul 2, 2018
Python

uma-pi1 / OPIEC-pipeline

Star

nlp natural-language-processing big-data wiki wikipedia bigdata information-extraction text-processing corpus-linguistics corpus-data nlp-apis nlp-resources corpus-generator corpus-builder corpus-tools natural-language-understanding open-information-extraction wikipedia-corpus corpus-processing nlp-datasets

Updated Oct 13, 2020
Java

wiragotama / TIARA-annotationTool

Star

An Interactive Tool for Annotating Discourse Structure and Text Improvement

nlp natural-language-processing annotation corpus corpus-linguistics corpus-data corpus-tools annotating-discourse-relations

Updated Sep 15, 2021
JavaScript

notesjor / corpusexplorer2.0

Star

Korpuslinguistik war noch nie so einfach...

data-science natural-language-processing text-mining data-mining sdk natural-language corpus text-analysis data-visualization linguistics corpora text-processing corpus-linguistics data-miner corpus-builder corpus-tools linguistic-corpora natural-language-understanding data-minig corpus-processing

Updated Sep 26, 2021
C#

Linguista / CQPweb-Instabox

Star

Script that sets up and configures an entire CQPweb server installation

linguistics cwb corpus-linguistics corpus-tools cqp corpus-processing opencorpusworkbench

Updated Dec 1, 2019
Shell

liao961120 / concordancer

Star

Searching in-memory corpus with Corpus Query Language (CQL)

python3 corpus-tools concordancer corpus-query-language

Updated Oct 11, 2021
Python

mikahama / python-korp

Sponsor Star

Library for Python to use Korp API

python corpus-linguistics corpus-tools korp-api

Updated Sep 11, 2020
Python

timarkh / tsakorpus

Star

Yet another search platform for linguistic corpora.

flask elasticsearch corpus linguistics corpus-linguistics corpus-tools linguistic-corpora language-documentation parallel-corpora media-aligned-corpora

Updated Oct 6, 2021
Python

Signbank / FinSL-signbank

Star

Web based database for sign language lexicons and corpuses. Fork of NGT-signbank (https://github.com/Signbank/Global-signbank).

sign-language linguistics corpus-tools signbank

Updated Sep 26, 2021
Python

CSCfi / Kielipankki-utilities

Star

Scripts for data conversion

vrt corpus-tools korp corpus-processing

Updated Oct 4, 2021
Python

Improve this page

Add a description, image, and links to the corpus-tools topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the corpus-tools topic, visit your repo's landing page and select "manage topics."