Pinned

1. trafilatura Public

   Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

   Python 618 81

2. htmldate Public

   Fast and robust date extraction from web pages, with Python or on the command-line

   Python 58 15

3. simplemma Public

   Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

   Python 64 3

4. py3langid Public

   Forked from saffsd/langid.py

   Faster, modernized fork of the language identification tool langid.py

   Python 9 3

5. courlan Public

   Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters

   Python 21 1

6. German-NLP Public

   Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

   253 43