Archive Team

Repositories

• ArchiveBot

  ArchiveBot, an IRC bot for archiving websites

  javascript ruby python irc archiving haxe
  Python MIT 50 202 127 15 Updated Dec 5, 2020

• google-poly-grab

  Archiving Google Poly.
  0 0 0 0 Updated Dec 5, 2020

• chrome-web-store-grab

  Forked from OrIdow6/chrome-web-store-grab
  Lua Unlicense 1 0 0 0 Updated Dec 1, 2020

• chrome-web-store-items

  Forked from OrIdow6/chrome-web-store-items
  1 0 0 0 Updated Dec 1, 2020

• dronetest-grab
  Dockerfile 1 0 0 0 Updated Nov 30, 2020

• urls-grab

  Archiving URLs (outlinks) from a variety of sources.
  Python Unlicense 1 0 0 0 Updated Nov 23, 2020

• twitch-grab
  0 0 0 0 Updated Nov 19, 2020

• nagi-grab

  Archiving nagi.ee.
  Lua Unlicense 0 0 0 0 Updated Nov 18, 2020

• nagi-items

  Managing items for nagi-grab.
  0 0 0 0 Updated Nov 18, 2020

• kinja-grab

  Archiving kinja.com.
  Lua Unlicense 0 0 0 0 Updated Nov 16, 2020

• youtube-playlistnotes-grab

  Archiving public notes from YouTube playlists.
  Lua Unlicense 1 2 0 1 Updated Nov 12, 2020

• parler-grab

  Archiving Parler.
  0 0 0 0 Updated Nov 11, 2020

• terroroftinytown-client-grab

  The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project
  Python Unlicense 7 19 2 0 Updated Nov 10, 2020

• pastebin-grab

  Archiving pastebin
  Lua Unlicense 1 2 0 0 Updated Nov 10, 2020

• google-sites-grab

  Archiving Google Sites Classic.
  Lua Unlicense 2 3 1 0 Updated Nov 10, 2020

• grab-site

  The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

  crawler spider archiving crawl warc
  Python 67 646 56 (20 issues need help) 4 Updated Nov 5, 2020

• standalone-readme-template

  Readme instructions template for manually running pipeline grab scripts outside the warrior
  CC0-1.0 13 1 1 0 Updated Nov 3, 2020

• urls-items

  Managing items for urls-grab.
  0 0 0 0 Updated Nov 1, 2020

• grab-base-df

  Base Dockerfile for warrior project grab scripts
  Dockerfile MIT 1 2 0 0 Updated Oct 31, 2020

• fotoalbum-grab

  Archiving fotoalbum.ee.
  Lua Unlicense 0 0 0 0 Updated Oct 31, 2020

• github-grab

  Archiving GitHub
  Lua Unlicense 0 2 0 0 Updated Oct 31, 2020

• mercurial-grab

  Archiving mercurial repositories.
  Lua Unlicense 1 0 0 1 Updated Oct 31, 2020

• reddit-grab

  Grabbing everything from reddit.
  Lua Unlicense 2 3 0 0 Updated Oct 31, 2020

• albumee-grab

  Archiving album.ee.
  Lua Unlicense 0 0 0 0 Updated Oct 31, 2020

• google-sites-items

  Managing items for google-sites-grab.
  Python 0 0 0 0 Updated Oct 30, 2020

• Ubuntu-Warrior

  Scripts to build and boot warrior virtual machine containing Docker
  Shell Unlicense 4 9 6 0 Updated Oct 29, 2020

• wget-lua

  Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

  crawler spider lua crawling archiving wget crawl
  C GPL-3.0 6 15 4 1 Updated Oct 29, 2020

• archiveteam-megawarc-factory

  Some scripts to process ArchiveTeam uploads
  Shell 5 1 1 1 Updated Oct 29, 2020

• megawarc

  Forked from alard/megawarc

  Nondestructive warc-in-tar to warc conversion
  Python 5 2 0 0 Updated Oct 30, 2020

• docker-hub-items

  Managing items for docker-hub-grab.
  0 0 0 0 Updated Oct 26, 2020