Repositories list

• library-of-alexandria

  Public
  Library of Alexandria (LoA in short) is a project that aims to collect and archive documents from the internet.

  archivinglibrary-of-alexandria

  Java

  •

  MIT License

  •1•112•14•2•Updated Jul 5, 2024Jul 5, 2024

• library-of-alexandria.github.io

  Public
  The official website of the Library of Alexandria project.

  documentationlibrary-of-alexandria

  HTML

  •0•1•0•1•Updated May 16, 2024May 16, 2024

• file-collector

  Public
  Java

  •

  MIT License

  •0•0•4•0•Updated Nov 14, 2021Nov 14, 2021

• document-location-database

  Public
  MIT License

  •0•0•0•0•Updated Oct 18, 2021Oct 18, 2021

• url-collector

  Public
  An application that crawls the Common Crawl corpus for URLs with the specified file extensions.

  crawlercommon-crawlurl-crawler

  Java

  •

  MIT License

  •0•0•2•0•Updated Oct 15, 2021Oct 15, 2021

• java-warc

  Public
  Read Web ARChive (WARC) files in Java.

  javalibrarywarc+ 1web-archive

  Java

  •

  Apache License 2.0

  •6•5•0•0•Updated Sep 12, 2021Sep 12, 2021

• common-crawl-client

  Public
  This library is a very lightweight client to Common Crawl's WARC files.

  warccommon-crawl

  Java

  •0•0•0•0•Updated Jan 16, 2020Jan 16, 2020