news-please - an integrated web crawler and information extractor for news that just works

Wiktionary dump file parser and multilingual data extractor

SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ...

A framework for creating semi-automatic web content extractors

Crawl and extract (regular or onion) webpages through TOR network

Python based Open Source ETL tools for file crawling, document processing (text extraction, OCR), content analysis (Entity Extraction & Named Entity Recognition) & data enrichment (annotation) pipelines & ingestor to Solr or Elastic search index & linked data graph database

URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.

适用于高性能系统的多进程解压缩软件(A multiprocess decompression software for high-performance system)

burpsuite extension for check and extract sensitive request parameter

Python reader of LabVIEW RSRC files (VI, CTL, LLB). File format description on the Wiki.

Extract dates from text

Extracting features from URLs to build a data set for machine learning. The purpose is to find a machine learning model to predict phishing URLs, which are targeted to the Brazilian population.

Extract article or news by url or html, parse the title and content, output in markdown format.

Basic website cloner written in Python

This Python script extracts Macromedia / Adobe Director movies and casts from Windows and Mac executables.

Extract frames from videos in Python using OpenCV.

A tool to help you get image info.

Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler

A mostly universal file extraction library and CLI tool to extract almost any archive in a reasonably safe way on Linux, macOS and Windows.

an async ETL tool written in Python.