Skip to content

A very simple crawler, nothing you would use in production

Notifications You must be signed in to change notification settings

stefano/simple_crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

A simple crawler.

It requires python 3.

Build:

    $ virtualenv -p python3 .env
    $ . .env/bin/activate
    $ pip install -r requirements.txt

Usage:

    $ python crawler.py http://<root url>

About

A very simple crawler, nothing you would use in production

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages