This repository has been archived by the owner on Mar 10, 2020. It is now read-only.
Releases: blurHY/HorizonSpider
Releases · blurHY/HorizonSpider
4.0.0
3.1.0
3.0.1
First release for node HorizonSpider
3.0.0 Update README.md
Fixed division by zero
A site has no file.But zeronet says it's downloaded.Maybe it's a bug of zeronet.
Feeds crawling,File scanning and Site Info
- Feeds crawling with NLP libs: jieba for Chinese and rake-nltk for the others
- File scanning: Scan links in site files and send request to zeroent
- Site info: Basic site information