Skip to content

Time For A Restful Harvest

Compare
Choose a tag to compare
@L1ghtn1ng L1ghtn1ng released this 01 Jul 22:38
· 1423 commits to master since this release
82fe0f6

This is a big release due to the rest API being introduced and I expect the community will have fun playing with it. There are a lot of changes for this release. Please be aware of that when Spyse drop support for v3 of there API that module will break due to me not having a paid account to be able to update to the new version of the API. Community support on getting this module updated would be much appreciated.

The changes for this release are the following;

What's New

New Modules Added:
Anubis
BinaryEdge
Rocket Reach
ZoomEye

  • JSON output

  • More Information Collected:
    * Now collects ASNs and interesting urls
    * Shodan collects much more information

  • Fully Asynchronous Rest API written with FastAPI created, use restfulHarvest to start it

  • Added .dockerignore to decrease size of container

  • new unit tests

  • Added restfulHarvest to setup.py to get installed the same as theHarvester binary

  • Added new dependencies for the restAPI

Bug Fixes

  • Censys module is fixed thanks to thehappydinoa fixing this so we support the censys 2.0.x SDK

What's Changed

  • Removed exalead module (triggered captcha after one query and not very fruitful results)
  • Removed HTML reporting (can still be used if wanted with manual tweaking just use the code from older version)
  • Made screenshotting less resource intensive
  • CI changes
  • Removed pipenv files
  • Removed uneeded dependencies
  • Update DNS brute forcing lists to find more subdomains when doing a DNS brute force
  • Docker container works with version 4.0.0 of theHarvester and due to this was moved to Ubuntu due to compatibility issues with alpine
  • Update dependencies
  • Add new entries for new modules to api-keys.yaml
  • Misc changes all over the place