Skip to content

Crawl sync option

Compare
Choose a tag to compare
@j-mendez j-mendez released this 24 Apr 19:20
  1. ability to crawl links in sync.
fn main() {
   // crawl one by one 
    let mut website: Website = Website::new("https://choosealicense.com");
    website.crawl_sync();
}

or via the cli.

spider -d https://rsseau.fr crawl -s

What's Changed

  • chore(log): add crate log default logger by @j-mendez in #42
  • feat(delay): add non blocking delay scheduling by @j-mendez in #43

Full Changelog: v1.6.1...v1.7.3