-
Notifications
You must be signed in to change notification settings - Fork 2
Road Map
Michael Telford edited this page Jul 1, 2024
·
98 revisions
Raise an issue if you have a feature request.
Nothing below is set in stone (until it's been implemented) and the order doesn't matter. Primary and Secondary refer to the importance of the change, not the amount of work or even when it'll be implemented. If in doubt, reach out and ask!
- ...
- ...
- Use
refine
instead ofcore_ext
.
- Try out lightweight alternatives to
nokogiri
e.g.ox
,rexml
etc. How much lighter are they as a dep? How much faster - benchmark? How much code needs changed? Do they provide as much functionality? Do they require native C extensions?
- How To Crawl A Website
- How To Crawl Locally
- How To Crawl More Than Just HTML
- How To Derive Crawl Statistics
- How To Extract Content
- How To Handle Redirects
- How To Index
- How To Multi-Thread
- How To Parse A URL
- How To Parse Javascript
- How To Prevent Indexing
- How To Use A Database
- How To Use Last Response
- How To Use The DSL
- How To Use The Executable
- How To Use The Logger
- How To Write A Database Adapter