-
Bugfixing skip query string options
-
not currently compatable with mongo 2.x + work to correct pending.
-
Add options to :skip_no_follow => false and :follow_subdomain => true
-
If :skip_no_follow => true, all links or pages that have nofollow tag will be ignore
-
If :follow_subdomain => true, all subdomain pages will be crawled
-
We can also set :follow_subdomain => [“abc.com”] to allow it to follow new domain.
Skipping up version numbers for first fork release!
*Forked from github.com/chriskite/anemone
*adding dev branches *updating misc files with fork information *commenting out non-compatable dependencies *updating to ruby 2.2.0 *updating to rspec 3 *updating gem versions
-
Bug fixes
-
Fix bug causing anchor links to have ‘#’ converted to ‘%23’
-