block_all_robots

[dogweather]

While a site is in development, it's common to block all robots with html meta tags and robots.txt. This test asserts that no such setting is in place. So it's a nice test that this easy-to-forget thing has been taken care of when putting an app in production. We've also seen these blocks get accidentally enabled, which is a bad thing, and hard to debug.

It will pass, however, if partial blocks are set up for certain robots or certain parts of the site, because production sites often use those.

[dogweather]

This could be rolled up into the be_setup_for_production matcher.