Tests All necessary testing functionality (Mocks, Nulls, etc.) should be implemented, the tests themselves just need to be written Better HTTP error handling Retry queue? Failed items set? Exception handling Stopping mid-crawl