Significant performance degredation

[spenserblack]

Turns out gengo is once again much slower. Given the changes in #191, the most likely culprit is the Git source. Originally blobs were read and analyzed in parallel. Now they're only analyzed in parallel.

Edit: The biggest time-consumer seems to be calling file_source.overrides 🤔

Ideas

• Right now a FileSource returns a iterator over tuples of filenames and file contents. Perhaps the iterator should only yield filenames, and provide a method get_contents that takes that filename. That could possibly be easier to parallelize and boost performance.
• Similar to above, but filename() and contents() methods that take Self::Iter::Item and return the filename and contents.
• Go with the other idea for implementing multiple sources where they would be receive the analyze_blob function and return results.
  • Implement an overrides method
  • analyze_blob calls self.file_source.overrides
  • analyze passes analyze_blob to self.file_sources.handle

[spenserblack]

Bisect (predictably) points to e84c746