Skip to content
This repository has been archived by the owner on Feb 3, 2018. It is now read-only.

Implement persistent caching in SourceMgr #130

Open
sdboyer opened this issue Dec 30, 2016 · 2 comments
Open

Implement persistent caching in SourceMgr #130

sdboyer opened this issue Dec 30, 2016 · 2 comments

Comments

@sdboyer
Copy link
Owner

sdboyer commented Dec 30, 2016

With additional testing being done as part of the new tool, it's increasingly clear that we really, really need to get persistent, disk-backed caching into place. There are four basic things we need to cache:

  1. Version lists - all the versions available for a source
  2. Manifest and Lock - for a given rev and a particular analyzer, these should be permanently cacheable
  3. PackageTree - for a given rev and gps version, these should be permanently cacheable
  4. Project root computations - those that require a go-get metadata query

The biggest immediate question is how to actually store it on disk. For the first three, at least, discrete files would probably work. However, I'm inclined to store everything together using bolt. That'll cover the last case more easily, especially because it is likely to require prefix queries; it'll also probably make it a bit cleaner to store TTLs.

(supercedes #8)

@sdboyer
Copy link
Owner Author

sdboyer commented Apr 4, 2017

With #196 finally done, the road to this is pretty clear. There's even a TODO exactly where a handle to it should be dropped in 😄

We do need to pick a storage lib for it. LevelDB would be fine, as would Bolt.

@fabulous-gopher
Copy link

This issue was moved to golang/dep#431

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants