Skip to content

v0.1.22
Compare
Choose a tag to compare
@dchiquito dchiquito released this 01 Oct 17:30
· 4518 commits to master since this release
v0.1.22
d93a1df
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Optimize Celery tasks

  • Asset metadata validation is very fast, so it is now done in the request thread to reduce the number of tasks dispatched.
  • Version metadata validation is now done once a minute (configurable) rather than a new validation task being dispatched on every dandiset modification.
    During large uploads, each file upload would trigger it's own version metadata validation, which created an excessive number of tasks that were simply revalidating for no reason.
    This new scheme effectively debounces version metadata validation.
  • Draft metadata manifests are now written out whenever metadata is changed, rather than nightly.
Assets 2
Loading