Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up handling of large numbers of transform entities #7300

Merged
merged 5 commits into from
Aug 28, 2024

Conversation

jleibs
Copy link
Member

@jleibs jleibs commented Aug 28, 2024

What

Resolves: #7292

Halves the time spent in execute_systems when using many Transforms.

  • TransformContext uses a store subscriper to track which components are non-empty and only queries those from the store.
  • Arrows visualizer no longer queries for overrides on the unused transform components since those are fetched from the transform context manager anyways.

Before:
image

After:
image

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

@jleibs jleibs added 🚀 performance Optimization, memory use, etc include in changelog labels Aug 28, 2024
@jleibs jleibs changed the title Track which components are used by each transformed entity Speed up handling of large numbers of transform entities Aug 28, 2024
@jleibs jleibs marked this pull request as ready for review August 28, 2024 13:32
@teh-cmc teh-cmc self-requested a review August 28, 2024 13:40
@teh-cmc
Copy link
Member

teh-cmc commented Aug 28, 2024

Would you say this:

?

@jleibs
Copy link
Member Author

jleibs commented Aug 28, 2024

Would you say this: Fixes #7292

I'm going to mark it as resolves for now. Just compared release build between 0.18 and o.17 and they both end up in the ballpark of 3.3ms for system execution.

@jleibs jleibs merged commit 3fdc7c1 into main Aug 28, 2024
35 checks passed
@jleibs jleibs deleted the jleibs/speedup_transforms branch August 28, 2024 14:34
jleibs added a commit that referenced this pull request Aug 28, 2024
### What
Resolves: #7292

Halves the time spent in `execute_systems` when using many Transforms.
- TransformContext uses a store subscriper to track which components are
non-empty and only queries those from the store.
- Arrows visualizer no longer queries for overrides on the unused
transform components since those are fetched from the transform context
manager anyways.

Before:

![image](https://github.com/user-attachments/assets/90137375-087a-47ee-8e76-6cb13b46f4cf)

After:

![image](https://github.com/user-attachments/assets/beab559a-2d72-49da-8403-48c057e2a811)


### Checklist
* [x] I have read and agree to [Contributor
Guide](https://github.com/rerun-io/rerun/blob/main/CONTRIBUTING.md) and
the [Code of
Conduct](https://github.com/rerun-io/rerun/blob/main/CODE_OF_CONDUCT.md)
* [x] I've included a screenshot or gif (if applicable)
* [x] I have tested the web demo (if applicable):
* Using examples from latest `main` build:
[rerun.io/viewer](https://rerun.io/viewer/pr/7300?manifest_url=https://app.rerun.io/version/main/examples_manifest.json)
* Using full set of examples from `nightly` build:
[rerun.io/viewer](https://rerun.io/viewer/pr/7300?manifest_url=https://app.rerun.io/version/nightly/examples_manifest.json)
* [x] The PR title and labels are set such as to maximize their
usefulness for the next release's CHANGELOG
* [x] If applicable, add a new check to the [release
checklist](https://github.com/rerun-io/rerun/blob/main/tests/python/release_checklist)!
* [x] If have noted any breaking changes to the log API in
`CHANGELOG.md` and the migration guide

- [PR Build Summary](https://build.rerun.io/pr/7300)
- [Recent benchmark results](https://build.rerun.io/graphs/crates.html)
- [Wasm size tracking](https://build.rerun.io/graphs/sizes.html)

To run all checks from `main`, comment on the PR with `@rerun-bot
full-check`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
include in changelog 🚀 performance Optimization, memory use, etc
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Performance regression with many poses
2 participants