Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update MF submission format for multi-world challenge #138

Merged
merged 3 commits into from
Mar 31, 2023

Conversation

wqi
Copy link
Collaborator

@wqi wqi commented Mar 27, 2023

PR Summary

This PR updates the submission format for the motion forecasting challenge in preparation for the shift to multi-world evaluation in this year's CVPR challenge.

All new submissions to both the single-agent and multi-world phases of the motion forecasting challenge will be required to use this new format - which should only require slight modifications to the final step of existing methods.

This PR also introduces several new metrics to evaluate multi-world prediction, which build upon their existing single-agent counterparts.

Testing

Updated existing unit tests for metrics and the submission format. Unit tests for new multi-world metrics will be added in a follow-up PR.

In order to ensure this PR works as intended, it is:

  • unit tested.
  • other or not applicable (additional detail/rationale required)

Compliance with Standards

As the author, I certify that this PR conforms to the following standards:

  • Code changes conform to PEP8 and docstrings conform to the Google Python style guide.
  • A well-written summary explains what was done and why it was done.
  • The PR is adequately tested and the testing details and links to external results are included.

@wqi wqi requested a review from benjaminrwilson March 27, 2023 19:29
@wqi wqi force-pushed the feature/mf-challenge-2023-update branch from 6d9a5c8 to 52af0af Compare March 31, 2023 04:38
@benjaminrwilson benjaminrwilson merged commit 002a65c into main Mar 31, 2023
@benjaminrwilson benjaminrwilson deleted the feature/mf-challenge-2023-update branch March 31, 2023 15:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants