Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update benchmark tool for otx2.1 #3652

Merged

Conversation

chuneuny-emily
Copy link
Contributor

@chuneuny-emily chuneuny-emily commented Jun 20, 2024

Summary

This PR makes the following improvements:

  1. Deterministic setting optimization: Eliminated redundant deterministic configurations, using user settings when available or defaulting to task-specific values.

  2. Add newly added models in OTX2.1: Added rtmdet for detection and instance segmentation, and maskrcnn_r50_tv for instance segmentation.

How to test

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have ran e2e tests and there is no issues.
  • I have added the description of my changes into CHANGELOG in my target branch (e.g., CHANGELOG in develop).​
  • I have updated the documentation in my target branch accordingly (e.g., documentation in develop).
  • I have linked related issues.

License

  • I submit my code changes under the same Apache License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2024 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

@chuneuny-emily chuneuny-emily marked this pull request as draft June 20, 2024 23:40
@chuneuny-emily chuneuny-emily marked this pull request as ready for review June 21, 2024 00:48
Copy link
Contributor

@eunwoosh eunwoosh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your work. I left some comments. Please take a look.

tests/perf/test_action.py Outdated Show resolved Hide resolved
tests/perf/test_anomaly.py Outdated Show resolved Hide resolved
tests/conftest.py Outdated Show resolved Hide resolved
sungchul2
sungchul2 previously approved these changes Jun 21, 2024
@chuneuny-emily chuneuny-emily enabled auto-merge (squash) June 21, 2024 01:37
@chuneuny-emily chuneuny-emily merged commit 78ee400 into openvinotoolkit:develop Jun 21, 2024
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
TEST Any changes in tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants