unittest opt #460

HYLcool · 2024-10-23T08:37:35Z

Add test coverage report
Allow to decide whether to keep the downloaded models during unittests.
Enable those skipped unittests for model-based OPs.

❌ Add processing speed benchmark (in the next PR)

…ustomizable

tests/run.py

* use coverage to check the unittest coverage

ceee62b

HYLcool self-assigned this Oct 23, 2024

HYLcool had a problem deploying to Testing October 23, 2024 08:37 — with GitHub Actions Failure

HYLcool added the enhancement New feature or request label Oct 23, 2024

* ignore trace for unknown strange file config-3.py

b68d7e1

HYLcool had a problem deploying to Testing October 23, 2024 11:36 — with GitHub Actions Failure

* ignore trace for unknown strange file config-3.py

ca25bf6

HYLcool temporarily deployed to Testing October 23, 2024 12:19 — with GitHub Actions Inactive

* ignore third-party packages and entrance of unittest

e09dc08

HYLcool temporarily deployed to Testing October 23, 2024 14:18 — with GitHub Actions Inactive

* ignore code of unittest

ed55cfb

HYLcool temporarily deployed to Testing October 24, 2024 02:57 — with GitHub Actions Inactive

HYLcool changed the title ~~[WIP] unittest coverage~~ [WIP] unittest opt Oct 28, 2024

* keep the downloaded models during unittest in default and make it c…

a5b15fb

…ustomizable

HYLcool temporarily deployed to Testing October 28, 2024 06:13 — with GitHub Actions Inactive

HYLcool added 2 commits October 28, 2024 14:28

* disable all skipping on some model-based unittest

f79fac0

* enable unittest

cc8795f

HYLcool had a problem deploying to Testing October 28, 2024 06:30 — with GitHub Actions Error

* skip initialization models when preparing vllm models

d2524ed

HYLcool had a problem deploying to Testing October 28, 2024 09:16 — with GitHub Actions Failure

* fix bug in remove_table_text_mapper from batched modification

c368d9f

HYLcool had a problem deploying to Testing October 29, 2024 01:58 — with GitHub Actions Failure

* set mem_required for tests of image_captioning_mapper

fc545f1

HYLcool had a problem deploying to Testing October 29, 2024 02:04 — with GitHub Actions Failure

* skip tests that might be OOM

7f6ba45

HYLcool had a problem deploying to Testing October 29, 2024 09:05 — with GitHub Actions Failure

HYLcool had a problem deploying to Testing October 30, 2024 01:35 — with GitHub Actions Failure

* skip 3 vllm-related OPs and 1 OOM OP

370cabd

HYLcool had a problem deploying to Testing October 30, 2024 10:09 — with GitHub Actions Failure

HYLcool had a problem deploying to Testing October 31, 2024 01:10 — with GitHub Actions Failure

HYLcool had a problem deploying to Testing October 31, 2024 03:40 — with GitHub Actions Failure

- avoid two tests

ff6e302

HYLcool temporarily deployed to Testing October 31, 2024 06:32 — with GitHub Actions Inactive

HYLcool marked this pull request as ready for review October 31, 2024 08:36

HYLcool requested review from yxdyc, drcege and Cathy0908 and removed request for yxdyc October 31, 2024 08:36

HYLcool added the priority:high in high priority label Oct 31, 2024

HYLcool changed the title ~~[WIP] unittest opt~~ unittest opt Oct 31, 2024

drcege reviewed Nov 1, 2024

View reviewed changes

tests/run.py Show resolved Hide resolved

drcege approved these changes Nov 1, 2024

View reviewed changes

HYLcool merged commit d185d54 into main Nov 1, 2024
3 checks passed

HYLcool deleted the opt/test_coverage branch November 1, 2024 09:10

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

unittest opt #460

unittest opt #460

HYLcool commented Oct 23, 2024 •

edited

Loading

unittest opt #460

unittest opt #460

Conversation

HYLcool commented Oct 23, 2024 • edited Loading

HYLcool commented Oct 23, 2024 •

edited

Loading