[TVM] Add TVM Support #1390

sxjscience · 2020-10-19T06:55:29Z

Description

Add TVM test case + profiling after apache/tvm#6699 is merged.

Test case
Profile

Checklist

Essentials

PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
Changes are complete (i.e. I finished coding on this PR)
All changes have test coverage
Code is well-documented

cc @dmlc/gluon-nlp-team

github-actions · 2020-10-19T07:14:33Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T07:14:58Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T07:15:01Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

codecov · 2020-10-19T07:15:18Z

Codecov Report

Merging #1390 into master will decrease coverage by 0.22%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master    #1390      +/-   ##
==========================================
- Coverage   85.35%   85.12%   -0.23%     
==========================================
  Files          53       53              
  Lines        6959     6946      -13     
==========================================
- Hits         5940     5913      -27     
- Misses       1019     1033      +14

Impacted Files	Coverage Δ
src/gluonnlp/models/albert.py	`95.42% <ø> (-0.05%)`	⬇️
src/gluonnlp/models/bert.py	`94.80% <ø> (-0.06%)`	⬇️
src/gluonnlp/models/electra.py	`76.90% <ø> (+0.44%)`	⬆️
src/gluonnlp/models/mobilebert.py	`87.85% <ø> (-0.10%)`	⬇️
src/gluonnlp/models/roberta.py	`93.61% <ø> (-0.06%)`	⬇️
src/gluonnlp/utils/lazy_imports.py	`59.75% <100.00%> (+5.43%)`	⬆️
src/gluonnlp/utils/misc.py	`59.20% <100.00%> (+0.37%)`	⬆️
src/gluonnlp/data/loading.py	`78.11% <0.00%> (-5.29%)`	⬇️
src/gluonnlp/data/filtering.py	`78.26% <0.00%> (-4.35%)`	⬇️
src/gluonnlp/data/tokenizers/subword_nmt.py	`78.50% <0.00%> (-0.94%)`	⬇️
... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7910d6d...1e1b05d. Read the comment docs.

github-actions · 2020-10-19T07:16:01Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T07:36:21Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T07:36:34Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T17:43:29Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T18:56:08Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T18:59:03Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T19:15:09Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T19:17:52Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T19:19:49Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T19:42:53Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-19T19:49:48Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-23T19:58:58Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-23T22:08:05Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T00:50:59Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T00:51:49Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T04:31:21Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T04:32:42Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T05:16:18Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T05:16:35Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T05:37:13Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T06:47:22Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T06:49:20Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

github-actions · 2020-10-24T08:44:55Z

The documentation website for preview: http://gluon-nlp-staging.s3-accelerate.dualstack.amazonaws.com/PR1390/add_tvm/index.html

sxjscience · 2020-10-24T10:08:32Z

@leezu I’ve removed the LLVM installation code, and the CI has passed.

szha

thanks! this is an important integration

tqchen · 2020-10-24T23:39:23Z

FYI https://github.com/tlc-pack/tlcpack now provides nightly thirdparty build for tvm, packages can be installed from https://anaconda.org/tlcpack if you are using conda, this might be easier than building tvm from scratch every time

sxjscience added 4 commits October 18, 2020 23:41

Update test_models.py

c35bf54

Update lazy_imports.py

0f16b3c

Update test_models.py

c6cfa1c

Update test_models.py

958971b

sxjscience added 2 commits October 19, 2020 00:16

Update unittests.yml

3b1e095

Update unittests.yml

1e3b6c3

Update unittests.yml

0928ee3

sxjscience added 2 commits October 19, 2020 11:33

Update test_models.py

74b0cee

Update test_models.py

d76ddaa

sxjscience added 2 commits October 19, 2020 11:56

Update test_models.py

cafbc45

Update test_models.py

3ebaf9f

use the new API

f4d4bd4

sxjscience added 2 commits October 19, 2020 12:29

update dockerfile

b2ee011

update

c10957b

move recommended flags to misc

4f7285e

sxjscience added 2 commits October 23, 2020 14:45

Delete run_batch_backbone_profiling.sh

2573b20

remove

71f6b8e

sxjscience added 2 commits October 23, 2020 17:31

Update test_models.py

73742fb

Merge remote-tracking branch 'upstream/master' into add_tvm

dd1e499

sxjscience added 2 commits October 23, 2020 21:10

remove all hybridize

0c01e46

Update test_models_roberta.py

4947342

sxjscience added 2 commits October 23, 2020 21:54

try to disable the check of roberta base

1bedbfa

test hybridize

b8d2518

Update test_models.py

30b561c

sxjscience added 2 commits October 23, 2020 23:24

Update test_models.py

baa83d0

Update test_models.py

a99cda6

Update test_models.py

1e1b05d

szha approved these changes Oct 24, 2020

View reviewed changes

sxjscience merged commit 8c8b0c9 into dmlc:master Oct 24, 2020

sxjscience mentioned this pull request Oct 25, 2020

[TVM Integration] Improve TVM Integration: Tutorial + Investigating Numerical Issue #1401

Open

3 tasks

sxjscience mentioned this pull request Dec 31, 2020

[Frontend][MXNet] Importer Missing Operators apache/tvm#7186

Closed

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[TVM] Add TVM Support #1390

[TVM] Add TVM Support #1390

sxjscience commented Oct 19, 2020 •

edited

Loading

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

codecov bot commented Oct 19, 2020 •

edited

Loading

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 23, 2020

github-actions bot commented Oct 23, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

sxjscience commented Oct 24, 2020 •

edited

Loading

szha left a comment

tqchen commented Oct 24, 2020 •

edited

Loading

[TVM] Add TVM Support #1390

[TVM] Add TVM Support #1390

Conversation

sxjscience commented Oct 19, 2020 • edited Loading

Description

Checklist

Essentials

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

codecov bot commented Oct 19, 2020 • edited Loading

Codecov Report

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 19, 2020

github-actions bot commented Oct 23, 2020

github-actions bot commented Oct 23, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

github-actions bot commented Oct 24, 2020

sxjscience commented Oct 24, 2020 • edited Loading

szha left a comment

Choose a reason for hiding this comment

tqchen commented Oct 24, 2020 • edited Loading

sxjscience commented Oct 19, 2020 •

edited

Loading

codecov bot commented Oct 19, 2020 •

edited

Loading

sxjscience commented Oct 24, 2020 •

edited

Loading

tqchen commented Oct 24, 2020 •

edited

Loading