[Meta Schedule] Evolutionary Search #522

zxybazh · 2021-11-24T01:53:01Z

Implemented the evolutionary search strategy, c++ part done and working on python-side classes. Functions follow the design of Previous implementation.

zxybazh · 2021-11-24T08:18:03Z

Done with tests added. One problem is that the current implementation might produce less than expected candidates each time because of deduplication, and initial sampling does not consider duplication problem which might be troublesome.

src/target/target_kind.cc

junrushao

Did a pass over everything except the main impl

include/tvm/meta_schedule/search_strategy.h

python/tvm/meta_schedule/search_strategy/evolutionary_search.py

src/meta_schedule/utils.h

src/meta_schedule/search_strategy/evolutionary_search.cc

src/meta_schedule/utils.h

src/meta_schedule/search_strategy/evolutionary_search.cc

src/meta_schedule/utils.h

src/meta_schedule/search_strategy/evolutionary_search.cc

junrushao · 2021-11-30T07:08:23Z

Goals for refactoring:

~~Allow customization of all the retry-counts~~
~~Pack every the per-thread data structure into a struct~~
~~Consider completely removing dependency to CachedTrace if possible~~
~~Misc. see comments above~~

src/meta_schedule/search_strategy/evolutionary_search.cc

Fix cost model comment. Finish evolutionary seaarch. Remove extra code. Fix compile. Add comments. Add python part. Ad test. Update other files & comments.

[Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com>

* annotate * annotate * lint * test * fix * fix * fix

…on-Block (#509)

* Blockize & Tensorize * Update tensor intrin * Fix blockized & Recalculate affine flags * Cleanup utils.cc * Add test cases of blockize * Re-enable affine flag checking

python/tvm/meta_schedule/search_strategy/evolutionary_search.py

src/meta_schedule/search_strategy/evolutionary_search.cc

zxybazh · 2021-12-05T22:41:57Z

Fixed all issues and got 3 issues remaining discussion.

zxybazh · 2021-12-06T19:48:37Z

All issues fixed and passed tests! Ready for another round of review.

src/meta_schedule/tune_context.cc

src/meta_schedule/search_strategy/evolutionary_search.cc

junrushao · 2021-12-06T20:38:43Z

src/meta_schedule/search_strategy/evolutionary_search.cc

+  std::vector<CachedTrace> pruned;
+  pruned.reserve(measured.size() + unmeasured.size());
+  for (const CachedTrace& entry : measured) {
+    if (entry.Defined()) {


I guess it's always defined, so let's switch to :

ICHECK(entry.defined())

I think for unmeasured it's always defined. I am confirming it for measured ones because it seems I need to make sure measured_traces's size is equal to num in that case.

src/meta_schedule/search_strategy/evolutionary_search.cc

zxybazh · 2021-12-06T23:09:21Z

All fixed.

junrushao

Finally! Thank you @zxybazh for the great work!!

[Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) [TensorIR] GetProducer, GetConsumer (#506) [MetaScheduleRefactor] Annotate&Unannotate (#505) [MetaSchedule] Multi-Level-Tiling & Auto-Inline (#503) [Tests] Add unittests for auto-inline and multi-level-tiling (#508) [Meta Schedule] Minor Fixes (#507) [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (#499) [Meta Schedule] Add Helper Function & Minor Modification (#512) [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll (#513) [Meta Schedule] Feature Extractor & Cost Model (#510) Blockize & Tensorize (#514) Layout Rewriting: Suggest-Index-Map (#520) [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (#516) [Meta Schedule] Per-Store-Feature (#521) Add traced schedule for blockize & tensorize (#526) [Meta Schedule] Add XGBoost Model & Random Model (#519) User-Interface: Tune-TIR (#525) User-Interface: Tune-TE (#527) [Minor] More logging on python (#528) Get CUDA tuning working (#529) [MetaSchedule] TensorRT BYOC (#518) [BugFix] LocalBuilder API (#531) [Meta Schedule] Add Cost Model Update Measure Callback (#530) [Bugfix] BuilderInput with default params (#532) [MetaSchedule] Mutator-Tile-Size, Mutate-Parallel, Mutate-Unroll (#534) [Meta Schedule] Evolutionary Search (#522) [BugFix] Remove duplicated definition of MakeMultinomialSampler (#535) [Meta Schedule] Fix some bugs (#537) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com>

[Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) [TensorIR] GetProducer, GetConsumer (#506) [MetaScheduleRefactor] Annotate&Unannotate (#505) [MetaSchedule] Multi-Level-Tiling & Auto-Inline (#503) [Tests] Add unittests for auto-inline and multi-level-tiling (#508) [Meta Schedule] Minor Fixes (#507) [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (#499) [Meta Schedule] Add Helper Function & Minor Modification (#512) [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll (#513) [Meta Schedule] Feature Extractor & Cost Model (#510) Blockize & Tensorize (#514) Layout Rewriting: Suggest-Index-Map (#520) [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (#516) [Meta Schedule] Per-Store-Feature (#521) Add traced schedule for blockize & tensorize (#526) [Meta Schedule] Add XGBoost Model & Random Model (#519) User-Interface: Tune-TIR (#525) User-Interface: Tune-TE (#527) [Minor] More logging on python (#528) Get CUDA tuning working (#529) [MetaSchedule] TensorRT BYOC (#518) [BugFix] LocalBuilder API (#531) [Meta Schedule] Add Cost Model Update Measure Callback (#530) [Bugfix] BuilderInput with default params (#532) [MetaSchedule] Mutator-Tile-Size, Mutate-Parallel, Mutate-Unroll (#534) [Meta Schedule] Evolutionary Search (#522) [BugFix] Remove duplicated definition of MakeMultinomialSampler (#535) [Meta Schedule] Fix some bugs (#537) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> Co-authored-by: Xiyou Zhou <xiyou@octoml.ai>

* Squashed commit [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) [TensorIR] GetProducer, GetConsumer (#506) [MetaScheduleRefactor] Annotate&Unannotate (#505) [MetaSchedule] Multi-Level-Tiling & Auto-Inline (#503) [Tests] Add unittests for auto-inline and multi-level-tiling (#508) [Meta Schedule] Minor Fixes (#507) [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (#499) [Meta Schedule] Add Helper Function & Minor Modification (#512) [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll (#513) [Meta Schedule] Feature Extractor & Cost Model (#510) Blockize & Tensorize (#514) Layout Rewriting: Suggest-Index-Map (#520) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> * [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (#516) * parallel vectorize unroll & random compute location * rebased * [Meta Schedule] Per-Store-Feature (#521) * [Meta Schedule] Add XGBoost Model & Random Model (#519) * Squashed commit [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> [TensorIR] GetProducer, GetConsumer (#506) [MetaScheduleRefactor] Annotate&Unannotate (#505) * annotate * annotate * lint * test * fix * fix * fix [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) Fix sttr func & schedule naming. Fix schedule -> sch. Add feature extractor. Fix init. Add cost model. Remove unused include. [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (#499) * wip fix * revoke change to gallery * split postprocessors to separate files * rename attrs * minor * minor tweak on utils.h * refactor disallow-dynamic-loop * refactor verify_gpu_code * succesfully give up refactoring parallelize-vectorize-unroll * python structuring * unittests Co-authored-by: Junru Shao <junrushao1994@gmail.com> Fix issues. Fix init. Finish random model part. Finish xgb model. Minor fix. Rebase. Add init. Await refactor of callback. Update a bit on the test case. Move impos. Minor fix. More fixes. Remove unused import. Fix per store feature test. Update model save / load. * Fix model save / load with tar. * Fix issues. * Remove dup. Co-authored-by: Junru Shao <junrushao1994@gmail.com> * User-Interface: Tune-TIR (#525) * User-Interface: Tune-TIR * fix fix fix * User-Interface: Tune-TE (#527) * fix a lot of issues * Add tune-te * Get CUDA tuning working (#529) * [Meta Schedule] Evolutionary Search (#522) * Checkpoint. Fix cost model comment. Finish evolutionary seaarch. Remove extra code. Fix compile. Add comments. Add python part. Ad test. Update other files & comments. * Squashed commit [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> * [TensorIR] GetProducer, GetConsumer (#506) * [MetaScheduleRefactor] Annotate&Unannotate (#505) * annotate * annotate * lint * test * fix * fix * fix * [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) * Blockize & Tensorize (#514) * Blockize & Tensorize * Update tensor intrin * Fix blockized & Recalculate affine flags * Cleanup utils.cc * Add test cases of blockize * Re-enable affine flag checking * Checkpoint. Fix cost model comment. Finish evolutionary seaarch. Remove extra code. Fix compile. Add comments. Add python part. Ad test. Update other files & comments. Fix random seed bug. Minor fix. Fix num-cores. Add docs. Check point. Add max_fail_cnt. Minor fix. Minor fix. Segfault. Fix pointers to trace. Test fix. Remove measure callbacks. Refactor a bit. Split function. Adjust variable name. Minor fixes. Add mutator probs to TuneContext. Add token. Fix loops. Remove include. Add has workload for database. Add check. Add concurrent bitmask. * Fix TuneContext. * Fix haash & stuff. * Modifyy shash. * Remove trace field. * Minor fix. * Fix cbmask. * Fix numbers. Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> * [BugFix] Remove duplicated definition of MakeMultinomialSampler (#535) * Tune relay. * [FIX] Simplify during create prim func (#9691) * Further add interface. * Remove unused import * Fix rebase. * Renmove unused module. Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com>

[Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (#485) [Meta Schedule][M3c] PostOrderApply (#486) Fix Post Order Apply (#490) [MetaSchedule] Relay Integration (#489) [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (#492) Fix replay trace. (#493) [M3c][Meta Schedule] Implement the Replay Func class. (#495) [PR] Test script for meta-schedule task extraction. Interface to load… (#494) [Meta Schedule Refactor] Get child blocks (#500) Read-at && Write-at (#497) [M3c][Meta Schedule] Measure Callbacks (#498) [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (#496) [MetaSchedule] Sample-Perfect-Tile (#501) [MetaSchedule] TE Workloads (#502) [TensorIR] GetProducer, GetConsumer (#506) [MetaScheduleRefactor] Annotate&Unannotate (#505) [MetaSchedule] Multi-Level-Tiling & Auto-Inline (#503) [Tests] Add unittests for auto-inline and multi-level-tiling (#508) [Meta Schedule] Minor Fixes (#507) [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (#509) [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (#499) [Meta Schedule] Add Helper Function & Minor Modification (#512) [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll (#513) [Meta Schedule] Feature Extractor & Cost Model (#510) Blockize & Tensorize (#514) Layout Rewriting: Suggest-Index-Map (#520) [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (#516) [Meta Schedule] Per-Store-Feature (#521) Add traced schedule for blockize & tensorize (#526) [Meta Schedule] Add XGBoost Model & Random Model (#519) User-Interface: Tune-TIR (#525) User-Interface: Tune-TE (#527) [Minor] More logging on python (#528) Get CUDA tuning working (#529) [MetaSchedule] TensorRT BYOC (#518) [BugFix] LocalBuilder API (#531) [Meta Schedule] Add Cost Model Update Measure Callback (#530) [Bugfix] BuilderInput with default params (#532) [MetaSchedule] Mutator-Tile-Size, Mutate-Parallel, Mutate-Unroll (#534) [Meta Schedule] Evolutionary Search (#522) [BugFix] Remove duplicated definition of MakeMultinomialSampler (#535) [Meta Schedule] Fix some bugs (#537) Initiate Experiments for CPU Performance Alignment with Ansor (#538) [Meta Schedule] Tweak experiment scripts (#539) [Meta Schedule] Initiate experiments on CUDA (#540) [TIR][Schedule] Buffer transform (#523) Auto Tensor Core (#524) Working on Evo Search (#542) [Meta Schedule] Add Replay Tuning Interface (#543) Evolutionary Search on CPU (#544) Misc improvement over the error message (#545) [TIR][Schedule] Software pipelining (#533) [Meta Schedule Refactor] fixing unit tests (#547) [MetaSchedule] Mutator-Compute-Location (#548) Misc Improvement of Evolutionary Search (#549) Hotfix for software pipeline (#552) Misc Improvement (#550) [Cherry-Pick][TensorIR] Primitive "SetScope" (#9738) (#555) Rule RFactor (#551) [MemHammer] Rewrite Rules (#554) [MetaSchedule] Schedule Rule: Cross-Thread Reduction (#556) [MetaSchedule] Performance Alignment - NRM and SFM (CUDA) (#559) [MetaSchedule] Perf Alignment - NRM on CUDA (#560) [TIR] Reorder the block iters of the blocks generated by RFactor (#561) Co-authored-by: Siyuan Feng <Hzfengsy@sjtu.edu.cn> Co-authored-by: Bohan Hou <32121147+spectrometerHBH@users.noreply.github.com> Co-authored-by: Hongyi Jin <3231950289@qq.com> Co-authored-by: Ruihang Lai <lairuihangdongdong@qq.com> Co-authored-by: Junru Shao <junrushao1994@gmail.com> Co-authored-by: Wuwei Lin <wuwei@apache.org> Co-authored-by: Sunghyun Park <49998730+sunggg@users.noreply.github.com> Co-authored-by: Xiyou Zhou <xiyou@octoml.ai>

zxybazh changed the title ~~[WIP][Meta Schedule] Evolutionary Search~~ [Meta Schedule] Evolutionary Search Nov 24, 2021

zxybazh force-pushed the tensorir-infra/upstream/2021-11-18/evolutionary-search branch from 50e02b0 to 205e9fb Compare November 29, 2021 19:44

junrushao force-pushed the tensorir-infra/upstream/2021-11-18/evolutionary-search branch 2 times, most recently from a244e90 to 15e0d81 Compare November 29, 2021 20:20

junrushao reviewed Nov 29, 2021

View reviewed changes

src/target/target_kind.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 29, 2021

View reviewed changes

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/utils.h Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Nov 30, 2021

View reviewed changes

zxybazh force-pushed the tensorir-infra/upstream/2021-11-18/evolutionary-search branch 2 times, most recently from 3ce4f7c to ca609d2 Compare December 2, 2021 04:28

junrushao reviewed Dec 2, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 2, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

zxybazh and others added 6 commits December 2, 2021 13:47

Checkpoint.

4eb75ce

Fix cost model comment. Finish evolutionary seaarch. Remove extra code. Fix compile. Add comments. Add python part. Ad test. Update other files & comments.

[TensorIR] GetProducer, GetConsumer (#506)

69e38c8

[MetaScheduleRefactor] Annotate&Unannotate (#505)

e0c9e66

* annotate * annotate * lint * test * fix * fix * fix

[MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reducti…

f653621

…on-Block (#509)

Blockize & Tensorize (#514)

8d829c2

* Blockize & Tensorize * Update tensor intrin * Fix blockized & Recalculate affine flags * Cleanup utils.cc * Add test cases of blockize * Re-enable affine flag checking

zxybazh force-pushed the tensorir-infra/upstream/2021-11-18/evolutionary-search branch from 520ae49 to d5e5ecb Compare December 2, 2021 21:47

junrushao reviewed Dec 3, 2021

View reviewed changes

python/tvm/meta_schedule/search_strategy/evolutionary_search.py Outdated Show resolved Hide resolved

junrushao reviewed Dec 3, 2021

View reviewed changes

python/tvm/meta_schedule/search_strategy/evolutionary_search.py Outdated Show resolved Hide resolved

junrushao reviewed Dec 3, 2021

View reviewed changes

python/tvm/meta_schedule/search_strategy/evolutionary_search.py Outdated Show resolved Hide resolved

junrushao reviewed Dec 4, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

zxybazh added 2 commits December 5, 2021 13:10

Fix TuneContext.

c184547

Fix haash & stuff.

eb8a4ae

zxybazh added 2 commits December 6, 2021 11:18

Modifyy shash.

eb86feb

Remove trace field.

ece4c4f

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/tune_context.cc Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

Minor fix.

3351e73

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

Fix cbmask.

9f1db1e

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

junrushao reviewed Dec 6, 2021

View reviewed changes

src/meta_schedule/search_strategy/evolutionary_search.cc Outdated Show resolved Hide resolved

Fix numbers.

1949b04

junrushao approved these changes Dec 7, 2021

View reviewed changes

junrushao merged commit 1249af5 into tlc-pack:meta-schedule-refactor Dec 7, 2021

junrushao mentioned this pull request Dec 7, 2021

[BugFix] Remove duplicated definition of MakeMultinomialSampler #535

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Meta Schedule] Evolutionary Search #522

[Meta Schedule] Evolutionary Search #522

zxybazh commented Nov 24, 2021

zxybazh commented Nov 24, 2021

junrushao left a comment •

edited

Loading

junrushao commented Nov 30, 2021 •

edited by zxybazh

Loading

zxybazh commented Dec 5, 2021

zxybazh commented Dec 6, 2021

junrushao Dec 6, 2021

zxybazh Dec 6, 2021

zxybazh commented Dec 6, 2021

junrushao left a comment

[Meta Schedule] Evolutionary Search #522

[Meta Schedule] Evolutionary Search #522

Conversation

zxybazh commented Nov 24, 2021

zxybazh commented Nov 24, 2021

junrushao left a comment • edited Loading

Choose a reason for hiding this comment

junrushao commented Nov 30, 2021 • edited by zxybazh Loading

zxybazh commented Dec 5, 2021

zxybazh commented Dec 6, 2021

junrushao Dec 6, 2021

Choose a reason for hiding this comment

zxybazh Dec 6, 2021

Choose a reason for hiding this comment

zxybazh commented Dec 6, 2021

junrushao left a comment

Choose a reason for hiding this comment

junrushao left a comment •

edited

Loading

junrushao commented Nov 30, 2021 •

edited by zxybazh

Loading