Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Meta Schedule] Update Tune Relay #4

Commits on Jan 7, 2022

  1. Squashed commit

    [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (apache#485)
    
    [Meta Schedule][M3c] PostOrderApply (apache#486)
    
    Fix Post Order Apply (apache#490)
    
    [MetaSchedule] Relay Integration (apache#489)
    
    [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (apache#492)
    
    Fix replay trace. (apache#493)
    
    [M3c][Meta Schedule] Implement the Replay Func class. (apache#495)
    
    [PR] Test script for meta-schedule task extraction. Interface to load… (apache#494)
    
    [Meta Schedule Refactor] Get child blocks (apache#500)
    
    Read-at && Write-at (apache#497)
    
    [M3c][Meta Schedule] Measure Callbacks (apache#498)
    
    [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (apache#496)
    
    [MetaSchedule] Sample-Perfect-Tile (apache#501)
    
    [MetaSchedule] TE Workloads (apache#502)
    
    [TensorIR] GetProducer, GetConsumer (apache#506)
    
    [MetaScheduleRefactor] Annotate&Unannotate (apache#505)
    
    [MetaSchedule] Multi-Level-Tiling & Auto-Inline (apache#503)
    
    [Tests] Add unittests for auto-inline and multi-level-tiling (apache#508)
    
    [Meta Schedule] Minor Fixes (apache#507)
    
    [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (apache#509)
    
    [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (apache#499)
    
    [Meta Schedule] Add Helper Function & Minor Modification (apache#512)
    
    [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll  (apache#513)
    
    [Meta Schedule] Feature Extractor & Cost Model (apache#510)
    
    Blockize & Tensorize (apache#514)
    
    Layout Rewriting: Suggest-Index-Map (apache#520)
    
    [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (apache#516)
    
    [Meta Schedule] Per-Store-Feature (apache#521)
    
    Add traced schedule for blockize & tensorize (apache#526)
    
    [Meta Schedule] Add XGBoost Model & Random Model (apache#519)
    
    User-Interface: Tune-TIR (apache#525)
    
    User-Interface: Tune-TE (apache#527)
    
    [Minor] More logging on python (apache#528)
    
    Get CUDA tuning working (apache#529)
    
    [MetaSchedule] TensorRT BYOC (apache#518)
    
    [BugFix] LocalBuilder API (apache#531)
    
    [Meta Schedule] Add Cost Model Update Measure Callback (apache#530)
    
    [Bugfix] BuilderInput with default params (apache#532)
    
    [MetaSchedule] Mutator-Tile-Size, Mutate-Parallel, Mutate-Unroll (apache#534)
    
    [Meta Schedule] Evolutionary Search (apache#522)
    
    [BugFix] Remove duplicated definition of MakeMultinomialSampler (apache#535)
    
    [Meta Schedule] Fix some bugs (apache#537)
    
    Initiate Experiments for CPU Performance Alignment with Ansor (apache#538)
    
    [Meta Schedule] Tweak experiment scripts (apache#539)
    
    [Meta Schedule] Initiate experiments on CUDA (apache#540)
    
    [TIR][Schedule] Buffer transform (apache#523)
    
    Auto Tensor Core (apache#524)
    
    Working on Evo Search (apache#542)
    
    [Meta Schedule] Add Replay Tuning Interface (apache#543)
    
    Evolutionary Search on CPU (apache#544)
    
    Misc improvement over the error message (apache#545)
    
    [TIR][Schedule] Software pipelining (apache#533)
    
    [Meta Schedule Refactor] fixing unit tests (apache#547)
    
    [MetaSchedule] Mutator-Compute-Location (apache#548)
    
    Misc Improvement of Evolutionary Search (apache#549)
    
    Hotfix for software pipeline (apache#552)
    
    Misc Improvement (apache#550)
    
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    Co-authored-by: Xiyou Zhou <[email protected]>
    
    Squashed commit
    
    [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (apache#485)
    
    [Meta Schedule][M3c] PostOrderApply (apache#486)
    
    Fix Post Order Apply (apache#490)
    
    [MetaSchedule] Relay Integration (apache#489)
    
    [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (apache#492)
    
    Fix replay trace. (apache#493)
    
    [M3c][Meta Schedule] Implement the Replay Func class. (apache#495)
    
    [PR] Test script for meta-schedule task extraction. Interface to load… (apache#494)
    
    [Meta Schedule Refactor] Get child blocks (apache#500)
    
    Read-at && Write-at (apache#497)
    
    [M3c][Meta Schedule] Measure Callbacks (apache#498)
    
    [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (apache#496)
    
    [MetaSchedule] Sample-Perfect-Tile (apache#501)
    
    [MetaSchedule] TE Workloads (apache#502)
    
    [TensorIR] GetProducer, GetConsumer (apache#506)
    
    [MetaScheduleRefactor] Annotate&Unannotate (apache#505)
    
    [MetaSchedule] Multi-Level-Tiling & Auto-Inline (apache#503)
    
    [Tests] Add unittests for auto-inline and multi-level-tiling (apache#508)
    
    [Meta Schedule] Minor Fixes (apache#507)
    
    [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (apache#509)
    
    [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (apache#499)
    
    [Meta Schedule] Add Helper Function & Minor Modification (apache#512)
    
    [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll  (apache#513)
    
    [Meta Schedule] Feature Extractor & Cost Model (apache#510)
    
    Blockize & Tensorize (apache#514)
    
    Layout Rewriting: Suggest-Index-Map (apache#520)
    
    [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (apache#516)
    
    [Meta Schedule] Per-Store-Feature (apache#521)
    
    Add traced schedule for blockize & tensorize (apache#526)
    
    [Meta Schedule] Add XGBoost Model & Random Model (apache#519)
    
    User-Interface: Tune-TIR (apache#525)
    
    User-Interface: Tune-TE (apache#527)
    
    [Minor] More logging on python (apache#528)
    
    Get CUDA tuning working (apache#529)
    
    [MetaSchedule] TensorRT BYOC (apache#518)
    
    [BugFix] LocalBuilder API (apache#531)
    
    [Meta Schedule] Add Cost Model Update Measure Callback (apache#530)
    
    [Bugfix] BuilderInput with default params (apache#532)
    
    [MetaSchedule] Mutator-Tile-Size, Mutate-Parallel, Mutate-Unroll (apache#534)
    
    [Meta Schedule] Evolutionary Search (apache#522)
    
    [BugFix] Remove duplicated definition of MakeMultinomialSampler (apache#535)
    
    [Meta Schedule] Fix some bugs (apache#537)
    
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    Co-authored-by: Xiyou Zhou <[email protected]>
    
    Initiate Experiments for CPU Performance Alignment with Ansor (apache#538)
    
    * ...
    
    * update
    
    * update
    
    * print
    
    * more
    
    [Meta Schedule] Tweak experiment scripts (apache#539)
    
    [Meta Schedule] Initiate experiments on CUDA (apache#540)
    
    * [Meta Schedule] Initiate experiments on CUDA
    
    * ...
    
    * fix boolean printing
    
    Auto Tensor Core (apache#524)
    
    Working on Evo Search (apache#542)
    
    Squashed commit
    
    [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (apache#485)
    
    [Meta Schedule][M3c] PostOrderApply (apache#486)
    
    Fix Post Order Apply (apache#490)
    
    [MetaSchedule] Relay Integration (apache#489)
    
    [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (apache#492)
    
    Fix replay trace. (apache#493)
    
    [M3c][Meta Schedule] Implement the Replay Func class. (apache#495)
    
    [PR] Test script for meta-schedule task extraction. Interface to load… (apache#494)
    
    [Meta Schedule Refactor] Get child blocks (apache#500)
    
    Read-at && Write-at (apache#497)
    
    [M3c][Meta Schedule] Measure Callbacks (apache#498)
    
    [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (apache#496)
    
    [MetaSchedule] Sample-Perfect-Tile (apache#501)
    
    [MetaSchedule] TE Workloads (apache#502)
    
    [TensorIR] GetProducer, GetConsumer (apache#506)
    
    [MetaScheduleRefactor] Annotate&Unannotate (apache#505)
    
    [MetaSchedule] Multi-Level-Tiling & Auto-Inline (apache#503)
    
    [Tests] Add unittests for auto-inline and multi-level-tiling (apache#508)
    
    [Meta Schedule] Minor Fixes (apache#507)
    
    [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (apache#509)
    
    [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (apache#499)
    
    [Meta Schedule] Add Helper Function & Minor Modification (apache#512)
    
    [MetaSchedule] Test for Rewrite Parallel-Vectorize-Unroll  (apache#513)
    
    [Meta Schedule] Feature Extractor & Cost Model (apache#510)
    
    Blockize & Tensorize (apache#514)
    
    Layout Rewriting: Suggest-Index-Map (apache#520)
    
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    
    [MetaSchedule] Parallel-Vectorize-Unroll & Random-Compute-Location (apache#516)
    
    * parallel vectorize unroll & random compute location
    
    * rebased
    
    [Meta Schedule] Per-Store-Feature (apache#521)
    
    [Meta Schedule] Add XGBoost Model & Random Model (apache#519)
    
    * Squashed commit
    
    [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (apache#485)
    
    [Meta Schedule][M3c] PostOrderApply (apache#486)
    
    Fix Post Order Apply (apache#490)
    
    [MetaSchedule] Relay Integration (apache#489)
    
    [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (apache#492)
    
    Fix replay trace. (apache#493)
    
    [M3c][Meta Schedule] Implement the Replay Func class. (apache#495)
    
    [PR] Test script for meta-schedule task extraction. Interface to load… (apache#494)
    
    [Meta Schedule Refactor] Get child blocks (apache#500)
    
    Read-at && Write-at (apache#497)
    
    [M3c][Meta Schedule] Measure Callbacks (apache#498)
    
    [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (apache#496)
    
    [MetaSchedule] Sample-Perfect-Tile (apache#501)
    
    [MetaSchedule] TE Workloads (apache#502)
    
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    
    [TensorIR] GetProducer, GetConsumer (apache#506)
    
    [MetaScheduleRefactor] Annotate&Unannotate (apache#505)
    
    * annotate
    
    * annotate
    
    * lint
    
    * test
    
    * fix
    
    * fix
    
    * fix
    
    [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (apache#509)
    
    Fix sttr func & schedule naming.
    
    Fix schedule -> sch.
    
    Add feature extractor.
    
    Fix init.
    
    Add cost model.
    
    Remove unused include.
    
    [MetaSchedule] Rewrite Parallel-Vectorize-Unroll / Verify-GPU / Disallow-Dynamic-Loops (apache#499)
    
    * wip
    
    fix
    
    * revoke change to gallery
    
    * split postprocessors to separate files
    
    * rename attrs
    
    * minor
    
    * minor tweak on utils.h
    
    * refactor disallow-dynamic-loop
    
    * refactor verify_gpu_code
    
    * succesfully give up refactoring parallelize-vectorize-unroll
    
    * python structuring
    
    * unittests
    
    Co-authored-by: Junru Shao <[email protected]>
    
    Fix issues.
    
    Fix init.
    
    Finish random model part.
    
    Finish xgb model.
    
    Minor fix.
    
    Rebase.
    
    Add init.
    
    Await refactor of callback.
    
    Update a bit on the test case.
    
    Move impos.
    
    Minor fix.
    
    More fixes.
    
    Remove unused import.
    
    Fix per store feature test.
    
    Update model save / load.
    
    * Fix model save / load with tar.
    
    * Fix issues.
    
    * Remove dup.
    
    Co-authored-by: Junru Shao <[email protected]>
    
    User-Interface: Tune-TIR (apache#525)
    
    * User-Interface: Tune-TIR
    
    * fix fix fix
    
    User-Interface: Tune-TE (apache#527)
    
    * fix a lot of issues
    
    * Add tune-te
    
    Get CUDA tuning working (apache#529)
    
    [Meta Schedule] Evolutionary Search (apache#522)
    
    * Checkpoint.
    
    Fix cost model comment.
    
    Finish evolutionary seaarch.
    
    Remove  extra code.
    
    Fix compile.
    
    Add comments.
    
    Add python part.
    
    Ad test.
    
    Update other files & comments.
    
    * Squashed commit
    
    [Meta Schedule][M3c] Schedule Rules, Mutator & Postprocs (apache#485)
    
    [Meta Schedule][M3c] PostOrderApply (apache#486)
    
    Fix Post Order Apply (apache#490)
    
    [MetaSchedule] Relay Integration (apache#489)
    
    [M3c][Meta Schedule] Add Trace Correctness Test for PostOrderApply (apache#492)
    
    Fix replay trace. (apache#493)
    
    [M3c][Meta Schedule] Implement the Replay Func class. (apache#495)
    
    [PR] Test script for meta-schedule task extraction. Interface to load… (apache#494)
    
    [Meta Schedule Refactor] Get child blocks (apache#500)
    
    Read-at && Write-at (apache#497)
    
    [M3c][Meta Schedule] Measure Callbacks (apache#498)
    
    [Bug] Fix Infinite Loop Caused When Calling Methods Not Overrided In PyClass (apache#496)
    
    [MetaSchedule] Sample-Perfect-Tile (apache#501)
    
    [MetaSchedule] TE Workloads (apache#502)
    
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    
    * [TensorIR] GetProducer, GetConsumer (apache#506)
    
    * [MetaScheduleRefactor] Annotate&Unannotate (apache#505)
    
    * annotate
    
    * annotate
    
    * lint
    
    * test
    
    * fix
    
    * fix
    
    * fix
    
    * [MetaSchedule] Rewrite Cooperative-Fetching / Unbound-Block / Reduction-Block (apache#509)
    
    * Blockize & Tensorize (apache#514)
    
    * Blockize & Tensorize
    
    * Update tensor intrin
    
    * Fix blockized & Recalculate affine flags
    
    * Cleanup utils.cc
    
    * Add test cases of blockize
    
    * Re-enable affine flag checking
    
    * Checkpoint.
    
    Fix cost model comment.
    
    Finish evolutionary seaarch.
    
    Remove  extra code.
    
    Fix compile.
    
    Add comments.
    
    Add python part.
    
    Ad test.
    
    Update other files & comments.
    
    Fix random seed bug.
    
    Minor fix.
    
    Fix num-cores.
    
    Add docs.
    
    Check point.
    
    Add max_fail_cnt.
    
    Minor fix.
    
    Minor fix.
    
    Segfault.
    
    Fix pointers to trace.
    
    Test fix.
    
    Remove measure callbacks.
    
    Refactor a bit.
    
    Split function.
    
    Adjust variable name.
    
    Minor fixes.
    
    Add mutator probs to TuneContext.
    
    Add token.
    
    Fix loops.
    
    Remove include.
    
    Add has workload for database.
    
    Add check.
    
    Add concurrent bitmask.
    
    * Fix TuneContext.
    
    * Fix haash & stuff.
    
    * Modifyy shash.
    
    * Remove trace field.
    
    * Minor fix.
    
    * Fix cbmask.
    
    * Fix numbers.
    
    Co-authored-by: Junru Shao <[email protected]>
    Co-authored-by: Siyuan Feng <[email protected]>
    Co-authored-by: Bohan Hou <[email protected]>
    Co-authored-by: Hongyi Jin <[email protected]>
    Co-authored-by: Ruihang Lai <[email protected]>
    Co-authored-by: Wuwei Lin <[email protected]>
    Co-authored-by: Sunghyun Park <[email protected]>
    
    [BugFix] Remove duplicated definition of MakeMultinomialSampler (apache#535)
    
    Tune relay.
    
    Further add interface.
    
    Remove unused import
    
    Fix rebase.
    
    Add task name dispatch.
    
    Add task deduplication.
    
    Rename extract_task to extract_task_from_relay
    
    Remove duplicate function def.
    
    Minor fix.
    junrushao authored and zxybazh committed Jan 7, 2022
    Configuration menu
    Copy the full SHA
    05f3aba View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2022

  1. Add ApplyHistoryBest.

    zxybazh committed Jan 8, 2022
    Configuration menu
    Copy the full SHA
    91533a4 View commit details
    Browse the repository at this point in the history