[Unity][MSC][M4.1] Add plugin && plugin_builder, enable build and test in different frameworks #16397
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is a pull request for MSC(Multi-System Compile)
RFC: https://discuss.tvm.apache.org/t/rfc-unity-msc-introduction-to-multi-system-compiler/15251/5
Tracking issue: #15233
This is the Milestone 4 for MSC: Add plugin builder, enable plugin wrap in different frameworks.
To limit each PR in reviewable size, the Milestone 4 will be split into some steps:
[M4.1] Add plugin && plugin_builder, enable build and test in different frameworks.
[M4.2] Enable plugin with manager, test plugins in compile pipeline.
[M4.3] Enable auto generate plugin kernel with script.
Plugin Builder build the plugins from kernel source or kernel libs. Plugin will be build according to framework register style and able to be called by python api.
The plugin builder in MSC enable dispatching cu/cpu kernels in different frameworks, so that we can use tvm together with HPC team, 3rd party kernel libs, and so on.
cc @Hzfengsy