proposal: Resctrl Qos Enhancement Proposal

[kangclzjc]

Ⅰ. Describe what this PR does

Koordinator support LLC and MBA configuration and adjustment by config map based on class level. It uses a goroutine to set/adjust RDT configuration in async mode which may not in real time. As Koordinator already support NRI in 0.3.0 release, we can migrate current function into Koordlet runtimehooks as an runtime hook plugin which could be more real time. Furthermore, we propose bolstering resctrl capabilities by integrating real-time monitoring and pod-level LLC/MBA configuration/adjustment. This richer data landscape will empower Koordinator to make informed decisions regarding the dynamic allocation of LLC, MBA, and potentially even other resources, tailoring them to the specific needs of diverse workloads.

Ⅱ. Does this pull request fix one issue?

fixes #756

Ⅲ. Describe how to verify it

Update resctrl configmap and then check the resctrl group.

Ⅳ. Special notes for reviews

V. Checklist

• I have written necessary docs and comments
• I have added necessary unit tests and integration tests
• All checks passed in make test

[kangclzjc]

Will signoff later~

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (a404e7f) 66.42% compared to head (6b867b2) 67.25%.
Report is 49 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1798      +/-   ##
==========================================
+ Coverage   66.42%   67.25%   +0.83%     
==========================================
  Files         396      407      +11     
  Lines       43739    45644    +1905     
==========================================
+ Hits        29053    30698    +1645     
- Misses      12525    12730     +205     
- Partials     2161     2216      +55     

Flag	Coverage Δ
unittests	67.25% <ø> (+0.83%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[zwzhang0107]

/lgtm
next i think it will be better to split into some issues to follow this proposal

[kangclzjc]

/lgtm next i think it will be better to split into some issues to follow this proposal

Sure, let me create several issues and link them to this proposal

[saintube]

/lgtm

[hormes]

/approve

[koordinator-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hormes, jasonliu747

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [hormes]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment