kernel: smp: Optimize delivery of IPIs #69770
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
zephyrbot
added
area: RISCV
peter-mitsis
force-pushed
the
pmitsis-ipi
branch
from
65d5381
to
44dae3d
Compare
|
The following west manifest projects have been modified in this Pull Request:
Note: This message is automatically posted and updated by the Manifest GitHub Action. |
zephyrbot
added
manifest
manifest-sof
DNM
peter-mitsis
dismissed stale reviews from ruuddw, andyross, and evgeniy-paltsev
via
d2cb09a
|
Rebased to resolve a merge conflict. |
npitre
previously approved these changes
Jun 4, 2024
|
@peter-mitsis there is a failure because of another change in the SOF tree, I am working on resolving this now, but the conflict here not sure what is it about. |
nashif
reviewed
Jun 4, 2024
submanifests/optional.yaml
Outdated
| @@ -34,7 +34,7 @@ manifest: | |||
| groups: | |||
| - optional | |||
| - name: sof | |||
| revision: c11a3185afbc8e1b2a79916de3dfefaf326d9ad1 | |||
| revision: ac1b774abfe2e8a9f6547f5bc305e499c51f9671 | |||
There was a problem hiding this comment.
point to this 1e4702f3080c68e6046b7b16eb030a3eba0ce231 instead.
ok, that was the esf change... |
|
Updated submanifest as per @nashif's request -- nothing else changed. |
nashif
previously approved these changes
Jun 4, 2024
evgeniy-paltsev
previously approved these changes
Jun 4, 2024
npitre
previously approved these changes
Jun 5, 2024
1. The flagging of IPIs is moved out of k_thread_priority_set() into z_thread_prio_set(). This allows for an IPI to be done for a thread that had its priority bumped due to the handling of priority inheritance from a mutex. 2. k_thread_priority_set()'s check for sched_locked only applies to non-SMP builds that are using the old arch_swap() framework to switch between threads. Incidentally, nearly all calls to flag_ipi() are now performed with sched_spinlock being locked. The only exception is in slice_timeout(). Signed-off-by: Peter Mitsis <peter.mitsis@intel.com>
The CONFIG_IPI_OPTIMIZE configuration option allows for the flagging and subsequent signaling of IPIs to be optimized. It does this by making each bit in the kernel's pending_ipi field a flag that indicates whether the corresponding CPU might need an IPI to trigger the scheduling of a new thread on that CPU. When a new thread is made ready, we compare that thread against each of the threads currently executing on the other CPUs. If there is a chance that that thread should preempt the thread on the other CPU then we flag that an IPI is needed for that CPU. That is, a clear bit indicates that the CPU absolutely will not need to reschedule, while a set bit indicates that the target CPU must make that determination for itself. Signed-off-by: Peter Mitsis <peter.mitsis@intel.com>
Platforms that support IPIs allow them to be broadcast via the new arch_sched_broadcast_ipi() routine (replacing arch_sched_ipi()). Those that also allow IPIs to be directed to specific CPUs may use arch_sched_directed_ipi() to do so. As the kernel has the capability to track which CPUs may need an IPI (see CONFIG_IPI_OPTIMIZE), this commit updates the signalling of tracked IPIs to use the directed version if supported; otherwise they continue to use the broadcast version. Platforms that allow directed IPIs may see a significant reduction in the number of IPI related ISRs when CONFIG_IPI_OPTIMIZE is enabled and the number of CPUs increases. These platforms can be identified by the Kconfig option CONFIG_ARCH_HAS_DIRECTED_IPIS. Signed-off-by: Peter Mitsis <peter.mitsis@intel.com>
Updates the sof revision. This is needed for it to pick up a change to the arch_sched_ipi() which has been renamed to arch_sched_broadcast_ipi(). Signed-off-by: Peter Mitsis <peter.mitsis@intel.com>
Adds several tests to verify that IPIs can be appropriately targeted to specific CPUs. Signed-off-by: Peter Mitsis <peter.mitsis@intel.com>
nashif
dismissed stale reviews from npitre, evgeniy-paltsev, and themself
via
05c473a
nashif
approved these changes
Jun 5, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This set of commits is a step towards optimising the delivery of inter-processor interrupts (IPIs). It does this by attempting to deliver IPIs only to relevant CPUs.
The bulk of these changes revolve around three ideas.