If I have an AMD Processor with 128 cores, can DeepSparse fully utilizes all those cores? #1591
Unanswered
CracklyOdin
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello! I recently conducted testing on my WSL2 environment with DeepSparse using the neuralmagic/Nous-Hermes-2-SOLAR-10.7B-pruned50-quant-ds model. I performed this testing on two devices: one with an AMD Ryzen 5 7600 and another with an Intel® Core™ i9-13900KF.
For your reference, the AMD Ryzen 5 7600 has 6 cores, while the Intel® Core™ i9-13900KF has 24 cores (16 efficient cores (E-cores) and 8 high-performance cores (P-cores)).
The following screenshot illustrates that in the AMD Ryzen 5 7600 device, the response generation process is utilizing 598% of CPU usage (approximately 6 cores), fully leveraging all cores of the AMD Ryzen 5 7600 processor.
The following screenshot shows the testing result in the Intel® Core™ i9-13900KF device, the response generation process is utilizing 1591% of CPU usage (approximately 16 cores).
I've reviewed other discussions in the DeepSparse forum and discovered that DeepSparse doesn't support virtual threading provided by hyper-threading and only utilizes physical cores. Could this be the reason why the response generation process is only utilizing 16 E-cores and not the 8 P-cores, given that P-cores support hyperthreading?
Additionally, if I have an AMD processor with 128 cores, will DeepSparse fully utilize all of them?
Thanks in advanced.
Beta Was this translation helpful? Give feedback.
All reactions