If I have an AMD Processor with 128 cores, can DeepSparse fully utilizes all those cores?

[CracklyOdin]

Hello! I recently conducted testing on my WSL2 environment with DeepSparse using the neuralmagic/Nous-Hermes-2-SOLAR-10.7B-pruned50-quant-ds model. I performed this testing on two devices: one with an AMD Ryzen 5 7600 and another with an Intel® Core™ i9-13900KF.

For your reference, the AMD Ryzen 5 7600 has 6 cores, while the Intel® Core™ i9-13900KF has 24 cores (16 efficient cores (E-cores) and 8 high-performance cores (P-cores)).

The following screenshot illustrates that in the AMD Ryzen 5 7600 device, the response generation process is utilizing 598% of CPU usage (approximately 6 cores), fully leveraging all cores of the AMD Ryzen 5 7600 processor.

The following screenshot shows the testing result in the Intel® Core™ i9-13900KF device, the response generation process is utilizing 1591% of CPU usage (approximately 16 cores).

I've reviewed other discussions in the DeepSparse forum and discovered that DeepSparse doesn't support virtual threading provided by hyper-threading and only utilizes physical cores. Could this be the reason why the response generation process is only utilizing 16 E-cores and not the 8 P-cores, given that P-cores support hyperthreading?

Additionally, if I have an AMD processor with 128 cores, will DeepSparse fully utilize all of them?

Thanks in advanced.