CPU not fully utilised (NUMA edge case?)

[MR-Jarble]

Describe the bug

When working with the transformers section I have found that the system will only engage half my cpu cores/threads. It stops exactly at numa node two and will not use nodes three or four. I have a feeling this is an extreme edge case with my hardware as most systems only have one or two nodes but mine has four. As best I can tell this is not a thread issue as systems with lower numa counts and higher threads seem fine.

Is there an existing issue for this?

• [X] I have searched the existing issues

Reproduction

Load any transformer model and see half of the cores at 100%

Screenshot

Logs

No errors encountered.

System Info

Host Name:                 THEFARM
OS Name:                   Microsoft Windows 11 Pro for Workstations
OS Version:                10.0.22621 N/A Build 22621
OS Manufacturer:           Microsoft Corporation
OS Configuration:          Standalone Workstation
OS Build Type:             Multiprocessor Free
System Manufacturer:       HP
System Model:              ProLiant DL580 Gen9
System Type:               x64-based PC
Processor(s):              4 Processor(s) Installed.
                           [01]: Intel64 Family 6 Model 79 Stepping 1 GenuineIntel ~2401 Mhz
                           [02]: Intel64 Family 6 Model 79 Stepping 1 GenuineIntel ~2401 Mhz
                           [03]: Intel64 Family 6 Model 79 Stepping 1 GenuineIntel ~2401 Mhz
                           [04]: Intel64 Family 6 Model 79 Stepping 1 GenuineIntel ~2401 Mhz
GPU(s):                    4 GPU(s) Installed.
                           [01]: RTX 4070 Super 12GB
                           [02]: RTX 4070 Super 12GB
                           [03]: RTX 4070 Super 12GB
                           [04]: RTX 4070 Super 12GB
BIOS Version:              HP U17, 4/29/2021
Windows Directory:         C:\Windows
System Directory:          C:\Windows\system32
Boot Device:               \Device\HarddiskVolume4
System Locale:             en-us;English (United States)
Input Locale:              en-us;English (United States)
Time Zone:                 (UTC-05:00) Eastern Time (US & Canada)
Total Physical Memory:     1,048,456 MB
Available Physical Memory: 747,127 MB
Virtual Memory: Max Size:  1,099,656 MB
Virtual Memory: Available: 785,557 MB
Virtual Memory: In Use:    314,099 MB
Page File Location(s):     C:\pagefile.sys

[MR-Jarble]

I have additional data in that this also occurs on systems with dual sockets as well. When using a dual 64 core cpu system the transformers section will only engage one cpu leaving the other unused. So I am not as sure that this is a numa issue but maybe something else.