Closed hadisinaee closed 1 month ago
Hi,
pqos --version
pqos --display-verbose --super-verbose
pqos --show --super-verbose
Could you provide full pqos command that are you trying to execute?
Yes, sure. I used sudo pqos -t 1
.
What system are you using?
I'm using Intel(R) Xeon(R) W-2275 CPU @ 3.30GHz. Also, my running os is ubuntu 20.04 LTS.
Please, provide output of the following commands
$ pqos --version
NOTE: Mixed use of MSR and kernel interfaces to manage
CAT or CMT & MBM may lead to unexpected behavior.
WARN: resctl filesystem mounted! Using MSR interface may corrupt resctrl filesystem and cause unexpected behaviour
PQoS Library version: 3.2.0
$ pqos --display-verbose --super-verbose
NOTE: Mixed use of MSR and kernel interfaces to manage
CAT or CMT & MBM may lead to unexpected behavior.
INFO: CACHE: type 1, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 2, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 2, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 16 way(s), 1024 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 3, max id sharing this cache 32 (5 bits)
DEBUG: CACHE: not inclusive, complex cache indexing, 11 way(s), 28672 set(s), line size 64, 1 partition(s)
DEBUG: Detected core 0, socket 0, L2 ID 0, L3 ID 0, APICID 0
DEBUG: Detected core 1, socket 0, L2 ID 1, L3 ID 0, APICID 2
DEBUG: Detected core 2, socket 0, L2 ID 2, L3 ID 0, APICID 4
DEBUG: Detected core 3, socket 0, L2 ID 3, L3 ID 0, APICID 6
DEBUG: Detected core 4, socket 0, L2 ID 4, L3 ID 0, APICID 8
DEBUG: Detected core 5, socket 0, L2 ID 5, L3 ID 0, APICID 10
DEBUG: Detected core 6, socket 0, L2 ID 6, L3 ID 0, APICID 12
DEBUG: Detected core 7, socket 0, L2 ID 8, L3 ID 0, APICID 16
DEBUG: Detected core 8, socket 0, L2 ID 9, L3 ID 0, APICID 18
DEBUG: Detected core 9, socket 0, L2 ID 10, L3 ID 0, APICID 20
DEBUG: Detected core 10, socket 0, L2 ID 11, L3 ID 0, APICID 22
DEBUG: Detected core 11, socket 0, L2 ID 12, L3 ID 0, APICID 24
DEBUG: Detected core 12, socket 0, L2 ID 13, L3 ID 0, APICID 26
DEBUG: Detected core 13, socket 0, L2 ID 14, L3 ID 0, APICID 28
DEBUG: Detected core 14, socket 0, L2 ID 0, L3 ID 0, APICID 1
DEBUG: Detected core 15, socket 0, L2 ID 1, L3 ID 0, APICID 3
DEBUG: Detected core 16, socket 0, L2 ID 2, L3 ID 0, APICID 5
DEBUG: Detected core 17, socket 0, L2 ID 3, L3 ID 0, APICID 7
DEBUG: Detected core 18, socket 0, L2 ID 4, L3 ID 0, APICID 9
DEBUG: Detected core 19, socket 0, L2 ID 5, L3 ID 0, APICID 11
DEBUG: Detected core 20, socket 0, L2 ID 6, L3 ID 0, APICID 13
DEBUG: Detected core 21, socket 0, L2 ID 8, L3 ID 0, APICID 17
DEBUG: Detected core 22, socket 0, L2 ID 9, L3 ID 0, APICID 19
DEBUG: Detected core 23, socket 0, L2 ID 10, L3 ID 0, APICID 21
DEBUG: Detected core 24, socket 0, L2 ID 11, L3 ID 0, APICID 23
DEBUG: Detected core 25, socket 0, L2 ID 12, L3 ID 0, APICID 25
DEBUG: Detected core 26, socket 0, L2 ID 13, L3 ID 0, APICID 27
DEBUG: Detected core 27, socket 0, L2 ID 14, L3 ID 0, APICID 29
WARN: resctl filesystem mounted! Using MSR interface may corrupt resctrl filesystem and cause unexpected behaviour
DEBUG: Adding monitoring event: resource ID 1, type 1 to table index 0
DEBUG: Adding monitoring event: resource ID 1, type 4 to table index 1
DEBUG: Adding monitoring event: resource ID 1, type 2 to table index 2
DEBUG: Adding monitoring event: resource ID 1, type 8 to table index 3
DEBUG: Adding monitoring event: resource ID 0, type 32768 to table index 4
DEBUG: Adding monitoring event: resource ID 0, type 16384 to table index 5
INFO: Monitoring capability detected
INFO: CPUID.0x7.0: L3 CAT supported
INFO: L3 CDP is disabled
INFO: L3CA capability detected
INFO: L3 CAT details: CDP support=1, CDP on=0, #COS=16, #ways=11, ways contention bit-mask 0x600
INFO: L3 CAT details: cache size 20185088 bytes, way size 1835008 bytes
INFO: CPUID 0x10.0: L2 CAT not supported!
INFO: L2CA capability not detected
INFO: MBA capability detected
INFO: MBA details: #COS=8, linear, max=90, step=10
DEBUG: allocation init OK
DEBUG: Max RMID per monitoring cluster is 112
DEBUG: monitoring init OK
Hardware capabilities
Monitoring
Cache Monitoring Technology (CMT) events:
LLC Occupancy (LLC): scale factor 57344, max_rmid 112
Memory Bandwidth Monitoring (MBM) events:
Total Memory Bandwidth (TMEM): scale factor 57344, max_rmid 112
Local Memory Bandwidth (LMEM): scale factor 57344, max_rmid 112
Remote Memory Bandwidth (RMEM) (calculated): scale factor 57344, max_rmid 112
PMU events:
Instructions/Clock (IPC)
LLC misses
Allocation
Cache Allocation Technology (CAT)
L3 CAT
CDP: disabled
Num COS: 16
Way size: 1835008 bytes
Ways contention bit-mask: 0x600
ERROR: WRMSR failed for reg[0xc9f] <- value[0x1] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x3] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x7] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0xf] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x1f] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x3f] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x7f] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0xff] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x1ff] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x3ff] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x7ff] on lcore 0
ERROR: WRMSR failed for reg[0xc9f] <- value[0x7ff] on lcore 0
ERROR: Failed to restore CAT configuration. CAT configuration has been altered!
Min CBM bits: unavailable
Max CBM bits: 11
Memory Bandwidth Allocation (MBA)
Num COS: 8
Granularity: 10
Min B/W: 10
Type: linear
Cache information
L3 Cache
Num ways: 11
Way size: 1835008 bytes
Num sets: 28672
Line size: 64 bytes
Total size: 20185088 bytes
L2 Cache
Num ways: 16
Way size: 65536 bytes
Num sets: 1024
Line size: 64 bytes
Total size: 1048576 bytes
$ sudo pqos --show --super-verbose
NOTE: Mixed use of MSR and kernel interfaces to manage
CAT or CMT & MBM may lead to unexpected behavior.
INFO: CACHE: type 1, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 2, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 2, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 16 way(s), 1024 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 3, max id sharing this cache 32 (5 bits)
DEBUG: CACHE: not inclusive, complex cache indexing, 11 way(s), 28672 set(s), line size 64, 1 partition(s)
DEBUG: Detected core 0, socket 0, L2 ID 0, L3 ID 0, APICID 0
DEBUG: Detected core 1, socket 0, L2 ID 1, L3 ID 0, APICID 2
DEBUG: Detected core 2, socket 0, L2 ID 2, L3 ID 0, APICID 4
DEBUG: Detected core 3, socket 0, L2 ID 3, L3 ID 0, APICID 6
DEBUG: Detected core 4, socket 0, L2 ID 4, L3 ID 0, APICID 8
DEBUG: Detected core 5, socket 0, L2 ID 5, L3 ID 0, APICID 10
DEBUG: Detected core 6, socket 0, L2 ID 6, L3 ID 0, APICID 12
DEBUG: Detected core 7, socket 0, L2 ID 8, L3 ID 0, APICID 16
DEBUG: Detected core 8, socket 0, L2 ID 9, L3 ID 0, APICID 18
DEBUG: Detected core 9, socket 0, L2 ID 10, L3 ID 0, APICID 20
DEBUG: Detected core 10, socket 0, L2 ID 11, L3 ID 0, APICID 22
DEBUG: Detected core 11, socket 0, L2 ID 12, L3 ID 0, APICID 24
DEBUG: Detected core 12, socket 0, L2 ID 13, L3 ID 0, APICID 26
DEBUG: Detected core 13, socket 0, L2 ID 14, L3 ID 0, APICID 28
DEBUG: Detected core 14, socket 0, L2 ID 0, L3 ID 0, APICID 1
DEBUG: Detected core 15, socket 0, L2 ID 1, L3 ID 0, APICID 3
DEBUG: Detected core 16, socket 0, L2 ID 2, L3 ID 0, APICID 5
DEBUG: Detected core 17, socket 0, L2 ID 3, L3 ID 0, APICID 7
DEBUG: Detected core 18, socket 0, L2 ID 4, L3 ID 0, APICID 9
DEBUG: Detected core 19, socket 0, L2 ID 5, L3 ID 0, APICID 11
DEBUG: Detected core 20, socket 0, L2 ID 6, L3 ID 0, APICID 13
DEBUG: Detected core 21, socket 0, L2 ID 8, L3 ID 0, APICID 17
DEBUG: Detected core 22, socket 0, L2 ID 9, L3 ID 0, APICID 19
DEBUG: Detected core 23, socket 0, L2 ID 10, L3 ID 0, APICID 21
DEBUG: Detected core 24, socket 0, L2 ID 11, L3 ID 0, APICID 23
DEBUG: Detected core 25, socket 0, L2 ID 12, L3 ID 0, APICID 25
DEBUG: Detected core 26, socket 0, L2 ID 13, L3 ID 0, APICID 27
DEBUG: Detected core 27, socket 0, L2 ID 14, L3 ID 0, APICID 29
WARN: resctl filesystem mounted! Using MSR interface may corrupt resctrl filesystem and cause unexpected behaviour
DEBUG: Adding monitoring event: resource ID 1, type 1 to table index 0
DEBUG: Adding monitoring event: resource ID 1, type 4 to table index 1
DEBUG: Adding monitoring event: resource ID 1, type 2 to table index 2
DEBUG: Adding monitoring event: resource ID 1, type 8 to table index 3
DEBUG: Adding monitoring event: resource ID 0, type 32768 to table index 4
DEBUG: Adding monitoring event: resource ID 0, type 16384 to table index 5
INFO: Monitoring capability detected
INFO: CPUID.0x7.0: L3 CAT supported
INFO: L3 CDP is disabled
INFO: L3CA capability detected
INFO: L3 CAT details: CDP support=1, CDP on=0, #COS=16, #ways=11, ways contention bit-mask 0x600
INFO: L3 CAT details: cache size 20185088 bytes, way size 1835008 bytes
INFO: CPUID 0x10.0: L2 CAT not supported!
INFO: L2CA capability not detected
INFO: MBA capability detected
INFO: MBA details: #COS=8, linear, max=90, step=10
DEBUG: allocation init OK
DEBUG: Max RMID per monitoring cluster is 112
DEBUG: monitoring init OK
L3CA/MBA COS definitions for Socket 0:
L3CA COS0 => MASK 0x7ff
L3CA COS1 => MASK 0x7ff
L3CA COS2 => MASK 0x7ff
L3CA COS3 => MASK 0x7ff
L3CA COS4 => MASK 0x7ff
L3CA COS5 => MASK 0x7ff
L3CA COS6 => MASK 0x7ff
L3CA COS7 => MASK 0x7ff
L3CA COS8 => MASK 0x7ff
L3CA COS9 => MASK 0x7ff
L3CA COS10 => MASK 0x7ff
L3CA COS11 => MASK 0x7ff
L3CA COS12 => MASK 0x7ff
L3CA COS13 => MASK 0x7ff
L3CA COS14 => MASK 0x7ff
L3CA COS15 => MASK 0x7ff
MBA COS0 => 100% available
MBA COS1 => 100% available
MBA COS2 => 100% available
MBA COS3 => 100% available
MBA COS4 => 100% available
MBA COS5 => 100% available
MBA COS6 => 100% available
MBA COS7 => 100% available
Core information for socket 0:
Core 0, L2ID 0, L3ID 0 => COS0, RMID0
Core 1, L2ID 1, L3ID 0 => COS0, RMID0
Core 2, L2ID 2, L3ID 0 => COS0, RMID0
Core 3, L2ID 3, L3ID 0 => COS0, RMID0
Core 4, L2ID 4, L3ID 0 => COS0, RMID0
Core 5, L2ID 5, L3ID 0 => COS0, RMID0
Core 6, L2ID 6, L3ID 0 => COS0, RMID0
Core 7, L2ID 8, L3ID 0 => COS0, RMID0
Core 8, L2ID 9, L3ID 0 => COS0, RMID0
Core 9, L2ID 10, L3ID 0 => COS0, RMID0
Core 10, L2ID 11, L3ID 0 => COS0, RMID0
Core 11, L2ID 12, L3ID 0 => COS0, RMID0
Core 12, L2ID 13, L3ID 0 => COS0, RMID0
Core 13, L2ID 14, L3ID 0 => COS0, RMID0
Core 14, L2ID 0, L3ID 0 => COS0, RMID0
Core 15, L2ID 1, L3ID 0 => COS0, RMID0
Core 16, L2ID 2, L3ID 0 => COS0, RMID0
Core 17, L2ID 3, L3ID 0 => COS0, RMID0
Core 18, L2ID 4, L3ID 0 => COS0, RMID0
Core 19, L2ID 5, L3ID 0 => COS0, RMID0
Core 20, L2ID 6, L3ID 0 => COS0, RMID0
Core 21, L2ID 8, L3ID 0 => COS0, RMID0
Core 22, L2ID 9, L3ID 0 => COS0, RMID0
Core 23, L2ID 10, L3ID 0 => COS0, RMID0
Core 24, L2ID 11, L3ID 0 => COS0, RMID0
Core 25, L2ID 12, L3ID 0 => COS0, RMID0
Core 26, L2ID 13, L3ID 0 => COS0, RMID0
Core 27, L2ID 14, L3ID 0 => COS0, RMID0
Hi,
I haven't been able to resolve this issue yet. Does it have anything to do with my CPU's model?
Thanks
It looks like reading MSR's is working, but you cannot write MSRs. But any chance does your system have Secure Boot enabled? Can you try running the commands above using the OS interface flag?
e.g. pqos --display-verbose --super-verbose --iface-os
I checked for the secure boot settings, and it seems I got the secure boot enabled.
>> sudo mokutil --sb-state
SecureBoot enabled
Also, the output of the pqos --display-verbose --super-verbose --iface-os
is:
NOTE: Mixed use of MSR and kernel interfaces to manage
CAT or CMT & MBM may lead to unexpected behavior.
INFO: CACHE: type 1, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 2, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 2, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 16 way(s), 1024 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 3, max id sharing this cache 32 (5 bits)
DEBUG: CACHE: not inclusive, complex cache indexing, 11 way(s), 28672 set(s), line size 64, 1 partition(s)
DEBUG: Detected core 0, socket 0, L2 ID 0, L3 ID 0, APICID 0
DEBUG: Detected core 1, socket 0, L2 ID 1, L3 ID 0, APICID 2
DEBUG: Detected core 2, socket 0, L2 ID 2, L3 ID 0, APICID 4
DEBUG: Detected core 3, socket 0, L2 ID 3, L3 ID 0, APICID 6
DEBUG: Detected core 4, socket 0, L2 ID 4, L3 ID 0, APICID 8
DEBUG: Detected core 5, socket 0, L2 ID 5, L3 ID 0, APICID 10
DEBUG: Detected core 6, socket 0, L2 ID 6, L3 ID 0, APICID 12
DEBUG: Detected core 7, socket 0, L2 ID 8, L3 ID 0, APICID 16
DEBUG: Detected core 8, socket 0, L2 ID 9, L3 ID 0, APICID 18
DEBUG: Detected core 9, socket 0, L2 ID 10, L3 ID 0, APICID 20
DEBUG: Detected core 10, socket 0, L2 ID 11, L3 ID 0, APICID 22
DEBUG: Detected core 11, socket 0, L2 ID 12, L3 ID 0, APICID 24
DEBUG: Detected core 12, socket 0, L2 ID 13, L3 ID 0, APICID 26
DEBUG: Detected core 13, socket 0, L2 ID 14, L3 ID 0, APICID 28
DEBUG: Detected core 14, socket 0, L2 ID 0, L3 ID 0, APICID 1
DEBUG: Detected core 15, socket 0, L2 ID 1, L3 ID 0, APICID 3
DEBUG: Detected core 16, socket 0, L2 ID 2, L3 ID 0, APICID 5
DEBUG: Detected core 17, socket 0, L2 ID 3, L3 ID 0, APICID 7
DEBUG: Detected core 18, socket 0, L2 ID 4, L3 ID 0, APICID 9
DEBUG: Detected core 19, socket 0, L2 ID 5, L3 ID 0, APICID 11
DEBUG: Detected core 20, socket 0, L2 ID 6, L3 ID 0, APICID 13
DEBUG: Detected core 21, socket 0, L2 ID 8, L3 ID 0, APICID 17
DEBUG: Detected core 22, socket 0, L2 ID 9, L3 ID 0, APICID 19
DEBUG: Detected core 23, socket 0, L2 ID 10, L3 ID 0, APICID 21
DEBUG: Detected core 24, socket 0, L2 ID 11, L3 ID 0, APICID 23
DEBUG: Detected core 25, socket 0, L2 ID 12, L3 ID 0, APICID 25
DEBUG: Detected core 26, socket 0, L2 ID 13, L3 ID 0, APICID 27
DEBUG: Detected core 27, socket 0, L2 ID 14, L3 ID 0, APICID 29
INFO: resctrl detected
INFO: resctrl not mounted
INFO: Unable to mount resctrl
ERROR: os_cap_init() error 3
Error initializing PQoS library!
Please check if resctrl can be mounted manually using command
mount -t resctrl - /sys/fs/resctrl
Verify resctrl filesystem structure
tree /sys/fs/resctrl
Thank you. I could mount and verify the restctrl
.
Hi could you retest the following command on latest package version
pqos --display-verbose --super-verbose --iface=os
Yes, sure. I installed version 4.4.0 on the release page.
The output is:
NOTE: Mixed use of MSR and kernel interfaces to manage
CAT or CMT & MBM may lead to unexpected behavior.
INFO: Requested interface: OS
INFO: Selected interface: OS
INFO: CACHE: type 1, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 2, level 1, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 8 way(s), 64 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 2, max id sharing this cache 2 (1 bits)
DEBUG: CACHE: not inclusive, direct mapped, 16 way(s), 1024 set(s), line size 64, 1 partition(s)
INFO: CACHE: type 3, level 3, max id sharing this cache 32 (5 bits)
DEBUG: CACHE: not inclusive, complex cache indexing, 11 way(s), 28672 set(s), line size 64, 1 partition(s)
DEBUG: Detected core 0, socket 0, L2 ID 0, L3 ID 0
DEBUG: Detected core 1, socket 0, L2 ID 1, L3 ID 0
DEBUG: Detected core 2, socket 0, L2 ID 2, L3 ID 0
DEBUG: Detected core 3, socket 0, L2 ID 3, L3 ID 0
DEBUG: Detected core 4, socket 0, L2 ID 4, L3 ID 0
DEBUG: Detected core 5, socket 0, L2 ID 5, L3 ID 0
DEBUG: Detected core 6, socket 0, L2 ID 6, L3 ID 0
DEBUG: Detected core 7, socket 0, L2 ID 8, L3 ID 0
DEBUG: Detected core 8, socket 0, L2 ID 9, L3 ID 0
DEBUG: Detected core 9, socket 0, L2 ID 10, L3 ID 0
DEBUG: Detected core 10, socket 0, L2 ID 11, L3 ID 0
DEBUG: Detected core 11, socket 0, L2 ID 12, L3 ID 0
DEBUG: Detected core 12, socket 0, L2 ID 13, L3 ID 0
DEBUG: Detected core 13, socket 0, L2 ID 14, L3 ID 0
DEBUG: Detected core 14, socket 0, L2 ID 0, L3 ID 0
DEBUG: Detected core 15, socket 0, L2 ID 1, L3 ID 0
DEBUG: Detected core 16, socket 0, L2 ID 2, L3 ID 0
DEBUG: Detected core 17, socket 0, L2 ID 3, L3 ID 0
DEBUG: Detected core 18, socket 0, L2 ID 4, L3 ID 0
DEBUG: Detected core 19, socket 0, L2 ID 5, L3 ID 0
DEBUG: Detected core 20, socket 0, L2 ID 6, L3 ID 0
DEBUG: Detected core 21, socket 0, L2 ID 8, L3 ID 0
DEBUG: Detected core 22, socket 0, L2 ID 9, L3 ID 0
DEBUG: Detected core 23, socket 0, L2 ID 10, L3 ID 0
DEBUG: Detected core 24, socket 0, L2 ID 11, L3 ID 0
DEBUG: Detected core 25, socket 0, L2 ID 12, L3 ID 0
DEBUG: Detected core 26, socket 0, L2 ID 13, L3 ID 0
DEBUG: Detected core 27, socket 0, L2 ID 14, L3 ID 0
INFO: resctrl detected
INFO: resctrl not mounted
DEBUG: resctrl mount failed with error 1 - Operation not permitted
DEBUG: resctrl mount failed with error 1 - Operation not permitted
INFO: Unable to mount resctrl
ERROR: os_cap_init() error 3
Error initializing PQoS library!
Hi,
When I am running
pqos
, I'll get the following error:The following is my
lscpu
output:I couldn't figure out how I can resolve this issue. I would appreciate any comment on it.