intel / intel-cmt-cat

User space software for Intel(R) Resource Director Technology
http://www.intel.com/content/www/us/en/architecture-and-technology/resource-director-technology.html
Other
693 stars 183 forks source link

ERROR: os_cap_init() error 3 #211

Closed igordptx closed 2 years ago

igordptx commented 2 years ago

I installed cat and enabled RDT in kernel. I get this error when trying to use pqos.

igor@acsl-serv02:~$ sudo pqos -I -D
NOTE:  Mixed use of MSR and kernel interfaces to manage
       CAT or CMT & MBM may lead to unexpected behavior.
OS capabilities (Linux kernel 4.15.18-igor)
    Monitoring
        Cache Monitoring Technology (CMT) events:
            LLC Occupancy (LLC)
                 scale factor: 1
                 max rmid: 128
        Memory Bandwidth Monitoring (MBM) events:
            Local Memory Bandwidth (LMEM)
                 scale factor: 1
                 max rmid: 128
            Total Memory Bandwidth (TMEM)
                 scale factor: 1
                 max rmid: 128
            Remote Memory Bandwidth (RMEM) (calculated)
                 scale factor: 1
                 max rmid: 128
        PMU events:
            LLC misses
                 scale factor: 1
                 max rmid: 128
            Instructions/Clock (IPC)
                 scale factor: 1
                 max rmid: 128
    Allocation
        Cache Allocation Technology (CAT)
            L3 CAT
                CDP: disabled
                Num COS: 8
                Way size: 2097152 bytes
                Ways contention bit-mask: 0x600
                Min CBM bits: 1
                Max CBM bits: 11
        Memory Bandwidth Allocation (MBA)
            Num COS: 8
            Granularity: 10
            Min B/W: 10
            Type: linear
Cache information
    L3 Cache
        Num ways: 11
        Way size: 2097152 bytes
        Num sets: 32768
        Line size: 64 bytes
        Total size: 23068672 bytes
    L2 Cache
        Num ways: 16
        Way size: 65536 bytes
        Num sets: 1024
        Line size: 64 bytes
        Total size: 1048576 bytes
pqos -s
NOTE:  Mixed use of MSR and kernel interfaces to manage
       CAT or CMT & MBM may lead to unexpected behavior.
ERROR: Could not open schemata file /sys/fs/resctrl/COS7/schemata for COS 7
L3CA/MBA COS definitions for Socket 0:
    L3CA COS0 => MASK 0x7ff
    L3CA COS1 => MASK 0x7ff
    L3CA COS2 => MASK 0x7ff
    L3CA COS3 => MASK 0x7ff
    L3CA COS4 => MASK 0x7ff
    L3CA COS5 => MASK 0x7ff
    L3CA COS6 => MASK 0x7ff
    L3CA COS7 => MASK 0x7ff
    MBA COS0 => 100% available
    MBA COS1 => 100% available
    MBA COS2 => 100% available
    MBA COS3 => 100% available
    MBA COS4 => 100% available
    MBA COS5 => 100% available
    MBA COS6 => 100% available
    MBA COS7 => 100% available
L3CA/MBA COS definitions for Socket 1:
    L3CA COS0 => MASK 0x7ff
    L3CA COS1 => MASK 0x7ff
    L3CA COS2 => MASK 0x7ff
    L3CA COS3 => MASK 0x7ff
    L3CA COS4 => MASK 0x7ff
    L3CA COS5 => MASK 0x7ff
    L3CA COS6 => MASK 0x7ff
    L3CA COS7 => MASK 0x7ff
    MBA COS0 => 100% available
    MBA COS1 => 100% available
    MBA COS2 => 100% available
    MBA COS3 => 100% available
    MBA COS4 => 100% available
    MBA COS5 => 100% available
    MBA COS6 => 100% available
    MBA COS7 => 100% available
Core information for socket 0:
    Core 0, L2ID 0, L3ID 0 => COS0
    Core 1, L2ID 1, L3ID 0 => COS0
    Core 2, L2ID 2, L3ID 0 => COS0
    Core 3, L2ID 3, L3ID 0 => COS0
    Core 4, L2ID 4, L3ID 0 => COS0
    Core 5, L2ID 5, L3ID 0 => COS0
    Core 6, L2ID 6, L3ID 0 => COS0
    Core 7, L2ID 7, L3ID 0 => COS0
    Core 8, L2ID 8, L3ID 0 => COS0
    Core 9, L2ID 9, L3ID 0 => COS0
    Core 10, L2ID 10, L3ID 0 => COS0
    Core 11, L2ID 11, L3ID 0 => COS0
    Core 12, L2ID 12, L3ID 0 => COS0
    Core 13, L2ID 13, L3ID 0 => COS0
    Core 14, L2ID 14, L3ID 0 => COS0
    Core 15, L2ID 15, L3ID 0 => COS0
Core information for socket 1:
    Core 16, L2ID 16, L3ID 1 => COS0
    Core 17, L2ID 17, L3ID 1 => COS0
    Core 18, L2ID 18, L3ID 1 => COS0
    Core 19, L2ID 19, L3ID 1 => COS0
    Core 20, L2ID 20, L3ID 1 => COS0
    Core 21, L2ID 21, L3ID 1 => COS0
    Core 22, L2ID 22, L3ID 1 => COS0
    Core 23, L2ID 23, L3ID 1 => COS0
    Core 24, L2ID 24, L3ID 1 => COS0
    Core 25, L2ID 25, L3ID 1 => COS0
    Core 26, L2ID 26, L3ID 1 => COS0
    Core 27, L2ID 27, L3ID 1 => COS0
    Core 28, L2ID 28, L3ID 1 => COS0
    Core 29, L2ID 29, L3ID 1 => COS0
    Core 30, L2ID 30, L3ID 1 => COS0
    Core 31, L2ID 31, L3ID 1 => COS0
PID association information:
    COS1 => (none)
    COS2 => (none)
    COS3 => (none)
    COS4 => (none)
    COS5 => (none)
    COS6 => (none)
    COS7 => (none)
 pqos -d
NOTE:  Mixed use of MSR and kernel interfaces to manage
       CAT or CMT & MBM may lead to unexpected behavior.
ERROR: Could not open schemata file /sys/fs/resctrl/COS7/schemata for COS 7
OS capabilities (Linux kernel 4.15.18-igor)
    Monitoring
        Cache Monitoring Technology (CMT) events:
            LLC Occupancy (LLC)
        Memory Bandwidth Monitoring (MBM) events:
            Local Memory Bandwidth (LMEM)
            Total Memory Bandwidth (TMEM)
            Remote Memory Bandwidth (RMEM) (calculated)
        PMU events:
            LLC misses
            Instructions/Clock (IPC)
    Allocation
        Cache Allocation Technology (CAT)
            L3 CAT
                CDP: disabled
                Num COS: 8
        Memory Bandwidth Allocation (MBA)
            Num COS: 8

machine:

Architecture:        x86_64
CPU op-mode(s):      32-bit, 64-bit
Byte Order:          Little Endian
CPU(s):              32
On-line CPU(s) list: 0-31
Thread(s) per core:  1
Core(s) per socket:  16
Socket(s):           2
NUMA node(s):        2
Vendor ID:           GenuineIntel
CPU family:          6
Model:               85
Model name:          Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
Stepping:            7
CPU MHz:             800.115
CPU max MHz:         2101.0000
CPU min MHz:         800.0000
BogoMIPS:            4200.00
Virtualization:      VT-x
L1d cache:           32K
L1i cache:           32K
L2 cache:            1024K
L3 cache:            22528K
NUMA node0 CPU(s):   0-15
NUMA node1 CPU(s):   16-31
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single intel_ppin ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts pku ospke avx512_vnni md_clear flush_l1d arch_capabilities
varungohil commented 2 years ago

Hey @igordptx, I am also facing the ERROR: os_cap_init() error 3 error when running pqos -s. I am guessing you were able to resolve the error as you closed this issue. Could you please let me know how you resolved the error? Thanks!