search

TensorBFS / TensorInference.jl

Probabilistic inference using contraction of tensor networks
https://tensorbfs.github.io/TensorInference.jl/
MIT License
18 stars 2 forks source link

Run benchmarks in CI and push results to TensorBFS/TensorInference-data #19

Closed mroavi closed 1 year ago

mroavi commented 1 year ago

Uses https://github.com/tkf/BenchmarkCI.jl Inspired by how https://github.com/JuliaFolds/Transducers.jl does it.

github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 00:46 - Baseline: 5 Nov 2022 - 00:46 * Package commits: - Target: bb1a87 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: speed user nice sys idle irq #1 2394 MHz 1191 s 1 s 194 s 2408 s 0 s #2 2394 MHz 1090 s 2 s 228 s 2497 s 0 s Memory: 6.78125 GB (5430.01171875 MB free) Uptime: 391.01 sec Load Avg: 1.24 0.85 0.38 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, haswell) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: speed user nice sys idle irq #1 2394 MHz 1253 s 1 s 200 s 2547 s 0 s #2 2394 MHz 1231 s 2 s 233 s 2559 s 0 s Memory: 6.78125 GB (5442.66796875 MB free) Uptime: 411.76 sec Load Avg: 1.16 0.86 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, haswell) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 0:46 * Package commit: bb1a87 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 82.518 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: speed user nice sys idle irq #1 2394 MHz 1191 s 1 s 194 s 2408 s 0 s #2 2394 MHz 1090 s 2 s 228 s 2497 s 0 s Memory: 6.78125 GB (5430.01171875 MB free) Uptime: 391.01 sec Load Avg: 1.24 0.85 0.38 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, haswell) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 0:46 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 83.133 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz: speed user nice sys idle irq #1 2394 MHz 1253 s 1 s 200 s 2547 s 0 s #2 2394 MHz 1231 s 2 s 233 s 2559 s 0 s Memory: 6.78125 GB (5442.66796875 MB free) Uptime: 411.76 sec Load Avg: 1.16 0.86 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, haswell) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 63 Model name: Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Stepping: 2 CPU MHz: 2394.454 BogoMIPS: 4788.90 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 512 KiB L3 cache: 30 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Not affected Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm invpcid_single pti fsgsbase bmi1 avx2 smep bmi2 erms invpcid xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz | | Vendor | :Intel | | Architecture | :Haswell | | Model | Family: 0x06, Model: 0x3f, Stepping: 0x02, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 30720) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 01:14 - Baseline: 5 Nov 2022 - 01:14 * Package commits: - Target: b64925 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------------------------|------------------------------| | `["marginals", "test"]` | 0.00 (5%) :white_check_mark: | 0.01 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 1420 s 1 s 197 s 2819 s 0 s #2 2095 MHz 802 s 2 s 202 s 3433 s 0 s Memory: 6.78125 GB (5451.6015625 MB free) Uptime: 449.89 sec Load Avg: 1.2 0.74 0.33 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 1558 s 1 s 202 s 2869 s 0 s #2 2095 MHz 853 s 2 s 207 s 3569 s 0 s Memory: 6.78125 GB (5397.12890625 MB free) Uptime: 469.28 sec Load Avg: 1.14 0.76 0.35 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:14 * Package commit: b64925 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|----------------:|--------:|----------------:|------------:| | `["marginals", "test"]` | 243.414 μs (5%) | | 207.34 KiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 1420 s 1 s 197 s 2819 s 0 s #2 2095 MHz 802 s 2 s 202 s 3433 s 0 s Memory: 6.78125 GB (5451.6015625 MB free) Uptime: 449.89 sec Load Avg: 1.2 0.74 0.33 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:14 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 58.545 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 1558 s 1 s 202 s 2869 s 0 s #2 2095 MHz 853 s 2 s 207 s 3569 s 0 s Memory: 6.78125 GB (5397.12890625 MB free) Uptime: 469.28 sec Load Avg: 1.14 0.76 0.35 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Stepping: 4 CPU MHz: 2095.174 BogoMIPS: 4190.34 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 01:34 - Baseline: 5 Nov 2022 - 01:35 * Package commits: - Target: 4a226f - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1082 s 2 s 159 s 912 s 0 s #2 2593 MHz 812 s 1 s 185 s 1182 s 0 s Memory: 6.78125 GB (5433.7421875 MB free) Uptime: 224.63 sec Load Avg: 1.22 0.71 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1211 s 2 s 164 s 948 s 0 s #2 2593 MHz 848 s 1 s 189 s 1311 s 0 s Memory: 6.78125 GB (5390.47265625 MB free) Uptime: 241.65 sec Load Avg: 1.16 0.73 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:34 * Package commit: 4a226f * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 48.345 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1082 s 2 s 159 s 912 s 0 s #2 2593 MHz 812 s 1 s 185 s 1182 s 0 s Memory: 6.78125 GB (5433.7421875 MB free) Uptime: 224.63 sec Load Avg: 1.22 0.71 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:35 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 48.534 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1211 s 2 s 164 s 948 s 0 s #2 2593 MHz 848 s 1 s 189 s 1311 s 0 s Memory: 6.78125 GB (5390.47265625 MB free) Uptime: 241.65 sec Load Avg: 1.16 0.73 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Stepping: 7 CPU MHz: 2593.905 BogoMIPS: 5187.81 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 01:47 - Baseline: 5 Nov 2022 - 01:47 * Package commits: - Target: c6037b - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------------------------|------------------------------| | `["marginals", "test"]` | 0.00 (5%) :white_check_mark: | 0.01 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1038 s 2 s 162 s 1831 s 0 s #2 2593 MHz 849 s 0 s 179 s 1992 s 0 s Memory: 6.78125 GB (5451.22265625 MB free) Uptime: 308.51 sec Load Avg: 1.33 0.73 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1174 s 2 s 170 s 1862 s 0 s #2 2593 MHz 890 s 0 s 184 s 2121 s 0 s Memory: 6.78125 GB (5406.328125 MB free) Uptime: 325.88 sec Load Avg: 1.23 0.75 0.32 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:47 * Package commit: c6037b * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|----------------:|--------:|----------------:|------------:| | `["marginals", "test"]` | 236.204 μs (5%) | | 207.34 KiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1038 s 2 s 162 s 1831 s 0 s #2 2593 MHz 849 s 0 s 179 s 1992 s 0 s Memory: 6.78125 GB (5451.22265625 MB free) Uptime: 308.51 sec Load Avg: 1.33 0.73 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:47 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 48.335 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1174 s 2 s 170 s 1862 s 0 s #2 2593 MHz 890 s 0 s 184 s 2121 s 0 s Memory: 6.78125 GB (5406.328125 MB free) Uptime: 325.88 sec Load Avg: 1.23 0.75 0.32 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Stepping: 7 CPU MHz: 2593.905 BogoMIPS: 5187.81 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 01:53 - Baseline: 5 Nov 2022 - 01:54 * Package commits: - Target: f17d59 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1395 s 1 s 170 s 636 s 0 s #2 2593 MHz 586 s 2 s 170 s 1425 s 0 s Memory: 6.78125 GB (5430.66015625 MB free) Uptime: 225.57 sec Load Avg: 1.16 0.7 0.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1457 s 1 s 174 s 749 s 0 s #2 2593 MHz 700 s 2 s 176 s 1484 s 0 s Memory: 6.78125 GB (5463.46875 MB free) Uptime: 243.48 sec Load Avg: 1.18 0.73 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:53 * Package commit: f17d59 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 51.380 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1395 s 1 s 170 s 636 s 0 s #2 2593 MHz 586 s 2 s 170 s 1425 s 0 s Memory: 6.78125 GB (5430.66015625 MB free) Uptime: 225.57 sec Load Avg: 1.16 0.7 0.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 1:54 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 50.826 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1457 s 1 s 174 s 749 s 0 s #2 2593 MHz 700 s 2 s 176 s 1484 s 0 s Memory: 6.78125 GB (5463.46875 MB free) Uptime: 243.48 sec Load Avg: 1.18 0.73 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Stepping: 7 CPU MHz: 2593.907 BogoMIPS: 5187.81 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 02:00 - Baseline: 5 Nov 2022 - 02:00 * Package commits: - Target: ff9b7b - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------------------------|------------------------------| | `["marginals", "test"]` | 0.00 (5%) :white_check_mark: | 0.01 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1250 s 2 s 148 s 764 s 0 s #2 2793 MHz 650 s 1 s 157 s 1361 s 0 s Memory: 6.78125 GB (5472.0 MB free) Uptime: 221.78 sec Load Avg: 1.24 0.87 0.38 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1304 s 2 s 152 s 872 s 0 s #2 2793 MHz 760 s 1 s 161 s 1414 s 0 s Memory: 6.78125 GB (5425.03125 MB free) Uptime: 238.44 sec Load Avg: 1.18 0.87 0.39 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 2:0 * Package commit: ff9b7b * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|----------------:|--------:|----------------:|------------:| | `["marginals", "test"]` | 246.299 μs (5%) | | 207.34 KiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1250 s 2 s 148 s 764 s 0 s #2 2793 MHz 650 s 1 s 157 s 1361 s 0 s Memory: 6.78125 GB (5472.0 MB free) Uptime: 221.78 sec Load Avg: 1.24 0.87 0.38 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 2:0 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 54.748 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1304 s 2 s 152 s 872 s 0 s #2 2793 MHz 760 s 1 s 161 s 1414 s 0 s Memory: 6.78125 GB (5425.03125 MB free) Uptime: 238.44 sec Load Avg: 1.18 0.87 0.39 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 106 Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz Stepping: 6 CPU MHz: 2793.439 BogoMIPS: 5586.87 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 96 KiB L1i cache: 64 KiB L2 cache: 2.5 MiB L3 cache: 48 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Not affected Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz | | Vendor | :Intel | | Architecture | :UnknownIntel | | Model | Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (48, 1280, 49152) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 02:11 - Baseline: 5 Nov 2022 - 02:11 * Package commits: - Target: 905d06 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1017 s 1 s 152 s 1252 s 0 s #2 2593 MHz 893 s 1 s 180 s 1370 s 0 s Memory: 6.78125 GB (5471.3984375 MB free) Uptime: 249.42 sec Load Avg: 1.23 0.68 0.28 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1148 s 1 s 156 s 1288 s 0 s #2 2593 MHz 930 s 1 s 184 s 1499 s 0 s Memory: 6.78125 GB (5470.30078125 MB free) Uptime: 266.43 sec Load Avg: 1.16 0.7 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 2:11 * Package commit: 905d06 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 48.366 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1017 s 1 s 152 s 1252 s 0 s #2 2593 MHz 893 s 1 s 180 s 1370 s 0 s Memory: 6.78125 GB (5471.3984375 MB free) Uptime: 249.42 sec Load Avg: 1.23 0.68 0.28 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 2:11 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 48.076 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 1148 s 1 s 156 s 1288 s 0 s #2 2593 MHz 930 s 1 s 184 s 1499 s 0 s Memory: 6.78125 GB (5470.30078125 MB free) Uptime: 266.43 sec Load Avg: 1.16 0.7 0.3 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Stepping: 7 CPU MHz: 2593.907 BogoMIPS: 5187.81 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 13:21 - Baseline: 5 Nov 2022 - 13:21 * Package commits: - Target: ce45c1 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------|------------------------------|------------------------------| | `["marginals", "test"]` | 0.00 (5%) :white_check_mark: | 0.01 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1096 s 2 s 152 s 2464 s 0 s #2 2793 MHz 808 s 1 s 156 s 2780 s 0 s Memory: 6.78125 GB (5472.28125 MB free) Uptime: 379.13 sec Load Avg: 1.18 0.71 0.32 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1216 s 2 s 156 s 2507 s 0 s #2 2793 MHz 851 s 1 s 161 s 2900 s 0 s Memory: 6.78125 GB (5402.8671875 MB free) Uptime: 395.97 sec Load Avg: 1.12 0.73 0.33 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 13:21 * Package commit: ce45c1 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|----------------:|--------:|----------------:|------------:| | `["marginals", "test"]` | 246.399 μs (5%) | | 207.34 KiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1096 s 2 s 152 s 2464 s 0 s #2 2793 MHz 808 s 1 s 156 s 2780 s 0 s Memory: 6.78125 GB (5472.28125 MB free) Uptime: 379.13 sec Load Avg: 1.18 0.71 0.32 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 13:21 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 54.721 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 1216 s 2 s 156 s 2507 s 0 s #2 2793 MHz 851 s 1 s 161 s 2900 s 0 s Memory: 6.78125 GB (5402.8671875 MB free) Uptime: 395.97 sec Load Avg: 1.12 0.73 0.33 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 106 Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz Stepping: 6 CPU MHz: 2793.437 BogoMIPS: 5586.87 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 96 KiB L1i cache: 64 KiB L2 cache: 2.5 MiB L3 cache: 48 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Not affected Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz | | Vendor | :Intel | | Architecture | :UnknownIntel | | Model | Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (48, 1280, 49152) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
mroavi commented 1 year ago

Finally 😅 (received something at https://github.com/TensorBFS/TensorInference-data)

github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 14:14 - Baseline: 5 Nov 2022 - 14:15 * Package commits: - Target: b29035 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |----|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 2090 s 1 s 176 s 632 s 0 s #2 2095 MHz 607 s 2 s 207 s 2094 s 0 s Memory: 6.78125 GB (5320.11328125 MB free) Uptime: 297.26 sec Load Avg: 1.09 0.84 0.39 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 2137 s 1 s 181 s 761 s 0 s #2 2095 MHz 737 s 2 s 213 s 2140 s 0 s Memory: 6.78125 GB (5456.79296875 MB free) Uptime: 315.48 sec Load Avg: 1.07 0.85 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 14:14 * Package commit: b29035 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |--------------------------------------------|---------------:|--------:|---------------:|------------:| | `["marginals_cached", "marginals-cached"]` | 60.387 ms (5%) | | 36.95 MiB (1%) | 182679 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals_cached"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 2090 s 1 s 176 s 632 s 0 s #2 2095 MHz 607 s 2 s 207 s 2094 s 0 s Memory: 6.78125 GB (5320.11328125 MB free) Uptime: 297.26 sec Load Avg: 1.09 0.84 0.39 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 14:15 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 53.825 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 2137 s 1 s 181 s 761 s 0 s #2 2095 MHz 737 s 2 s 213 s 2140 s 0 s Memory: 6.78125 GB (5456.79296875 MB free) Uptime: 315.48 sec Load Avg: 1.07 0.85 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Stepping: 4 CPU MHz: 2095.243 BogoMIPS: 4190.48 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 15:59 - Baseline: 5 Nov 2022 - 15:59 * Package commits: - Target: 6026c4 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |----|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 2208 s 2 s 197 s 3451 s 0 s #2 2593 MHz 1225 s 0 s 184 s 4470 s 0 s Memory: 6.78125 GB (5016.171875 MB free) Uptime: 595.35 sec Load Avg: 1.02 0.81 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 2251 s 2 s 202 s 3572 s 0 s #2 2593 MHz 1348 s 0 s 189 s 4513 s 0 s Memory: 6.78125 GB (5411.0078125 MB free) Uptime: 612.38 sec Load Avg: 1.01 0.82 0.41 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 15:59 * Package commit: 6026c4 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------|----------------:|-----------:|---------------:|------------:| | `["map", "map"]` | 257.285 ms (5%) | 8.025 ms | 91.14 MiB (1%) | 158842 | | `["mar", "mar"]` | 58.910 ms (5%) | | 34.74 MiB (1%) | 182389 | | `["mmap", "mmap-1"]` | 140.855 ms (5%) | | 35.84 MiB (1%) | 78690 | | `["mmap", "mmap-2"]` | 2.879 s (5%) | 210.814 ms | 1.59 GiB (1%) | 81587 | | `["mmap", "mmap-3"]` | 383.685 ms (5%) | 8.282 ms | 77.52 MiB (1%) | 156765 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["map"]` - `["mar"]` - `["mmap"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 2208 s 2 s 197 s 3451 s 0 s #2 2593 MHz 1225 s 0 s 184 s 4470 s 0 s Memory: 6.78125 GB (5016.171875 MB free) Uptime: 595.35 sec Load Avg: 1.02 0.81 0.4 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 15:59 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 47.871 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz: speed user nice sys idle irq #1 2593 MHz 2251 s 2 s 202 s 3572 s 0 s #2 2593 MHz 1348 s 0 s 189 s 4513 s 0 s Memory: 6.78125 GB (5411.0078125 MB free) Uptime: 612.38 sec Load Avg: 1.01 0.82 0.41 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, skylake-avx512) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Stepping: 7 CPU MHz: 2593.905 BogoMIPS: 5187.81 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 2 MiB L3 cache: 35.8 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Vulnerable Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x07, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
mroavi commented 1 year ago

I had to disable the marginals CUDA benchmark because it is causing the following error:

ERROR: Could not find the CUDA driver library. Please make sure you have installed the NVIDIA driver for your GPU. If you're sure it's installed, look for libcuda.so in your system and make sure it's discoverable by the linker. Typically, that involves an entry in '/etc/ld.so.conf', or setting LD_LIBRARY_PATH.

https://github.com/TensorBFS/TensorInference.jl/actions/runs/3400670036/jobs/5655250476

It's strange because the marginals CUDA test does work on CI. I wonder if I have to set LD_LIBRARY_PATH to some value. Any idea @GiggleLiu ?

github-actions[bot] commented 1 year ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmarks: - Target: 5 Nov 2022 - 16:50 - Baseline: 5 Nov 2022 - 16:51 * Package commits: - Target: 3dced4 - Baseline: ab5b04 * Julia commits: - Target: 36034a - Baseline: 36034a * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |----|------------|--------------| ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: ## Julia versioninfo ### Target ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 2718 s 2 s 166 s 2424 s 0 s #2 2793 MHz 642 s 1 s 156 s 4513 s 0 s Memory: 6.781246185302734 GB (5145.80078125 MB free) Uptime: 536.37 sec Load Avg: 1.03 0.86 0.44 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` ### Baseline ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 2847 s 2 s 171 s 2459 s 0 s #2 2793 MHz 678 s 1 s 159 s 4642 s 0 s Memory: 6.781246185302734 GB (5421.8984375 MB free) Uptime: 553.14 sec Load Avg: 1.02 0.87 0.45 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 16:50 * Package commit: 3dced4 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------|----------------:|---------:|---------------:|------------:| | `["map", "map"]` | 290.844 ms (5%) | 6.742 ms | 94.84 MiB (1%) | 159256 | | `["mar", "mar"]` | 48.240 ms (5%) | | 33.94 MiB (1%) | 183540 | | `["mmap", "mmap-1"]` | 119.375 ms (5%) | | 28.79 MiB (1%) | 80254 | | `["mmap", "mmap-2"]` | 83.042 ms (5%) | | 38.12 MiB (1%) | 81015 | | `["mmap", "mmap-3"]` | 480.571 ms (5%) | 6.347 ms | 98.25 MiB (1%) | 155750 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["map"]` - `["mar"]` - `["mmap"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 2718 s 2 s 166 s 2424 s 0 s #2 2793 MHz 642 s 1 s 156 s 4513 s 0 s Memory: 6.781246185302734 GB (5145.80078125 MB free) Uptime: 536.37 sec Load Avg: 1.03 0.86 0.44 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/TensorInference.jl/TensorInference.jl* ## Job Properties * Time of benchmark: 5 Nov 2022 - 16:51 * Package commit: ab5b04 * Julia commit: 36034a * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------|---------------:|--------:|---------------:|------------:| | `["marginals", "test"]` | 55.019 ms (5%) | | 15.76 MiB (1%) | 7 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["marginals"]` ## Julia versioninfo ``` Julia Version 1.8.2 Commit 36034abf260 (2022-09-29 15:21 UTC) Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 20.04.5 LTS uname: Linux 5.15.0-1022-azure #27~20.04.1-Ubuntu SMP Mon Oct 17 02:03:50 UTC 2022 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz: speed user nice sys idle irq #1 2793 MHz 2847 s 2 s 171 s 2459 s 0 s #2 2793 MHz 678 s 1 s 159 s 4642 s 0 s Memory: 6.781246185302734 GB (5421.8984375 MB free) Uptime: 553.14 sec Load Avg: 1.02 0.87 0.45 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-13.0.1 (ORCJIT, icelake-server) Threads: 1 on 2 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 1 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 106 Model name: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz Stepping: 6 CPU MHz: 2793.438 BogoMIPS: 5586.87 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 96 KiB L1i cache: 64 KiB L2 cache: 2.5 MiB L3 cache: 48 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown Vulnerability Retbleed: Not affected Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz | | Vendor | :Intel | | Architecture | :UnknownIntel | | Model | Family: 0x06, Model: 0x6a, Stepping: 0x06, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (48, 1280, 49152) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
GiggleLiu commented 1 year ago

I had to disable the marginals CUDA benchmark because it is causing the following error:

ERROR: Could not find the CUDA driver library. Please make sure you have installed the NVIDIA driver for your GPU. If you're sure it's installed, look for libcuda.so in your system and make sure it's discoverable by the linker. Typically, that involves an entry in '/etc/ld.so.conf', or setting LD_LIBRARY_PATH.

https://github.com/TensorBFS/TensorInference.jl/actions/runs/3400670036/jobs/5655250476

It's strange because the marginals CUDA test does work on CI. I wonder if I have to set LD_LIBRARY_PATH to some value. Any idea @GiggleLiu ?

Sorry, just saw this reply. Why is this strange? I think CUDA in not available in most CI.