issues
search
BioJulia
/
GenomicFeatures.jl
Tools for genomic features in Julia.
Other
32
stars
13
forks
source link
Test downstream error handling
#42
Closed
CiaranOMara
closed
2 years ago
github-actions[bot]
commented
2 years ago
Benchmark result
# Judge result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmarks: - Target: 20 Oct 2021 - 23:55 - Baseline: 20 Oct 2021 - 23:56 * Package commits: - Target: e64a5b - Baseline: d6de93 * Julia commits: - Target: ae8452 - Baseline: ae8452 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------------------------------------------------------------|------------------------------|---------------| | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 1.05 (5%) | 1.05 (1%) :x: | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 1.08 (5%) :x: | 1.00 (1%) | | `["insert", "shorthand"]` | 1.15 (5%) :x: | 1.00 (1%) | | `["push", "Vector{Interval{Int64}}"]` | 0.93 (5%) :white_check_mark: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ### Target ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 949 s 0 s 146 s 2140 s 0 s #2 2294 MHz 1592 s 0 s 226 s 1434 s 0 s Memory: 6.790924072265625 GB (3261.5859375 MB free) Uptime: 330.0 sec Load Avg: 1.06 0.71 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` ### Baseline ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1571 s 0 s 188 s 2237 s 0 s #2 2294 MHz 1698 s 0 s 230 s 2082 s 0 s Memory: 6.790924072265625 GB (3202.80859375 MB free) Uptime: 406.0 sec Load Avg: 1.01 0.78 0.37 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Target result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 20 Oct 2021 - 23:55 * Package commit: e64a5b * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.170 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.080 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.130 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.789 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 869.388 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 432.185 ms (5%) | 12.619 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 125.281 ms (5%) | 25.505 ms | 227.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 35.641 ms (5%) | 6.152 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 116.663 ms (5%) | 23.118 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 38.400 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 37.101 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 256.402 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 156.601 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 949 s 0 s 146 s 2140 s 0 s #2 2294 MHz 1592 s 0 s 226 s 1434 s 0 s Memory: 6.790924072265625 GB (3261.5859375 MB free) Uptime: 330.0 sec Load Avg: 1.06 0.71 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Baseline result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 20 Oct 2021 - 23:56 * Package commit: d6de93 * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.120 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.100 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.120 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.767 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 830.612 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 449.291 ms (5%) | 8.320 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 119.874 ms (5%) | 22.568 ms | 217.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 32.955 ms (5%) | 5.178 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 116.197 ms (5%) | 23.669 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 33.401 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 35.500 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 276.203 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 155.001 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1571 s 0 s 188 s 2237 s 0 s #2 2294 MHz 1698 s 0 s 230 s 2082 s 0 s Memory: 6.790924072265625 GB (3202.80859375 MB free) Uptime: 406.0 sec Load Avg: 1.01 0.78 0.37 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Stepping: 1 CPU MHz: 2294.687 BogoMIPS: 4589.37 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 512 KiB L3 cache: 50 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz | | Vendor | :Intel | | Architecture | :Broadwell | | Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 51200) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot]
commented
2 years ago
Benchmark result
# Judge result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmarks: - Target: 21 Oct 2021 - 00:14 - Baseline: 21 Oct 2021 - 00:15 * Package commits: - Target: 9404d0 - Baseline: d6de93 * Julia commits: - Target: ae8452 - Baseline: ae8452 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------------------------------------------------------------|------------------------------|---------------| | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 0.93 (5%) :white_check_mark: | 1.00 (1%) | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 1.10 (5%) :x: | 1.00 (1%) | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 1.04 (5%) | 1.05 (1%) :x: | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 0.93 (5%) :white_check_mark: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ### Target ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 546 s 1 s 130 s 3077 s 0 s #2 2294 MHz 1862 s 1 s 229 s 1692 s 0 s Memory: 6.790924072265625 GB (3380.66015625 MB free) Uptime: 383.0 sec Load Avg: 1.07 0.67 0.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` ### Baseline ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1141 s 1 s 170 s 3161 s 0 s #2 2294 MHz 1953 s 1 s 233 s 2315 s 0 s Memory: 6.790924072265625 GB (3288.7421875 MB free) Uptime: 455.0 sec Load Avg: 1.02 0.74 0.35 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Target result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 21 Oct 2021 - 0:14 * Package commit: 9404d0 * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.070 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.090 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.190 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.540 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 831.507 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 408.313 ms (5%) | 13.663 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 114.627 ms (5%) | 21.610 ms | 227.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 32.349 ms (5%) | 5.320 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 105.337 ms (5%) | 12.810 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 32.200 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 31.800 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 266.400 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 152.700 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 546 s 1 s 130 s 3077 s 0 s #2 2294 MHz 1862 s 1 s 229 s 1692 s 0 s Memory: 6.790924072265625 GB (3380.66015625 MB free) Uptime: 383.0 sec Load Avg: 1.07 0.67 0.29 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Baseline result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 21 Oct 2021 - 0:15 * Package commit: d6de93 * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.110 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.120 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.140 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.660 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 831.507 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 369.617 ms (5%) | 8.339 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 110.561 ms (5%) | 18.657 ms | 217.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 31.483 ms (5%) | 5.144 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 113.313 ms (5%) | 23.060 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 33.300 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 32.900 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 274.300 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 150.501 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1141 s 1 s 170 s 3161 s 0 s #2 2294 MHz 1953 s 1 s 233 s 2315 s 0 s Memory: 6.790924072265625 GB (3288.7421875 MB free) Uptime: 455.0 sec Load Avg: 1.02 0.74 0.35 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Stepping: 1 CPU MHz: 2294.685 BogoMIPS: 4589.37 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 512 KiB L3 cache: 50 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz | | Vendor | :Intel | | Architecture | :Broadwell | | Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 51200) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot]
commented
2 years ago github-actions[bot]
commented
2 years ago
Benchmark result
# Judge result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmarks: - Target: 20 Oct 2021 - 23:55 - Baseline: 20 Oct 2021 - 23:56 * Package commits: - Target: e64a5b - Baseline: d6de93 * Julia commits: - Target: ae8452 - Baseline: ae8452 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------------------------------------------------------------|------------------------------|---------------| | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 1.05 (5%) | 1.05 (1%) :x: | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 1.08 (5%) :x: | 1.00 (1%) | | `["insert", "shorthand"]` | 1.15 (5%) :x: | 1.00 (1%) | | `["push", "Vector{Interval{Int64}}"]` | 0.93 (5%) :white_check_mark: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ### Target ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 949 s 0 s 146 s 2140 s 0 s #2 2294 MHz 1592 s 0 s 226 s 1434 s 0 s Memory: 6.790924072265625 GB (3261.5859375 MB free) Uptime: 330.0 sec Load Avg: 1.06 0.71 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` ### Baseline ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1571 s 0 s 188 s 2237 s 0 s #2 2294 MHz 1698 s 0 s 230 s 2082 s 0 s Memory: 6.790924072265625 GB (3202.80859375 MB free) Uptime: 406.0 sec Load Avg: 1.01 0.78 0.37 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Target result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 20 Oct 2021 - 23:55 * Package commit: e64a5b * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.170 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.080 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.130 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.789 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 869.388 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 432.185 ms (5%) | 12.619 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 125.281 ms (5%) | 25.505 ms | 227.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 35.641 ms (5%) | 6.152 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 116.663 ms (5%) | 23.118 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 38.400 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 37.101 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 256.402 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 156.601 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 949 s 0 s 146 s 2140 s 0 s #2 2294 MHz 1592 s 0 s 226 s 1434 s 0 s Memory: 6.790924072265625 GB (3261.5859375 MB free) Uptime: 330.0 sec Load Avg: 1.06 0.71 0.31 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Baseline result # Benchmark Report for */home/runner/work/GenomicFeatures.jl/GenomicFeatures.jl* ## Job Properties * Time of benchmark: 20 Oct 2021 - 23:56 * Package commit: d6de93 * Julia commit: ae8452 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["accessors", "Vector{Interval{Int64}}", "leftposition"]` | 1.120 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "metadata"]` | 1.100 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "rightposition"]` | 1.120 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "seqname"]` | 1.767 μs (5%) | | 7.94 KiB (1%) | 1 | | `["accessors", "Vector{Interval{Int64}}", "strand"]` | 830.612 ns (5%) | | 1.06 KiB (1%) | 1 | | `["eachoverlap", "IntervalCollection{Int64}, IntervalCollection{Int64}"]` | 449.291 ms (5%) | 8.320 ms | 99.91 MiB (1%) | 591412 | | `["eachoverlap", "IntervalCollection{Int64}, Vector{Interval{Int64}}"]` | 119.874 ms (5%) | 22.568 ms | 217.44 MiB (1%) | 2036657 | | `["eachoverlap", "Vector{Interval{Int64}}, IntervalCollection{Int64}"]` | 32.955 ms (5%) | 5.178 ms | 81.86 MiB (1%) | 295706 | | `["eachoverlap", "Vector{Interval{Int64}}, Vector{Interval{Int64}}"]` | 116.197 ms (5%) | 23.669 ms | 211.00 MiB (1%) | 2035654 | | `["insert", "shorthand"]` | 33.401 μs (5%) | | 78.81 KiB (1%) | 96 | | `["insert", "type"]` | 35.500 μs (5%) | | 78.81 KiB (1%) | 96 | | `["push", "Vector{Interval{Int64}}"]` | 276.203 μs (5%) | | 129.16 KiB (1%) | 1725 | | `["sort", "Vector{Interval{Int64}}"]` | 155.001 μs (5%) | | 58.84 KiB (1%) | 4 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["accessors", "Vector{Interval{Int64}}"]` - `["eachoverlap"]` - `["insert"]` - `["push"]` - `["sort"]` ## Julia versioninfo ``` Julia Version 1.6.3 Commit ae8452a9e0 (2021-09-23 17:34 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 20.04.3 LTS uname: Linux 5.8.0-1042-azure #45~20.04.1-Ubuntu SMP Wed Sep 15 14:24:15 UTC 2021 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 1571 s 0 s 188 s 2237 s 0 s #2 2294 MHz 1698 s 0 s 230 s 2082 s 0 s Memory: 6.790924072265625 GB (3202.80859375 MB free) Uptime: 406.0 sec Load Avg: 1.01 0.78 0.37 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-11.0.1 (ORCJIT, broadwell) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 46 bits physical, 48 bits virtual CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Stepping: 1 CPU MHz: 2294.687 BogoMIPS: 4589.37 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB L1i cache: 64 KiB L2 cache: 512 KiB L3 cache: 50 MiB NUMA node0 CPU(s): 0,1 Vulnerability Itlb multihit: KVM: Mitigation: VMX unsupported Vulnerability L1tf: Mitigation; PTE Inversion Vulnerability Mds: Mitigation; Clear CPU buffers; SMT Host state unknown Vulnerability Meltdown: Mitigation; PTI Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Full generic retpoline, STIBP disabled, RSB filling Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT Host state unknown Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz | | Vendor | :Intel | | Architecture | :Broadwell | | Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 51200) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 46 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |