search

JuliaFolds / BangBang.jl

Immutables as mutables, mutables as immutables.
MIT License
108 stars 11 forks source link

Add `collector` and `finish!` #143

Closed tkf closed 4 years ago

github-actions[bot] commented 4 years ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmarks: - Target: 21 May 2020 - 05:19 - Baseline: 21 May 2020 - 05:20 * Package commits: - Target: a253fd - Baseline: 01bb10 * Julia commits: - Target: 381693 - Baseline: 381693 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------------------------------------------|------------------------------|--------------| | `["append", "append!!(::Vector, ::SingletonVector)"]` | 0.86 (5%) :white_check_mark: | 1.00 (1%) | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 0.78 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Categorical"]` | 0.87 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-Int"]` | 0.86 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-String"]` | 1.09 (5%) :x: | 1.00 (1%) | | `["dataframes", "String-String"]` | 0.95 (5%) :white_check_mark: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ### Target ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 8611 s 0 s 1291 s 27768 s 0 s #2 2095 MHz 17156 s 0 s 1768 s 18736 s 0 s Memory: 6.764888763427734 GB (3587.015625 MB free) Uptime: 390.0 sec Load Avg: 1.0 0.7255859375 0.3447265625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` ### Baseline ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 12288 s 0 s 1360 s 31646 s 0 s #2 2095 MHz 21093 s 0 s 1844 s 22357 s 0 s Memory: 6.764888763427734 GB (3600.37890625 MB free) Uptime: 467.0 sec Load Avg: 1.0 0.79345703125 0.40185546875 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Target result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 5:19 * Package commit: a253fd * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 13.901 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 400.501 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 2.900 ns (5%) | | | | | `["collectors", ":comp => \"filter\"", ":impl => \"base\""]` | 35.900 μs (5%) | | 128.66 KiB (1%) | 14 | | `["collectors", ":comp => \"filter\"", ":impl => \"coll\""]` | 41.501 μs (5%) | | 284.84 KiB (1%) | 5013 | | `["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""]` | 40.000 μs (5%) | | 312.75 KiB (1%) | 5005 | | `["collectors", ":comp => \"filter\"", ":impl => \"vec\""]` | 39.200 μs (5%) | | 128.72 KiB (1%) | 15 | | `["collectors", ":comp => \"map\"", ":impl => \"coll\""]` | 5.500 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"man\""]` | 5.767 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""]` | 10.400 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"vec\""]` | 65.900 μs (5%) | | 256.64 KiB (1%) | 14 | | `["dataframes", "Categorical"]` | 709.685 ms (5%) | 83.388 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 1.052 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.253 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.518 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.372 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["collectors", ":comp => \"filter\""]` - `["collectors", ":comp => \"map\""]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 8611 s 0 s 1291 s 27768 s 0 s #2 2095 MHz 17156 s 0 s 1768 s 18736 s 0 s Memory: 6.764888763427734 GB (3587.015625 MB free) Uptime: 390.0 sec Load Avg: 1.0 0.7255859375 0.3447265625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Baseline result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 5:20 * Package commit: 01bb10 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 13.587 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 465.109 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 3.700 ns (5%) | | | | | `["dataframes", "Categorical"]` | 818.328 ms (5%) | 92.438 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 1.047 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.450 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.399 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.448 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 12288 s 0 s 1360 s 31646 s 0 s #2 2095 MHz 21093 s 0 s 1844 s 22357 s 0 s Memory: 6.764888763427734 GB (3600.37890625 MB free) Uptime: 467.0 sec Load Avg: 1.0 0.79345703125 0.40185546875 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Stepping: 4 CPU MHz: 2095.079 BogoMIPS: 4190.15 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 36608K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 44 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
tkf commented 4 years ago

It looks like the speed up with "filter" case requires Julia 1.6 (1.5?):

In 1.4.1:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.378 μs)
          :impl => "vec" => Trial(50.589 μs)
          :impl => "coll" => Trial(3.267 μs)
          :impl => "man" => Trial(3.335 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(28.013 μs)
          :impl => "vec" => Trial(29.273 μs)
          :impl => "coll" => Trial(43.366 μs)
          :impl => "nonexpanding" => Trial(39.645 μs)

In 1.6.0-DEV.62:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.244 μs)
          :impl => "vec" => Trial(50.121 μs)
          :impl => "coll" => Trial(4.174 μs)
          :impl => "man" => Trial(3.924 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(30.483 μs)
          :impl => "vec" => Trial(30.203 μs)
          :impl => "coll" => Trial(14.574 μs)
          :impl => "nonexpanding" => Trial(10.516 μs)
codecov-commenter commented 4 years ago

Codecov Report

Merging #143 into master will increase coverage by 0.21%. The diff coverage is 93.44%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #143      +/-   ##
==========================================
+ Coverage   91.88%   92.09%   +0.21%     
==========================================
  Files          20       21       +1     
  Lines         382      443      +61     
==========================================
+ Hits          351      408      +57     
- Misses         31       35       +4
Impacted Files Coverage Δ
src/BangBang.jl 100.00% <ø> (ø)
src/NoBang/base.jl 94.80% <0.00%> (-1.25%) :arrow_down:
src/base.jl 82.97% <33.33%> (-1.64%) :arrow_down:
src/core.jl 82.35% <50.00%> (-4.32%) :arrow_down:
src/NoBang/emptycontainers.jl 96.15% <100.00%> (+2.82%) :arrow_up:
src/NoBang/singletoncontainers.jl 100.00% <100.00%> (ø)
src/collectors.jl 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 01bb108...92e0d90. Read the comment docs.

github-actions[bot] commented 4 years ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmarks: - Target: 21 May 2020 - 05:33 - Baseline: 21 May 2020 - 05:34 * Package commits: - Target: 9ba90b - Baseline: 01bb10 * Julia commits: - Target: 381693 - Baseline: 381693 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------------------------------------------|------------------------------|--------------| | `["dataframes", "Categorical"]` | 0.83 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-String"]` | 1.05 (5%) :x: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ### Target ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 20849 s 0 s 1442 s 7848 s 0 s #2 2294 MHz 5124 s 0 s 1326 s 23834 s 0 s Memory: 6.764888763427734 GB (3532.9453125 MB free) Uptime: 318.0 sec Load Avg: 1.162109375 0.8173828125 0.37353515625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` ### Baseline ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 22638 s 0 s 1501 s 13651 s 0 s #2 2294 MHz 10955 s 0 s 1417 s 25560 s 0 s Memory: 6.764888763427734 GB (3541.859375 MB free) Uptime: 394.0 sec Load Avg: 1.04443359375 0.86083984375 0.4248046875 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Target result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 5:33 * Package commit: 9ba90b * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 10.565 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 407.701 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 2.800 ns (5%) | | | | | `["collectors", ":comp => \"filter\"", ":impl => \"base\""]` | 32.200 μs (5%) | | 128.66 KiB (1%) | 14 | | `["collectors", ":comp => \"filter\"", ":impl => \"coll\""]` | 41.300 μs (5%) | | 284.84 KiB (1%) | 5013 | | `["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""]` | 32.400 μs (5%) | | 312.75 KiB (1%) | 5005 | | `["collectors", ":comp => \"filter\"", ":impl => \"vec\""]` | 34.400 μs (5%) | | 128.72 KiB (1%) | 15 | | `["collectors", ":comp => \"map\"", ":impl => \"coll\""]` | 5.157 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"man\""]` | 4.272 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""]` | 8.800 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"vec\""]` | 59.301 μs (5%) | | 256.64 KiB (1%) | 14 | | `["dataframes", "Categorical"]` | 730.624 ms (5%) | 93.220 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 962.603 μs (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.326 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.370 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.273 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["collectors", ":comp => \"filter\""]` - `["collectors", ":comp => \"map\""]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 20849 s 0 s 1442 s 7848 s 0 s #2 2294 MHz 5124 s 0 s 1326 s 23834 s 0 s Memory: 6.764888763427734 GB (3532.9453125 MB free) Uptime: 318.0 sec Load Avg: 1.162109375 0.8173828125 0.37353515625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Baseline result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 5:34 * Package commit: 01bb10 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 10.597 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 411.401 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 2.800 ns (5%) | | | | | `["dataframes", "Categorical"]` | 876.221 ms (5%) | 98.669 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 936.102 μs (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.348 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.303 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.267 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 22638 s 0 s 1501 s 13651 s 0 s #2 2294 MHz 10955 s 0 s 1417 s 25560 s 0 s Memory: 6.764888763427734 GB (3541.859375 MB free) Uptime: 394.0 sec Load Avg: 1.04443359375 0.86083984375 0.4248046875 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Stepping: 1 CPU MHz: 2294.684 BogoMIPS: 4589.36 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 51200K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz | | Vendor | :Intel | | Architecture | :Broadwell | | Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 51200) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 44 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 4 years ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmarks: - Target: 21 May 2020 - 06:06 - Baseline: 21 May 2020 - 06:07 * Package commits: - Target: ed5e23 - Baseline: 01bb10 * Julia commits: - Target: 381693 - Baseline: 381693 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------------------------------------------|------------------------------|--------------| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 1.05 (5%) :x: | 1.00 (1%) | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 0.87 (5%) :white_check_mark: | 1.00 (1%) | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 0.78 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Categorical"]` | 0.87 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-Int"]` | 0.86 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-String"]` | 0.75 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "String-String"]` | 1.06 (5%) :x: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ### Target ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 19999 s 0 s 1730 s 33487 s 0 s #2 2095 MHz 6009 s 0 s 1422 s 45860 s 0 s Memory: 6.764888763427734 GB (3616.9765625 MB free) Uptime: 604.0 sec Load Avg: 1.103515625 0.92529296875 0.54150390625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` ### Baseline ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 26476 s 0 s 1818 s 34654 s 0 s #2 2095 MHz 7248 s 0 s 1479 s 52296 s 0 s Memory: 6.764888763427734 GB (3604.359375 MB free) Uptime: 682.0 sec Load Avg: 1.09033203125 0.97314453125 0.59228515625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Target result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 6:6 * Package commit: ed5e23 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 13.998 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 465.334 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 2.900 ns (5%) | | | | | `["collectors", ":comp => \"filter\"", ":impl => \"base\""]` | 43.603 μs (5%) | | 128.66 KiB (1%) | 14 | | `["collectors", ":comp => \"filter\"", ":impl => \"coll\""]` | 44.903 μs (5%) | | 284.84 KiB (1%) | 5013 | | `["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""]` | 42.603 μs (5%) | | 312.75 KiB (1%) | 5005 | | `["collectors", ":comp => \"filter\"", ":impl => \"vec\""]` | 39.503 μs (5%) | | 128.72 KiB (1%) | 15 | | `["collectors", ":comp => \"map\"", ":impl => \"coll\""]` | 7.400 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"man\""]` | 8.641 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""]` | 11.501 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"vec\""]` | 73.005 μs (5%) | | 256.64 KiB (1%) | 14 | | `["dataframes", "Categorical"]` | 698.032 ms (5%) | 73.712 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 1.038 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.319 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.162 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.473 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["collectors", ":comp => \"filter\""]` - `["collectors", ":comp => \"map\""]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 19999 s 0 s 1730 s 33487 s 0 s #2 2095 MHz 6009 s 0 s 1422 s 45860 s 0 s Memory: 6.764888763427734 GB (3616.9765625 MB free) Uptime: 604.0 sec Load Avg: 1.103515625 0.92529296875 0.54150390625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Baseline result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 6:7 * Package commit: 01bb10 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------------------------------------------|----------------:|----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 13.307 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 534.030 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 3.700 ns (5%) | | | | | `["dataframes", "Categorical"]` | 804.391 ms (5%) | 88.795 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 1.063 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.530 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.542 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.387 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz: speed user nice sys idle irq #1 2095 MHz 26476 s 0 s 1818 s 34654 s 0 s #2 2095 MHz 7248 s 0 s 1479 s 52296 s 0 s Memory: 6.764888763427734 GB (3604.359375 MB free) Uptime: 682.0 sec Load Avg: 1.09033203125 0.97314453125 0.59228515625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, skylake) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Stepping: 4 CPU MHz: 2095.192 BogoMIPS: 4190.38 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 36608K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz | | Vendor | :Intel | | Architecture | :Skylake | | Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 1024, 36608) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 44 bits physical | | SIMD | 512 bit = 64 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 4 years ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmarks: - Target: 21 May 2020 - 06:58 - Baseline: 21 May 2020 - 07:00 * Package commits: - Target: 981c84 - Baseline: 01bb10 * Julia commits: - Target: 381693 - Baseline: 381693 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |-------------------------------------------------------------|------------------------------|--------------| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 1.18 (5%) :x: | 1.00 (1%) | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 1.07 (5%) :x: | 1.00 (1%) | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 1.07 (5%) :x: | 1.00 (1%) | | `["dataframes", "Categorical"]` | 0.90 (5%) :white_check_mark: | 1.00 (1%) | | `["dataframes", "Missing-String"]` | 1.19 (5%) :x: | 1.00 (1%) | | `["dataframes", "String-String"]` | 1.15 (5%) :x: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ### Target ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 21151 s 0 s 1480 s 10981 s 0 s #2 2294 MHz 6691 s 0 s 1440 s 25799 s 0 s Memory: 6.764888763427734 GB (3584.71484375 MB free) Uptime: 352.0 sec Load Avg: 1.04296875 0.81494140625 0.3916015625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` ### Baseline ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 28797 s 0 s 1571 s 11204 s 0 s #2 2294 MHz 7002 s 0 s 1481 s 33420 s 0 s Memory: 6.764888763427734 GB (3615.7578125 MB free) Uptime: 432.0 sec Load Avg: 1.0087890625 0.86181640625 0.4462890625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Target result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 6:58 * Package commit: 981c84 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |----------------------------------------------------------------------|----------------:|-----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 12.700 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 444.901 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 3.000 ns (5%) | | | | | `["collectors", ":comp => \"filter\"", ":impl => \"base\""]` | 42.400 μs (5%) | | 128.66 KiB (1%) | 14 | | `["collectors", ":comp => \"filter\"", ":impl => \"coll\""]` | 44.501 μs (5%) | | 284.81 KiB (1%) | 5012 | | `["collectors", ":comp => \"filter\"", ":impl => \"nonexpanding\""]` | 38.200 μs (5%) | | 312.75 KiB (1%) | 5005 | | `["collectors", ":comp => \"filter\"", ":impl => \"vec\""]` | 45.800 μs (5%) | | 128.59 KiB (1%) | 13 | | `["collectors", ":comp => \"map\"", ":impl => \"coll\""]` | 5.120 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"man\""]` | 4.300 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"safe_coll\""]` | 10.200 μs (5%) | | 78.20 KiB (1%) | 2 | | `["collectors", ":comp => \"map\"", ":impl => \"vec\""]` | 74.601 μs (5%) | | 256.64 KiB (1%) | 14 | | `["dataframes", "Categorical"]` | 843.697 ms (5%) | 105.924 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 971.404 μs (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.390 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.583 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.467 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["collectors", ":comp => \"filter\""]` - `["collectors", ":comp => \"map\""]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 21151 s 0 s 1480 s 10981 s 0 s #2 2294 MHz 6691 s 0 s 1440 s 25799 s 0 s Memory: 6.764888763427734 GB (3584.71484375 MB free) Uptime: 352.0 sec Load Avg: 1.04296875 0.81494140625 0.3916015625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Baseline result # Benchmark Report for */home/runner/work/BangBang.jl/BangBang.jl* ## Job Properties * Time of benchmark: 21 May 2020 - 7:0 * Package commit: 01bb10 * Julia commit: 381693 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |-------------------------------------------------------------|----------------:|-----------:|----------------:|------------:| | `["append", "append!!(::SVector, ::SingletonVector)"]` | 10.804 ms (5%) | | 16.78 MiB (1%) | 600000 | | `["append", "append!!(::Vector, ::SingletonVector)"]` | 415.908 μs (5%) | | | | | `["append", "append!!(Empty(SVector), ::SingletonVector)"]` | 2.800 ns (5%) | | | | | `["dataframes", "Categorical"]` | 940.496 ms (5%) | 111.179 ms | 992.89 MiB (1%) | 6318092 | | `["dataframes", "Int-Int"]` | 954.903 μs (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-Int"]` | 1.351 ms (5%) | | 160.23 KiB (1%) | 10251 | | `["dataframes", "Missing-String"]` | 1.335 ms (5%) | | 160.27 KiB (1%) | 10252 | | `["dataframes", "String-String"]` | 1.271 ms (5%) | | 160.27 KiB (1%) | 10252 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `["append"]` - `["dataframes"]` ## Julia versioninfo ``` Julia Version 1.4.1 Commit 381693d3df* (2020-04-14 17:20 UTC) Platform Info: OS: Linux (x86_64-pc-linux-gnu) Ubuntu 18.04.4 LTS uname: Linux 5.3.0-1020-azure #21~18.04.1-Ubuntu SMP Wed Apr 15 09:35:56 UTC 2020 x86_64 x86_64 CPU: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz: speed user nice sys idle irq #1 2294 MHz 28797 s 0 s 1571 s 11204 s 0 s #2 2294 MHz 7002 s 0 s 1481 s 33420 s 0 s Memory: 6.764888763427734 GB (3615.7578125 MB free) Uptime: 432.0 sec Load Avg: 1.0087890625 0.86181640625 0.4462890625 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-8.0.1 (ORCJIT, broadwell) ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `openblas64` | | `Sys.CPU_THREADS` | 2 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 79 Model name: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Stepping: 1 CPU MHz: 2294.687 BogoMIPS: 4589.37 Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 51200K NUMA node0 CPU(s): 0,1 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt md_clear | Cpu Property | Value | |:------------------ |:------------------------------------------------------- | | Brand | Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz | | Vendor | :Intel | | Architecture | :Broadwell | | Model | Family: 0x06, Model: 0x4f, Stepping: 0x01, Type: 0x00 | | Cores | 2 physical cores, 2 logical cores (on executing CPU) | | | No Hyperthreading detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 256, 51200) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 44 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC increased at every clock cycle (non-invariant TSC) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
tkf commented 4 years ago

92e0d90b99525cb969020ca9853e15fc3d65f438 with 1.6.0-DEV.62

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(10.816 μs)
          :impl => "vec" => Trial(49.284 μs)
          :impl => "coll" => Trial(3.553 μs)
          :impl => "man" => Trial(3.649 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(26.234 μs)
          :impl => "vec" => Trial(29.128 μs)
          :impl => "coll" => Trial(13.049 μs)
          :impl => "nonexpanding" => Trial(9.986 μs)

I see some fluctuations in [:comp => "filter"][:impl => "nonexpanding"]. Identical run:

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(11.101 μs)
          :impl => "vec" => Trial(49.540 μs)
          :impl => "coll" => Trial(3.826 μs)
          :impl => "man" => Trial(3.008 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(27.685 μs)
          :impl => "vec" => Trial(29.429 μs)
          :impl => "coll" => Trial(14.379 μs)
          :impl => "nonexpanding" => Trial(12.951 μs)

92e0d90b99525cb969020ca9853e15fc3d65f438 with 1.4.1

2-element BenchmarkTools.BenchmarkGroup:
  tags: []
  :comp => "map" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "safe_coll" => Trial(8.196 μs)
          :impl => "vec" => Trial(50.837 μs)
          :impl => "coll" => Trial(3.704 μs)
          :impl => "man" => Trial(3.345 μs)
  :comp => "filter" => 4-element BenchmarkTools.BenchmarkGroup:
          tags: []
          :impl => "base" => Trial(28.793 μs)
          :impl => "vec" => Trial(27.695 μs)
          :impl => "coll" => Trial(37.804 μs)
          :impl => "nonexpanding" => Trial(34.764 μs)