e4st-dev / E4ST.jl

Engineering, Economic, and Environmental Electricity Simulation Tool (E4ST)
GNU General Public License v3.0
7 stars 1 forks source link

Net revenue welfare check #257

Closed sallyrobson closed 7 months ago

sallyrobson commented 7 months ago

Adding a check to change the calculation of net revenue for generators and storage. Issue #256

codecov[bot] commented 7 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (4fce271) 90.13% compared to head (834e996) 90.15%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #257 +/- ## ========================================== + Coverage 90.13% 90.15% +0.02% ========================================== Files 49 49 Lines 4916 4928 +12 ========================================== + Hits 4431 4443 +12 Misses 485 485 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

github-actions[bot] commented 7 months ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmarks: - Target: 8 Dec 2023 - 15:03 - Baseline: 8 Dec 2023 - 15:06 * Package commits: - Target: 9d68c3 - Baseline: 4fce27 * Julia commits: - Target: 8e5136 - Baseline: 8e5136 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------|------------------------------|------------------------------| | `["run_e4st"]` | 0.00 (5%) :white_check_mark: | 0.02 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ### Target ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2535 MHz 1305 s 0 s 96 s 3509 s 0 s #2 2586 MHz 1482 s 0 s 116 s 3319 s 0 s #3 2445 MHz 1438 s 0 s 110 s 3359 s 0 s #4 3241 MHz 1272 s 0 s 118 s 3523 s 0 s Memory: 15.60690689086914 GB (12758.75390625 MB free) Uptime: 493.99 sec Load Avg: 1.03 1.0 0.53 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` ### Baseline ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3196 MHz 1602 s 0 s 110 s 4752 s 0 s #2 3244 MHz 1692 s 0 s 135 s 4647 s 0 s #3 2681 MHz 2082 s 0 s 124 s 4259 s 0 s #4 2606 MHz 1661 s 0 s 130 s 4678 s 0 s Memory: 15.60690689086914 GB (13618.98828125 MB free) Uptime: 649.92 sec Load Avg: 1.0 1.0 0.61 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 8 Dec 2023 - 15:3 * Package commit: 9d68c3 * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|----------------:|-----------:|----------------:|------------:| | `["get_af"]` | 74.699 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 39.113 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 84.869 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 31.999 ms (5%) | | 9.88 MiB (1%) | 336598 | | `["run_e4st"]` | 191.158 ms (5%) | 8.021 ms | 115.27 MiB (1%) | 1052582 | | `["setup_model"]` | 1.425 s (5%) | 422.174 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2535 MHz 1305 s 0 s 96 s 3509 s 0 s #2 2586 MHz 1482 s 0 s 116 s 3319 s 0 s #3 2445 MHz 1438 s 0 s 110 s 3359 s 0 s #4 3241 MHz 1272 s 0 s 118 s 3523 s 0 s Memory: 15.60690689086914 GB (12758.75390625 MB free) Uptime: 493.99 sec Load Avg: 1.03 1.0 0.53 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 8 Dec 2023 - 15:6 * Package commit: 4fce27 * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|---------------:|-----------:|--------------:|------------:| | `["get_af"]` | 73.467 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 38.912 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 83.966 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 33.318 ms (5%) | | 9.88 MiB (1%) | 336553 | | `["run_e4st"]` | 58.932 s (5%) | 1.825 s | 5.07 GiB (1%) | 77181515 | | `["setup_model"]` | 1.413 s (5%) | 421.104 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3196 MHz 1602 s 0 s 110 s 4752 s 0 s #2 3244 MHz 1692 s 0 s 135 s 4647 s 0 s #3 2681 MHz 2082 s 0 s 124 s 4259 s 0 s #4 2606 MHz 1661 s 0 s 130 s 4678 s 0 s Memory: 15.60690689086914 GB (13618.98828125 MB free) Uptime: 649.92 sec Load Avg: 1.0 1.0 0.61 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `lbt` | | `Sys.CPU_THREADS` | 4 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 48 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: AuthenticAMD Model name: AMD EPYC 7763 64-Core Processor CPU family: 25 Model: 1 Thread(s) per core: 2 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4890.86 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm Virtualization: AMD-V Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-3 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Mitigation; safe RET, no microcode Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected | Cpu Property | Value | |:------------------ |:---------------------------------------------------------- | | Brand | AMD EPYC 7763 64-Core Processor | | Vendor | :AMD | | Architecture | :Unknown | | Model | Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00 | | Cores | 16 physical cores, 16 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 512, 32768) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 48 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC runs at constant rate (invariant from clock frequency) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
sallyrobson commented 7 months ago

This looks good. Is the idea that this is supposed to always sum to zero? If so, maybe add a test for that?

No, it won't sum to zero but it should equal net_revenue_total_prelim for gen and storage, maybe I'll try to document that better somewhere

github-actions[bot] commented 7 months ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmarks: - Target: 18 Dec 2023 - 17:12 - Baseline: 18 Dec 2023 - 17:15 * Package commits: - Target: 1d8add - Baseline: 4fce27 * Julia commits: - Target: 8e5136 - Baseline: 8e5136 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------|------------------------------|------------------------------| | `["get_plnom"]` | 0.94 (5%) :white_check_mark: | 1.00 (1%) | | `["run_e4st"]` | 0.00 (5%) :white_check_mark: | 0.02 (1%) :white_check_mark: | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ### Target ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2761 MHz 1446 s 0 s 118 s 3166 s 0 s #2 3243 MHz 1605 s 0 s 98 s 3034 s 0 s #3 2675 MHz 1294 s 0 s 120 s 3311 s 0 s #4 2600 MHz 1194 s 0 s 114 s 3425 s 0 s Memory: 15.60690689086914 GB (12561.11328125 MB free) Uptime: 476.11 sec Load Avg: 1.11 1.05 0.56 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` ### Baseline ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3242 MHz 1949 s 0 s 135 s 4196 s 0 s #2 2445 MHz 2072 s 0 s 116 s 4098 s 0 s #3 2605 MHz 1660 s 0 s 132 s 4483 s 0 s #4 2445 MHz 1389 s 0 s 126 s 4767 s 0 s Memory: 15.60690689086914 GB (13504.13671875 MB free) Uptime: 631.49 sec Load Avg: 1.02 1.03 0.64 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 18 Dec 2023 - 17:12 * Package commit: 1d8add * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|----------------:|-----------:|----------------:|------------:| | `["get_af"]` | 71.373 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 36.648 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 84.598 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 32.777 ms (5%) | | 9.88 MiB (1%) | 336598 | | `["run_e4st"]` | 194.018 ms (5%) | 8.407 ms | 115.27 MiB (1%) | 1052584 | | `["setup_model"]` | 1.493 s (5%) | 458.966 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2761 MHz 1446 s 0 s 118 s 3166 s 0 s #2 3243 MHz 1605 s 0 s 98 s 3034 s 0 s #3 2675 MHz 1294 s 0 s 120 s 3311 s 0 s #4 2600 MHz 1194 s 0 s 114 s 3425 s 0 s Memory: 15.60690689086914 GB (12561.11328125 MB free) Uptime: 476.11 sec Load Avg: 1.11 1.05 0.56 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 18 Dec 2023 - 17:15 * Package commit: 4fce27 * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|---------------:|-----------:|--------------:|------------:| | `["get_af"]` | 72.275 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 37.009 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 89.667 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 31.567 ms (5%) | | 9.87 MiB (1%) | 336523 | | `["run_e4st"]` | 58.014 s (5%) | 1.829 s | 5.07 GiB (1%) | 77165570 | | `["setup_model"]` | 1.438 s (5%) | 424.891 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3242 MHz 1949 s 0 s 135 s 4196 s 0 s #2 2445 MHz 2072 s 0 s 116 s 4098 s 0 s #3 2605 MHz 1660 s 0 s 132 s 4483 s 0 s #4 2445 MHz 1389 s 0 s 126 s 4767 s 0 s Memory: 15.60690689086914 GB (13504.13671875 MB free) Uptime: 631.49 sec Load Avg: 1.02 1.03 0.64 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `lbt` | | `Sys.CPU_THREADS` | 4 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 48 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: AuthenticAMD Model name: AMD EPYC 7763 64-Core Processor CPU family: 25 Model: 1 Thread(s) per core: 2 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4890.86 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm Virtualization: AMD-V Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-3 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Mitigation; safe RET, no microcode Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected | Cpu Property | Value | |:------------------ |:---------------------------------------------------------- | | Brand | AMD EPYC 7763 64-Core Processor | | Vendor | :AMD | | Architecture | :Unknown | | Model | Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00 | | Cores | 16 physical cores, 16 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 512, 32768) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 48 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC runs at constant rate (invariant from clock frequency) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |
github-actions[bot] commented 7 months ago
Benchmark result # Judge result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmarks: - Target: 18 Dec 2023 - 17:33 - Baseline: 18 Dec 2023 - 17:36 * Package commits: - Target: 3ab20d - Baseline: 4fce27 * Julia commits: - Target: 8e5136 - Baseline: 8e5136 * Julia command flags: - Target: None - Baseline: None * Environment variables: - Target: None - Baseline: None ## Results A ratio greater than `1.0` denotes a possible regression (marked with :x:), while a ratio less than `1.0` denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds). | ID | time ratio | memory ratio | |---------------------|------------------------------|------------------------------| | `["get_af"]` | 0.91 (5%) :white_check_mark: | 1.00 (1%) | | `["run_e4st"]` | 0.00 (5%) :white_check_mark: | 0.02 (1%) :white_check_mark: | | `["setup_model"]` | 1.05 (5%) :x: | 1.00 (1%) | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ### Target ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2593 MHz 1389 s 0 s 93 s 3097 s 0 s #2 2578 MHz 1860 s 0 s 104 s 2618 s 0 s #3 2445 MHz 1089 s 0 s 105 s 3386 s 0 s #4 3243 MHz 1264 s 0 s 95 s 3225 s 0 s Memory: 15.60690689086914 GB (12779.55078125 MB free) Uptime: 461.04 sec Load Avg: 1.02 1.0 0.54 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` ### Baseline ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3197 MHz 2040 s 0 s 106 s 3974 s 0 s #2 2863 MHz 2425 s 0 s 121 s 3580 s 0 s #3 2445 MHz 1392 s 0 s 117 s 4613 s 0 s #4 3243 MHz 1267 s 0 s 107 s 4752 s 0 s Memory: 15.60690689086914 GB (13678.84375 MB free) Uptime: 615.64 sec Load Avg: 1.05 1.01 0.62 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Target result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 18 Dec 2023 - 17:33 * Package commit: 3ab20d * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|----------------:|-----------:|----------------:|------------:| | `["get_af"]` | 72.145 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 36.839 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 82.544 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 32.184 ms (5%) | | 9.88 MiB (1%) | 336598 | | `["run_e4st"]` | 194.896 ms (5%) | 9.029 ms | 115.28 MiB (1%) | 1052585 | | `["setup_model"]` | 1.452 s (5%) | 443.568 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 2593 MHz 1389 s 0 s 93 s 3097 s 0 s #2 2578 MHz 1860 s 0 s 104 s 2618 s 0 s #3 2445 MHz 1089 s 0 s 105 s 3386 s 0 s #4 3243 MHz 1264 s 0 s 95 s 3225 s 0 s Memory: 15.60690689086914 GB (12779.55078125 MB free) Uptime: 461.04 sec Load Avg: 1.02 1.0 0.54 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Baseline result # Benchmark Report for */home/runner/work/E4ST.jl/E4ST.jl* ## Job Properties * Time of benchmark: 18 Dec 2023 - 17:36 * Package commit: 4fce27 * Julia commit: 8e5136 * Julia command flags: None * Environment variables: None ## Results Below is a table of this job's results, obtained by running the benchmarks. The values listed in the `ID` column have the structure `[parent_group, child_group, ..., key]`, and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero. | ID | time | GC time | memory | allocations | |---------------------|---------------:|-----------:|--------------:|------------:| | `["get_af"]` | 79.077 ns (5%) | | 32 bytes (1%) | 2 | | `["get_generator"]` | 36.407 ns (5%) | | 48 bytes (1%) | 1 | | `["get_plnom"]` | 81.532 ns (5%) | | 48 bytes (1%) | 3 | | `["read_data"]` | 31.846 ms (5%) | | 9.88 MiB (1%) | 336553 | | `["run_e4st"]` | 57.708 s (5%) | 1.880 s | 5.07 GiB (1%) | 77196127 | | `["setup_model"]` | 1.377 s (5%) | 412.128 ms | 1.00 GiB (1%) | 14032956 | ## Benchmark Group List Here's a list of all the benchmark groups executed by this job: - `[]` ## Julia versioninfo ``` Julia Version 1.9.4 Commit 8e5136fa297 (2023-11-14 08:46 UTC) Build Info: Official https://julialang.org/ release Platform Info: OS: Linux (x86_64-linux-gnu) Ubuntu 22.04.3 LTS uname: Linux 6.2.0-1018-azure #18~22.04.1-Ubuntu SMP Tue Nov 21 19:25:02 UTC 2023 x86_64 x86_64 CPU: AMD EPYC 7763 64-Core Processor: speed user nice sys idle irq #1 3197 MHz 2040 s 0 s 106 s 3974 s 0 s #2 2863 MHz 2425 s 0 s 121 s 3580 s 0 s #3 2445 MHz 1392 s 0 s 117 s 4613 s 0 s #4 3243 MHz 1267 s 0 s 107 s 4752 s 0 s Memory: 15.60690689086914 GB (13678.84375 MB free) Uptime: 615.64 sec Load Avg: 1.05 1.01 0.62 WORD_SIZE: 64 LIBM: libopenlibm LLVM: libLLVM-14.0.6 (ORCJIT, znver3) Threads: 1 on 4 virtual cores ``` --- # Runtime information | Runtime Info | | |:--|:--| | BLAS #threads | 2 | | `BLAS.vendor()` | `lbt` | | `Sys.CPU_THREADS` | 4 | `lscpu` output: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 48 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: AuthenticAMD Model name: AMD EPYC 7763 64-Core Processor CPU family: 25 Model: 1 Thread(s) per core: 2 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4890.86 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm Virtualization: AMD-V Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-3 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Mitigation; safe RET, no microcode Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected | Cpu Property | Value | |:------------------ |:---------------------------------------------------------- | | Brand | AMD EPYC 7763 64-Core Processor | | Vendor | :AMD | | Architecture | :Unknown | | Model | Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00 | | Cores | 16 physical cores, 16 logical cores (on executing CPU) | | | No Hyperthreading hardware capability detected | | Clock Frequencies | Not supported by CPU | | Data Cache | Level 1:3 : (32, 512, 32768) kbytes | | | 64 byte cache line size | | Address Size | 48 bits virtual, 48 bits physical | | SIMD | 256 bit = 32 byte max. SIMD vector size | | Time Stamp Counter | TSC is accessible via `rdtsc` | | | TSC runs at constant rate (invariant from clock frequency) | | Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported | | Hypervisor | Yes, Microsoft |