search

TuringLang / JuliaBUGS.jl

A domain specific language (DSL) for probabilistic graphical models
https://turinglang.org/JuliaBUGS.jl/
MIT License
22 stars 4 forks source link

Add some benchmark for `logdensity` computations #172

Closed sunxd3 closed 6 months ago

coveralls commented 7 months ago

Pull Request Test Coverage Report for Build 8674896278

Warning: This coverage report may be inaccurate.

This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

Details

Files with Coverage Reduction New Missed Lines %
src/parser/Parser.jl 1 87.5%
ext/JuliaBUGSAdvancedMHExt.jl 2 0.0%
src/logdensityproblems.jl 3 66.67%
src/BUGSPrimitives/BUGSPrimitives.jl 4 20.0%
ext/JuliaBUGSAdvancedHMCExt.jl 7 0.0%
src/JuliaBUGS.jl 8 75.0%
src/utils.jl 12 82.78%
src/BUGSPrimitives/distributions.jl 12 22.86%
src/compiler_pass.jl 21 89.89%
ext/JuliaBUGSMCMCChainsExt.jl 23 0.0%
<!-- Total: 447 -->
Totals Coverage Status
Change from base Build 8472460186: -25.9%
Covered Lines: 981
Relevant Lines: 1732
💛 - Coveralls
sunxd3 commented 6 months ago
Example Name Category Median Time Minimum Time Maximum Time Memory Usage
surgical_realistic AD logdensity_and_gradient 287.928 μs 269.684 μs 10.515 ms 120.20 KiB
AD compiled logdensity_and_gradient 9.708 μs 9.418 μs 33.482 μs 208 bytes
logdensity 168.656 μs 160.701 μs 8.225 ms 60.81 KiB
AD logdensity 169.197 μs 161.282 μs 7.683 ms 60.81 KiB
AD compiled logdensity 169.126 μs 160.690 μs 14.370 ms 60.81 KiB
pumps AD logdensity_and_gradient 211.266 μs 197.981 μs 7.567 ms 87.09 KiB
AD compiled logdensity_and_gradient 7.035 μs 6.961 μs 15.126 μs 192 bytes
logdensity 121.928 μs 114.805 μs 8.940 ms 46.22 KiB
AD logdensity 121.087 μs 115.005 μs 11.596 ms 46.22 KiB
AD compiled logdensity 121.397 μs 114.414 μs 9.170 ms 46.22 KiB
dogs AD logdensity_and_gradient 9.003 ms 8.628 ms 18.305 ms 4.54 MiB
AD compiled logdensity_and_gradient 168.856 μs 163.686 μs 242.834 μs 112 bytes
logdensity 8.253 ms 7.829 ms 16.825 ms 3.96 MiB
AD logdensity 8.270 ms 7.841 ms 22.623 ms 3.96 MiB
AD compiled logdensity 8.292 ms 7.827 ms 21.382 ms 3.96 MiB
magnesium AD logdensity_and_gradient 4.111 ms 3.975 ms 11.826 ms 1.84 MiB
AD compiled logdensity_and_gradient 92.884 μs 89.037 μs 133.559 μs 1.02 KiB
logdensity 2.283 ms 2.191 ms 10.641 ms 1.11 MiB
AD logdensity 2.283 ms 2.190 ms 11.071 ms 1.11 MiB
AD compiled logdensity 2.287 ms 2.196 ms 20.101 ms 1.11 MiB
surgical_simple AD logdensity_and_gradient 155.081 μs 148.648 μs 6.202 ms 103.56 KiB
AD compiled logdensity_and_gradient 10.009 μs 9.718 μs 33.071 μs 192 bytes
logdensity 76.393 μs 73.046 μs 7.209 ms 34.50 KiB
AD logdensity 76.593 μs 73.327 μs 7.360 ms 34.50 KiB
AD compiled logdensity 76.633 μs 73.197 μs 7.561 ms 34.50 KiB
salm AD logdensity_and_gradient 589.453 μs 553.887 μs 14.337 ms 250.78 KiB
AD compiled logdensity_and_gradient 14.438 μs 14.086 μs 57.878 μs 272 bytes
logdensity 394.273 μs 370.934 μs 13.467 ms 172.12 KiB
AD logdensity 393.567 μs 370.323 μs 9.024 ms 172.12 KiB
AD compiled logdensity 392.595 μs 371.425 μs 9.461 ms 172.12 KiB
stacks AD logdensity_and_gradient 996.916 μs 948.775 μs 8.189 ms 385.91 KiB
AD compiled logdensity_and_gradient 16.060 μs 15.569 μs 43.101 μs 144 bytes
logdensity 763.122 μs 721.250 μs 10.071 ms 301.11 KiB
AD logdensity 763.728 μs 718.933 μs 10.908 ms 301.11 KiB
AD compiled logdensity 761.628 μs 721.249 μs 8.612 ms 301.11 KiB
bones AD logdensity_and_gradient 21.368 ms 20.561 ms 29.911 ms 8.52 MiB
AD compiled logdensity_and_gradient 229.108 μs 219.350 μs 358.751 μs 368 bytes
logdensity 18.462 ms 17.457 ms 26.803 ms 7.22 MiB
AD logdensity 18.397 ms 17.471 ms 31.720 ms 7.22 MiB
AD compiled logdensity 18.417 ms 17.474 ms 30.818 ms 7.22 MiB
leukfr AD logdensity_and_gradient 15.347 ms 14.636 ms 26.825 ms 8.42 MiB
AD compiled logdensity_and_gradient 337.350 μs 326.992 μs 482.743 μs 432 bytes
logdensity 12.059 ms 11.732 ms 20.426 ms 6.95 MiB
AD logdensity 12.058 ms 11.728 ms 19.779 ms 6.95 MiB
AD compiled logdensity 12.134 ms 11.704 ms 24.490 ms 6.95 MiB
lsat AD logdensity_and_gradient 234.609 ms 221.020 ms 245.198 ms 188.36 MiB
AD compiled logdensity_and_gradient 1.831 ms 1.724 ms 2.618 ms 8.03 KiB
logdensity 199.629 ms 197.852 ms 208.146 ms 182.63 MiB
AD logdensity 200.241 ms 194.278 ms 214.047 ms 182.63 MiB
AD compiled logdensity 199.198 ms 195.240 ms 213.718 ms 182.63 MiB
seeds AD logdensity_and_gradient 827.798 μs 795.106 μs 16.090 ms 374.33 KiB
AD compiled logdensity_and_gradient 23.635 μs 23.093 μs 53.810 μs 304 bytes
logdensity 558.816 μs 535.041 μs 8.225 ms 252.34 KiB
AD logdensity 557.633 μs 533.838 μs 7.993 ms 252.34 KiB
AD compiled logdensity 558.825 μs 531.745 μs 11.641 ms 252.34 KiB
blockers AD logdensity_and_gradient 1.147 ms 1.104 ms 7.876 ms 458.20 KiB
AD compiled logdensity_and_gradient 32.526 μs 31.799 μs 68.247 μs 480 bytes
logdensity 771.838 μs 742.748 μs 7.614 ms 261.11 KiB
AD logdensity 772.174 μs 740.564 μs 7.231 ms 261.11 KiB
AD compiled logdensity 771.716 μs 741.051 μs 7.384 ms 261.11 KiB
equiv AD logdensity_and_gradient 626.772 μs 599.862 μs 10.317 ms 300.70 KiB
AD compiled logdensity_and_gradient 16.992 μs 16.631 μs 42.820 μs 208 bytes
logdensity 451.684 μs 433.210 μs 7.289 ms 220.66 KiB
AD logdensity 451.013 μs 432.749 μs 7.564 ms 220.66 KiB
AD compiled logdensity 451.238 μs 430.535 μs 7.686 ms 220.66 KiB
rats AD logdensity_and_gradient 3.350 ms 3.221 ms 13.854 ms 1.72 MiB
AD compiled logdensity_and_gradient 92.382 μs 90.950 μs 142.577 μs 608 bytes
logdensity 2.599 ms 2.490 ms 10.787 ms 1.29 MiB
AD logdensity 2.597 ms 2.488 ms 10.980 ms 1.29 MiB
AD compiled logdensity 2.594 ms 2.492 ms 16.192 ms 1.29 MiB
mice AD logdensity_and_gradient 1.165 ms 1.107 ms 8.991 ms 555.02 KiB
AD compiled logdensity_and_gradient 40.646 μs 39.864 μs 74.229 μs 256 bytes
logdensity 592.166 μs 549.337 μs 10.077 ms 314.59 KiB
AD logdensity 592.327 μs 551.461 μs 9.860 ms 314.59 KiB
AD compiled logdensity 591.566 μs 548.886 μs 9.810 ms 314.59 KiB
leuk AD logdensity_and_gradient 11.603 ms 11.085 ms 20.680 ms 5.74 MiB
AD compiled logdensity_and_gradient 212.557 μs 210.444 μs 294.701 μs 240 bytes
logdensity 8.806 ms 8.387 ms 17.177 ms 4.48 MiB
AD logdensity 8.803 ms 8.420 ms 22.152 ms 4.48 MiB
AD compiled logdensity 8.798 ms 8.390 ms 17.591 ms 4.48 MiB
oxford AD logdensity_and_gradient 10.299 ms 9.977 ms 16.636 ms 4.27 MiB
AD compiled logdensity_and_gradient 208.950 μs 206.947 μs 361.656 μs 2.02 KiB
logdensity 7.660 ms 7.372 ms 21.998 ms 3.16 MiB
AD logdensity 7.642 ms 7.364 ms 14.752 ms 3.16 MiB
AD compiled logdensity 7.660 ms 7.391 ms 19.100 ms 3.16 MiB
epil AD logdensity_and_gradient 18.750 ms 18.031 ms 27.251 ms 12.92 MiB
AD compiled logdensity_and_gradient 411.279 μs 407.842 μs 631.730 μs 4.41 KiB
logdensity 14.051 ms 13.671 ms 21.499 ms 11.10 MiB
AD logdensity 14.030 ms 13.639 ms 23.545 ms 11.10 MiB
AD compiled logdensity 14.027 ms 13.613 ms 22.144 ms 11.10 MiB
dyes AD logdensity_and_gradient 338.843 μs 324.676 μs 13.413 ms 168.19 KiB
AD compiled logdensity_and_gradient 22.342 μs 21.671 μs 55.023 μs 400 bytes
logdensity 206.696 μs 199.493 μs 8.626 ms 86.67 KiB
AD logdensity 206.966 μs 199.713 μs 8.532 ms 86.67 KiB
AD compiled logdensity 206.796 μs 199.442 μs 8.473 ms 86.67 KiB
kidney AD logdensity_and_gradient 3.268 ms 3.161 ms 10.445 ms 1.48 MiB
AD compiled logdensity_and_gradient 78.636 μs 77.435 μs 176.219 μs 608 bytes
logdensity 2.039 ms 1.938 ms 15.956 ms 1.07 MiB
AD logdensity 2.040 ms 1.932 ms 11.176 ms 1.07 MiB
AD compiled logdensity 2.038 ms 1.936 ms 9.790 ms 1.07 MiB