nasa / prog_models

The NASA Prognostic Model Package is a Python framework focused on defining and building models for prognostics (computation of remaining useful life) of engineering systems, and provides a set of prognostics models for select components developed within this framework, suitable for use in prognostics applications for these components.
123 stars 50 forks source link

Tests/improving Estimate Params Feature #507

Closed aqitya closed 1 year ago

aqitya commented 1 year ago

Creating new test file to validate params_estimate functionality.

github-actions[bot] commented 1 year ago

Thank you for opening this PR. Each PR into dev requires a code review. For the code review, look at the following:

github-actions[bot] commented 1 year ago
Benchmarking Results From: Test Time (s)
import main 0.1274717999999999
import thrown object 0.49753559999999997
model initialization 0.10766319999999996
set noise 0.6509194
simulate 0.2953044
simulate with saving 0.9165383999999999
simulate with saving, dt 1.0404290000000005
simulate with printing results, dt 1.2624506999999996
Plot results 13.822943200000001
Metrics 0.03957030000000117
Surrogate Model Generation 3.1500012999999996
surrogate sim 0.9786715000000008
surrogate sim, dt 2.630960799999997
To: Test Time (s)
import main 0.1292180999999999
import thrown object 0.5061411999999998
model initialization 0.10662399999999983
set noise 0.6595241000000001
simulate 0.3079071999999998
simulate with saving 0.9293087
simulate with saving, dt 1.0419653999999996
simulate with printing results, dt 1.2614947
Plot results 13.746821
Metrics 0.03984960000000015
Surrogate Model Generation 3.2654034000000003
surrogate sim 0.9780853
surrogate sim, dt 2.6198938
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.16931550000000017
import thrown object 0.5885799
model initialization 0.15819459999999985
set noise 0.6911493000000002
simulate 0.3874778000000001
simulate with saving 1.2221675999999997
simulate with saving, dt 1.3540583000000002
simulate with printing results, dt 1.7073969
Plot results 22.336521
Metrics 0.04449220000000054
Surrogate Model Generation 4.630297200000001
surrogate sim 1.6846870999999979
surrogate sim, dt 3.9007964999999984

To:

Test Time (s)
import main 0.17173290000000008
import thrown object 0.6416362
model initialization 0.16509010000000002
set noise 0.7934929
simulate 0.38994719999999994
simulate with saving 1.3838962000000006
simulate with saving, dt 1.6174061000000002
simulate with printing results, dt 1.9631296000000003
Plot results 21.781195
Metrics 0.0548749000000015
Surrogate Model Generation 4.770595399999998
surrogate sim 1.815861499999997
surrogate sim, dt 4.085088599999999
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15701579999999993
import thrown object 0.6124475
model initialization 0.1333236000000002
set noise 0.7564905
simulate 0.33856829999999993
simulate with saving 1.0844201
simulate with saving, dt 1.2019330000000004
simulate with printing results, dt 1.4380403
Plot results 17.2782607
Metrics 0.04275050000000036
Surrogate Model Generation 3.7849697000000013
surrogate sim 1.2307084999999987
surrogate sim, dt 3.125160400000002

To:

Test Time (s)
import main 0.15899229999999998
import thrown object 0.6236093
model initialization 0.12961210000000012
set noise 0.7516677
simulate 0.3731314000000001
simulate with saving 1.1297859999999997
simulate with saving, dt 1.2495379
simulate with printing results, dt 1.4996777000000003
Plot results 17.2861557
Metrics 0.04643989999999931
Surrogate Model Generation 3.9922818999999983
surrogate sim 1.2309415999999977
surrogate sim, dt 3.1286223000000035
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.14375080000000007
import thrown object 0.5486297
model initialization 0.12267819999999996
set noise 0.7024033999999999
simulate 0.3061176000000003
simulate with saving 0.9935095
simulate with saving, dt 1.119815
simulate with printing results, dt 1.3302804999999998
Plot results 15.814299599999998
Metrics 0.041106999999996674
Surrogate Model Generation 3.5185058
surrogate sim 1.1523025000000011
surrogate sim, dt 2.9459160000000004

To:

Test Time (s)
import main 0.15074359999999998
import thrown object 0.5639523000000002
model initialization 0.11454770000000014
set noise 0.6851970000000001
simulate 0.32579740000000035
simulate with saving 0.9778621000000003
simulate with saving, dt 1.0704884999999997
simulate with printing results, dt 1.3115069000000004
Plot results 15.8721541
Metrics 0.03570060000000197
Surrogate Model Generation 3.6145213
surrogate sim 1.1242519999999985
surrogate sim, dt 2.8536775999999975
kjjarvis commented 1 year ago

Also, @aqitya, will you add a description for the PR at the top of the conversation when you have some time? Thank you!

github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15685529999999992
import thrown object 0.6000017000000002
model initialization 0.13127939999999994
set noise 0.7447831999999996
simulate 0.34212890000000007
simulate with saving 1.0918573999999999
simulate with saving, dt 1.2126392
simulate with printing results, dt 1.4531438999999997
Plot results 17.6268106
Metrics 0.04351139999999987
Surrogate Model Generation 3.9061886
surrogate sim 1.238935399999999
surrogate sim, dt 3.145614899999998

To:

Test Time (s)
import main 0.1544443000000002
import thrown object 0.5978506999999997
model initialization 0.12972610000000007
set noise 0.7821767999999998
simulate 0.3576383999999999
simulate with saving 1.1049172999999994
simulate with saving, dt 1.214009
simulate with printing results, dt 1.4580567000000002
Plot results 17.9850443
Metrics 0.04340089999999819
Surrogate Model Generation 4.096530300000001
surrogate sim 1.2345370999999972
surrogate sim, dt 3.1234500999999995
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15374490000000018
import thrown object 0.6031579
model initialization 0.13511739999999994
set noise 0.7660189000000002
simulate 0.35958089999999965
simulate with saving 1.1287786999999998
simulate with saving, dt 1.2801543999999998
simulate with printing results, dt 1.5333668000000005
Plot results 17.6904219
Metrics 0.04525090000000276
Surrogate Model Generation 3.9113883000000023
surrogate sim 1.258898900000002
surrogate sim, dt 3.2019366

To:

Test Time (s)
import main 0.16698250000000003
import thrown object 0.610814
model initialization 0.12982960000000032
set noise 0.7462063999999997
simulate 0.34145380000000003
simulate with saving 1.0963841000000003
simulate with saving, dt 1.2018752
simulate with printing results, dt 1.4518297000000002
Plot results 17.4248143
Metrics 0.04438090000000017
Surrogate Model Generation 4.000564499999999
surrogate sim 1.223393699999999
surrogate sim, dt 3.112995599999998
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12521990000000005
import thrown object 0.5047807999999998
model initialization 0.10652450000000013
set noise 0.6430317999999997
simulate 0.2926742
simulate with saving 0.9115625
simulate with saving, dt 1.0380620000000005
simulate with printing results, dt 1.2580185999999998
Plot results 13.7666227
Metrics 0.03906510000000196
Surrogate Model Generation 3.144302100000001
surrogate sim 0.9696821
surrogate sim, dt 2.6242742999999997

To:

Test Time (s)
import main 0.12637370000000003
import thrown object 0.5085488
model initialization 0.10753039999999991
set noise 0.6559751
simulate 0.3002153000000001
simulate with saving 0.9290152999999997
simulate with saving, dt 1.0522927000000002
simulate with printing results, dt 1.2726305
Plot results 13.777925
Metrics 0.04049399999999892
Surrogate Model Generation 3.279425700000001
surrogate sim 0.9934498999999981
surrogate sim, dt 2.6540314999999985
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12994110000000003
import thrown object 0.5028973000000001
model initialization 0.11430620000000014
set noise 0.6370929000000001
simulate 0.29163590000000017
simulate with saving 0.9387978000000001
simulate with saving, dt 1.0342275
simulate with printing results, dt 1.2406439000000002
Plot results 14.518661000000002
Metrics 0.03564139999999938
Surrogate Model Generation 3.200603000000001
surrogate sim 1.0441062000000016
surrogate sim, dt 2.6883759000000005

To:

Test Time (s)
import main 0.13140319999999983
import thrown object 0.5073783999999999
model initialization 0.11089740000000003
set noise 0.6351977
simulate 0.2965411000000002
simulate with saving 0.9479504999999997
simulate with saving, dt 1.0483362
simulate with printing results, dt 1.3238167
Plot results 14.4853482
Metrics 0.03660149999999973
Surrogate Model Generation 3.3147002999999984
surrogate sim 1.0624167
surrogate sim, dt 2.702180000000002
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.16557709999999992
import thrown object 0.6326337
model initialization 0.13564140000000013
set noise 0.8041884000000001
simulate 0.3640137000000001
simulate with saving 1.1342599999999994
simulate with saving, dt 1.2536836999999998
simulate with printing results, dt 1.5071062999999993
Plot results 18.2456912
Metrics 0.04434180000000154
Surrogate Model Generation 3.982359800000001
surrogate sim 1.2644716999999979
surrogate sim, dt 3.2349835999999996

To:

Test Time (s)
import main 0.1615803
import thrown object 0.6278231999999999
model initialization 0.13586259999999983
set noise 0.8329784
simulate 0.3557405
simulate with saving 1.1307620000000003
simulate with saving, dt 1.2584507
simulate with printing results, dt 1.5446559999999998
Plot results 18.2842195
Metrics 0.045078699999997696
Surrogate Model Generation 4.109910699999997
surrogate sim 1.2828037999999964
surrogate sim, dt 3.2395473999999993
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12872129999999993
import thrown object 0.5008363999999998
model initialization 0.11331329999999995
set noise 0.6480054000000002
simulate 0.2968906000000002
simulate with saving 0.9544872999999998
simulate with saving, dt 1.05408
simulate with printing results, dt 1.2597288000000004
Plot results 15.103731099999997
Metrics 0.03580069999999935
Surrogate Model Generation 3.3077761999999993
surrogate sim 1.0827093000000012
surrogate sim, dt 2.728801100000002

To:

Test Time (s)
import main 0.13870050000000012
import thrown object 0.5329405999999999
model initialization 0.1139338999999997
set noise 0.6324762000000002
simulate 0.2961157000000001
simulate with saving 0.9529535999999998
simulate with saving, dt 1.0464494000000002
simulate with printing results, dt 1.2474470000000002
Plot results 15.4257819
Metrics 0.035906199999999444
Surrogate Model Generation 3.4419071999999993
surrogate sim 1.0892307000000017
surrogate sim, dt 2.7581768999999987
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12466240000000006
import thrown object 0.5053766
model initialization 0.10829969999999989
set noise 0.6448310999999998
simulate 0.2928539999999997
simulate with saving 0.9128529999999997
simulate with saving, dt 1.0302315999999996
simulate with printing results, dt 1.2512136000000007
Plot results 14.307544899999998
Metrics 0.04113059999999891
Surrogate Model Generation 3.2044400999999993
surrogate sim 0.9702835999999984
surrogate sim, dt 2.5976938999999994

To:

Test Time (s)
import main 0.12643669999999996
import thrown object 0.4981757
model initialization 0.10730459999999997
set noise 0.6481589000000001
simulate 0.2932910999999998
simulate with saving 0.9101694999999999
simulate with saving, dt 1.0297945000000004
simulate with printing results, dt 1.2479687000000004
Plot results 14.3666774
Metrics 0.03956110000000024
Surrogate Model Generation 3.3379981
surrogate sim 0.9697610000000019
surrogate sim, dt 2.602494
aqitya commented 1 year ago

Note: The tests that are failing are all passing locally. Katy and I discovered that these tests fail partially due to an outdated scipy version compared to the one I am running locally.

github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.1325249999999999
import thrown object 0.5141966999999998
model initialization 0.11488989999999988
set noise 0.6426509
simulate 0.2945066999999999
simulate with saving 0.9374972000000001
simulate with saving, dt 1.0470229000000004
simulate with printing results, dt 1.2501869
Plot results 14.8694663
Metrics 0.036225600000001634
Surrogate Model Generation 3.275443199999998
surrogate sim 1.0756155000000014
surrogate sim, dt 2.699251499999999

To:

Test Time (s)
import main 0.12867699999999993
import thrown object 0.5051920000000001
model initialization 0.11191829999999992
set noise 0.6271165000000001
simulate 0.29734550000000004
simulate with saving 0.9552099000000003
simulate with saving, dt 1.0549031999999996
simulate with printing results, dt 1.2716214999999993
Plot results 14.947415099999999
Metrics 0.036413899999999444
Surrogate Model Generation 3.3924696999999995
surrogate sim 1.0776398999999977
surrogate sim, dt 2.736401100000002
codecov-commenter commented 1 year ago

Codecov Report

Merging #507 (a7abdf0) into dev (a7abdf0) will not change coverage. The diff coverage is n/a.

:exclamation: Current head a7abdf0 differs from pull request most recent head 4f4764e. Consider uploading reports for the commit 4f4764e to get more accurate results

@@           Coverage Diff           @@
##              dev     #507   +/-   ##
=======================================
  Coverage   79.18%   79.18%           
=======================================
  Files          30       30           
  Lines        2368     2368           
=======================================
  Hits         1875     1875           
  Misses        493      493           
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12417990000000012
import thrown object 0.5108878000000001
model initialization 0.10833530000000002
set noise 0.6519364999999997
simulate 0.29980910000000005
simulate with saving 0.9196149
simulate with saving, dt 1.0555690999999996
simulate with printing results, dt 1.2715736
Plot results 13.871880699999998
Metrics 0.04066609999999926
Surrogate Model Generation 3.1593219999999995
surrogate sim 0.975341499999999
surrogate sim, dt 2.619735300000002

To:

Test Time (s)
import main 0.12488469999999996
import thrown object 0.5063563
model initialization 0.10591050000000002
set noise 0.6422882000000001
simulate 0.2937751000000004
simulate with saving 0.9078391000000003
simulate with saving, dt 1.0324589999999998
simulate with printing results, dt 1.2500791999999992
Plot results 13.895754900000002
Metrics 0.040404900000002186
Surrogate Model Generation 3.2638137
surrogate sim 0.966922799999999
surrogate sim, dt 2.6016043000000018
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12492949999999992
import thrown object 0.5046937999999999
model initialization 0.1076853000000002
set noise 0.6524714999999999
simulate 0.2962990999999997
simulate with saving 0.9072640000000001
simulate with saving, dt 1.0317492000000001
simulate with printing results, dt 1.2519821000000002
Plot results 14.152220799999998
Metrics 0.04005030000000076
Surrogate Model Generation 3.1443239
surrogate sim 0.9757122000000003
surrogate sim, dt 2.6000866999999985

To:

Test Time (s)
import main 0.1257741000000001
import thrown object 0.5029710000000001
model initialization 0.10561660000000006
set noise 0.6564148000000003
simulate 0.2938879000000001
simulate with saving 0.9160031000000002
simulate with saving, dt 1.0327378999999994
simulate with printing results, dt 1.2529846000000004
Plot results 14.160112400000003
Metrics 0.03971130000000045
Surrogate Model Generation 3.2526536999999998
surrogate sim 0.9723850999999968
surrogate sim, dt 2.6031096
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.1323844999999999
import thrown object 0.5073637
model initialization 0.10798269999999999
set noise 0.6509110999999999
simulate 0.29343830000000004
simulate with saving 0.9056886
simulate with saving, dt 1.0283598999999999
simulate with printing results, dt 1.2531381000000001
Plot results 13.988700699999999
Metrics 0.040271400000001734
Surrogate Model Generation 3.1161110999999977
surrogate sim 0.9783508999999988
surrogate sim, dt 2.6114075999999997

To:

Test Time (s)
import main 0.1295719999999998
import thrown object 0.5167803
model initialization 0.10630439999999997
set noise 0.6506218999999998
simulate 0.2948171999999998
simulate with saving 0.9093606999999997
simulate with saving, dt 1.0222973
simulate with printing results, dt 1.2813201000000003
Plot results 13.892705000000001
Metrics 0.04029769999999999
Surrogate Model Generation 3.263203700000002
surrogate sim 0.9675848000000009
surrogate sim, dt 2.6005113999999985
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15833910000000007
import thrown object 0.6284447
model initialization 0.13118380000000007
set noise 0.7549264
simulate 0.3407741999999998
simulate with saving 1.0888960000000005
simulate with saving, dt 1.2092922000000002
simulate with printing results, dt 1.4539112999999997
Plot results 17.406275400000002
Metrics 0.043227200000000465
Surrogate Model Generation 3.734425999999999
surrogate sim 1.2242992000000008
surrogate sim, dt 3.111955200000004

To:

Test Time (s)
import main 0.15994900000000012
import thrown object 0.6264609999999999
model initialization 0.14297519999999997
set noise 0.8110970000000002
simulate 0.36644270000000034
simulate with saving 1.1897092000000002
simulate with saving, dt 1.2821753999999999
simulate with printing results, dt 1.4563699000000003
Plot results 17.426107599999998
Metrics 0.04311350000000047
Surrogate Model Generation 3.9676048
surrogate sim 1.2243387000000006
surrogate sim, dt 3.106144299999997
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12864810000000004
import thrown object 0.49618509999999993
model initialization 0.11440680000000003
set noise 0.6460861
simulate 0.29355639999999994
simulate with saving 0.9362547000000001
simulate with saving, dt 1.0457759000000002
simulate with printing results, dt 1.2472865000000004
Plot results 14.8004018
Metrics 0.03490560000000187
Surrogate Model Generation 3.2747978999999994
surrogate sim 1.0767969000000015
surrogate sim, dt 2.718429099999998

To:

Test Time (s)
import main 0.12908199999999992
import thrown object 0.5141723
model initialization 0.11347400000000007
set noise 0.6479046999999998
simulate 0.3065566999999998
simulate with saving 0.9605582999999998
simulate with saving, dt 1.0850405000000003
simulate with printing results, dt 1.2974573999999999
Plot results 14.7602035
Metrics 0.037596700000001704
Surrogate Model Generation 3.3329476999999983
surrogate sim 1.0631453999999998
surrogate sim, dt 2.7120798000000015
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.1252148999999999
import thrown object 0.5100155000000002
model initialization 0.10978690000000002
set noise 0.661354
simulate 0.29240580000000005
simulate with saving 0.9093174000000004
simulate with saving, dt 1.0302812000000001
simulate with printing results, dt 1.2494569000000002
Plot results 14.0042489
Metrics 0.03999929999999807
Surrogate Model Generation 3.128677400000001
surrogate sim 0.9684932999999987
surrogate sim, dt 2.5972799

To:

Test Time (s)
import main 0.12792459999999983
import thrown object 0.5067300000000001
model initialization 0.10504939999999996
set noise 0.6794946
simulate 0.2972436000000003
simulate with saving 0.9150635999999999
simulate with saving, dt 1.0392378000000004
simulate with printing results, dt 1.254041
Plot results 14.0225393
Metrics 0.040385999999998035
Surrogate Model Generation 3.2636013000000013
surrogate sim 0.974823899999997
surrogate sim, dt 2.6089084999999983
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12651690000000004
import thrown object 0.5014228000000001
model initialization 0.10829620000000006
set noise 0.6459128999999999
simulate 0.29603329999999994
simulate with saving 0.9165386999999998
simulate with saving, dt 1.0422892999999998
simulate with printing results, dt 1.2647585999999995
Plot results 14.419644000000002
Metrics 0.03978989999999882
Surrogate Model Generation 3.164469699999998
surrogate sim 0.9736618999999997
surrogate sim, dt 2.6188097

To:

Test Time (s)
import main 0.1322219
import thrown object 0.5091842
model initialization 0.10571339999999996
set noise 0.6553948999999999
simulate 0.29418049999999996
simulate with saving 0.9179477
simulate with saving, dt 1.0399485
simulate with printing results, dt 1.2492438000000003
Plot results 14.1752158
Metrics 0.03992489999999904
Surrogate Model Generation 3.2391936
surrogate sim 0.9692581999999987
surrogate sim, dt 2.5985276000000006
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.13145059999999997
import thrown object 0.5044119
model initialization 0.12231799999999993
set noise 0.6206781000000001
simulate 0.29767500000000036
simulate with saving 0.9457274
simulate with saving, dt 1.0399205
simulate with printing results, dt 1.2419098999999996
Plot results 14.691755
Metrics 0.03598670000000226
Surrogate Model Generation 3.214277499999998
surrogate sim 1.1045759000000004
surrogate sim, dt 2.9559736

To:

Test Time (s)
import main 0.1286811000000001
import thrown object 0.5013162999999998
model initialization 0.12161619999999984
set noise 0.644584
simulate 0.2969059999999999
simulate with saving 0.9421050000000002
simulate with saving, dt 1.0436243999999997
simulate with printing results, dt 1.2548060000000003
Plot results 14.6162684
Metrics 0.03622890000000112
Surrogate Model Generation 3.2882458999999997
surrogate sim 1.0984870000000022
surrogate sim, dt 2.953648600000001
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12871520000000014
import thrown object 0.5049363
model initialization 0.12312809999999996
set noise 0.6272111
simulate 0.2980166999999998
simulate with saving 0.9486996999999997
simulate with saving, dt 1.0462898000000003
simulate with printing results, dt 1.2423679000000005
Plot results 14.680718
Metrics 0.03589369999999903
Surrogate Model Generation 3.2435174000000018
surrogate sim 1.1037636999999982
surrogate sim, dt 2.9934295000000013

To:

Test Time (s)
import main 0.12839489999999998
import thrown object 0.5117732000000002
model initialization 0.1210106999999998
set noise 0.6697316999999998
simulate 0.29498479999999994
simulate with saving 0.9428482000000002
simulate with saving, dt 1.0358197000000002
simulate with printing results, dt 1.2412153999999997
Plot results 14.528323
Metrics 0.03644350000000074
Surrogate Model Generation 3.366519499999999
surrogate sim 1.1022433000000014
surrogate sim, dt 2.988646899999999
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.17129649999999996
import thrown object 0.6325608000000003
model initialization 0.17884209999999978
set noise 0.7944833
simulate 0.4304557
simulate with saving 1.4035500000000005
simulate with saving, dt 1.5011647000000004
simulate with printing results, dt 1.8618045999999993
Plot results 21.086827300000003
Metrics 0.0485982000000007
Surrogate Model Generation 4.444944900000003
surrogate sim 1.6612799000000038
surrogate sim, dt 4.0566591000000045

To:

Test Time (s)
import main 0.1650756000000002
import thrown object 0.6255307999999997
model initialization 0.16799039999999987
set noise 0.8099720000000001
simulate 0.416299
simulate with saving 1.3295498999999995
simulate with saving, dt 1.4537430000000002
simulate with printing results, dt 1.8874502
Plot results 21.890551
Metrics 0.05036360000000073
Surrogate Model Generation 4.559050699999997
surrogate sim 1.6403624000000008
surrogate sim, dt 3.9808361000000048
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.1760351
import thrown object 0.6970441
model initialization 0.18019070000000026
set noise 0.8442473000000001
simulate 0.43664700000000023
simulate with saving 1.3758939999999997
simulate with saving, dt 1.5240172999999997
simulate with printing results, dt 1.9011396000000005
Plot results 23.212737399999998
Metrics 0.050984499999998434
Surrogate Model Generation 4.818987700000001
surrogate sim 1.7462462999999957
surrogate sim, dt 4.275346799999994

To:

Test Time (s)
import main 0.17847840000000015
import thrown object 0.6858573000000001
model initialization 0.1908517999999999
set noise 0.8628505
simulate 0.4559477999999997
simulate with saving 1.4371090000000004
simulate with saving, dt 1.5553790000000003
simulate with printing results, dt 1.973810799999999
Plot results 23.5358624
Metrics 0.04862650000000457
Surrogate Model Generation 4.850161200000002
surrogate sim 1.7401726999999951
surrogate sim, dt 4.374854400000004
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15430159999999993
import thrown object 0.6075515
model initialization 0.1412779999999998
set noise 0.7574649
simulate 0.33950679999999966
simulate with saving 1.0678655
simulate with saving, dt 1.1975079000000006
simulate with printing results, dt 1.4307742
Plot results 16.9266141
Metrics 0.042705600000001454
Surrogate Model Generation 3.728387099999999
surrogate sim 1.2465429000000015
surrogate sim, dt 3.3773228000000017

To:

Test Time (s)
import main 0.16471520000000006
import thrown object 0.6434021999999999
model initialization 0.16675070000000014
set noise 0.8344293999999999
simulate 0.40808589999999967
simulate with saving 1.1899801
simulate with saving, dt 1.2064265
simulate with printing results, dt 1.4547687999999992
Plot results 17.149757
Metrics 0.04280479999999898
Surrogate Model Generation 3.842469900000001
surrogate sim 1.246068300000001
surrogate sim, dt 3.3782047000000013
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.1589214000000001
import thrown object 0.6084183000000001
model initialization 0.14247370000000026
set noise 0.7470828999999997
simulate 0.3422773000000001
simulate with saving 1.0820033999999996
simulate with saving, dt 1.2069248000000004
simulate with printing results, dt 1.4550935000000003
Plot results 17.7166599
Metrics 0.0423833000000009
Surrogate Model Generation 3.758240599999997
surrogate sim 1.2471035000000015
surrogate sim, dt 3.4059417999999972

To:

Test Time (s)
import main 0.15651490000000012
import thrown object 0.6107182
model initialization 0.14158500000000007
set noise 0.7800849999999997
simulate 0.34352150000000004
simulate with saving 1.0904591
simulate with saving, dt 1.2018661999999996
simulate with printing results, dt 1.4493532
Plot results 17.4747437
Metrics 0.043272699999999276
Surrogate Model Generation 3.9349276000000017
surrogate sim 1.2531124999999967
surrogate sim, dt 3.4080140000000014
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.15961079999999983
import thrown object 0.6119877999999999
model initialization 0.14403489999999985
set noise 0.7589471999999997
simulate 0.3599852000000001
simulate with saving 1.1127816999999998
simulate with saving, dt 1.2495289000000005
simulate with printing results, dt 1.5134600000000002
Plot results 17.4442835
Metrics 0.047126200000001006
Surrogate Model Generation 3.7753606000000026
surrogate sim 1.2646315000000001
surrogate sim, dt 3.472368499999998

To:

Test Time (s)
import main 0.15926940000000012
import thrown object 0.6018869999999998
model initialization 0.13984489999999994
set noise 0.7714524999999997
simulate 0.3498342000000001
simulate with saving 1.0994535
simulate with saving, dt 1.2301153000000005
simulate with printing results, dt 1.4864243000000004
Plot results 17.5187911
Metrics 0.04430870000000198
Surrogate Model Generation 3.865588299999999
surrogate sim 1.2591278999999993
surrogate sim, dt 3.4252566999999985
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.12879790000000002
import thrown object 0.49659849999999994
model initialization 0.12433660000000013
set noise 0.6437839000000001
simulate 0.2973667999999998
simulate with saving 0.9484075000000001
simulate with saving, dt 1.0423422000000002
simulate with printing results, dt 1.2502572
Plot results 15.2895274
Metrics 0.035136899999997695
Surrogate Model Generation 3.3071994999999994
surrogate sim 1.1024843000000004
surrogate sim, dt 2.974335700000001

To:

Test Time (s)
import main 0.12905940000000005
import thrown object 0.4956893
model initialization 0.11994219999999989
set noise 0.6415905999999998
simulate 0.2953990000000002
simulate with saving 0.9285399999999999
simulate with saving, dt 1.0263258999999998
simulate with printing results, dt 1.2499072999999994
Plot results 14.888038199999999
Metrics 0.03580439999999996
Surrogate Model Generation 3.3964095000000007
surrogate sim 1.0951683999999986
surrogate sim, dt 2.9407362
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.13002840000000004
import thrown object 0.5076632999999999
model initialization 0.12307749999999995
set noise 0.6446825999999999
simulate 0.29543050000000015
simulate with saving 0.9419422000000002
simulate with saving, dt 1.0407449999999998
simulate with printing results, dt 1.2546358999999994
Plot results 14.696888999999999
Metrics 0.03529680000000113
Surrogate Model Generation 3.219220400000001
surrogate sim 1.0973160000000028
surrogate sim, dt 2.9924348000000016

To:

Test Time (s)
import main 0.12993600000000005
import thrown object 0.5028088
model initialization 0.12127580000000004
set noise 0.6147280000000002
simulate 0.2964539999999998
simulate with saving 0.9484619000000003
simulate with saving, dt 1.0370121
simulate with printing results, dt 1.2431445000000005
Plot results 14.7530141
Metrics 0.03662540000000192
Surrogate Model Generation 3.318157899999999
surrogate sim 1.1058378999999974
surrogate sim, dt 2.9850569
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.13982969999999995
import thrown object 0.4949630999999999
model initialization 0.1498930999999999
set noise 0.6654135000000001
simulate 0.36747050000000003
simulate with saving 1.1338181999999999
simulate with saving, dt 1.2116479
simulate with printing results, dt 1.6113499000000004
Plot results 20.0701516
Metrics 0.036311800000000005
Surrogate Model Generation 4.205162800000004
surrogate sim 1.6902575000000013
surrogate sim, dt 3.976739000000002

To:

Test Time (s)
import main 0.14244940000000006
import thrown object 0.5354359
model initialization 0.14932290000000004
set noise 0.7087743
simulate 0.3739127
simulate with saving 1.0824637
simulate with saving, dt 1.2481919999999995
simulate with printing results, dt 1.5426639
Plot results 21.1027096
Metrics 0.03699630000000198
Surrogate Model Generation 4.141836999999999
surrogate sim 1.5987848999999983
surrogate sim, dt 3.7240810999999994
github-actions[bot] commented 1 year ago
Benchmarking Results [Update] From: Test Time (s)
import main 0.128981
import thrown object 0.5029777
model initialization 0.12331019999999993
set noise 0.6312679000000001
simulate 0.2956742000000001
simulate with saving 0.9327326999999999
simulate with saving, dt 1.0359458999999998
simulate with printing results, dt 1.2402436999999997
Plot results 14.765017100000001
Metrics 0.03523699999999863
Surrogate Model Generation 3.2371701999999978
surrogate sim 1.0914925999999987
surrogate sim, dt 2.952130699999998

To:

Test Time (s)
import main 0.13112420000000014
import thrown object 0.5212900999999999
model initialization 0.1349688
set noise 0.6321663000000002
simulate 0.2983203000000003
simulate with saving 0.9454835999999998
simulate with saving, dt 1.0503300000000002
simulate with printing results, dt 1.2672268999999998
Plot results 14.785131199999999
Metrics 0.0364957999999973
Surrogate Model Generation 3.378763499999998
surrogate sim 1.1168122000000018
surrogate sim, dt 2.9819163999999994