Analysis of Failed BFB Simulations

[boverhof]

Description

On AWS S3 there are records since 2020 of BFB runs. Some of these runs have failed because of convergence errors. An ability to analyze the inputs that create convergence errors would be useful in determining new parameter ranges/sets to try.

Demonstration

Here are sets of parameters that were used to run the BFB simulation. Parameter values that were associated with an error run are added to the "ERROR" set.

(py3.9) joshuas-mbp:foquscloudstack-blue-bluefoqussession6a558c90-1gzb41km1tzgi boverhof$ python analyze.py 
SAMPLES: total=24 error=2 success=22     session_1ecaa38c-78a7-4c9b-844c-525a2691c2d1_finished.txt
SAMPLES: total=12 error=1 success=11     session_6a3ba68d-1555-47c5-b6dd-584e6fd6a784_finished.txt
SAMPLES: total=20 error=2 success=18     session_5aaca30a-3dfe-4597-b8b9-31d60c1fd84e_finished.txt
SAMPLES: total=21 error=1 success=20     session_72db33ca-8400-4524-9c09-ff962222de39_finished.txt
SAMPLES: total=20 error=3 success=17     session_33615520-46c9-4a91-a466-52994643a57d_finished.txt
SAMPLES: total=20 error=1 success=19     session_a943067f-a483-4a52-848c-b5ddb827be21_finished.txt
TOTAL: 24 24
    BFBadsM.Lb -- {1.972}  ERRORS:{1.972}
       fg_flow -- {90339.3, 80301.6, 110414.7, 70263.9, 100377}  ERRORS:{90339.3, 80301.6, 110414.7, 70263.9}
    BFBadsB.Dt -- {11.897}  ERRORS:{11.897}
 GHXfg.GasIn.T -- {54}  ERRORS:{54}
    BFBadsM.dx -- {0.06695}  ERRORS:{0.06695}
  GHXfg.A_exch -- {16358}  ERRORS:{16358}
            dp -- {0.00015, 0.000174, 0.0001402, 0.0001598, 0.000126}  ERRORS:{0.0001598, 0.000126, 0.000174, 0.0001402}
    BFBadsM.Cr -- {1}  ERRORS:{1}
 GHXfg.GasIn.P -- {1.01325}  ERRORS:{1.01325}
     BFBRGN.Dt -- {9.041}  ERRORS:{9.041}
  BFBRGNTop.Cr -- {1}  ERRORS:{1}
    BFBadsT.Cr -- {1}  ERRORS:{1}
  BFBRGNTop.Lb -- {7.1926}  ERRORS:{7.1926}
     BFBRGN.Lb -- {8.886}  ERRORS:{8.886}
    BFBadsB.Cr -- {1}  ERRORS:{1}
    BFBadsT.Lb -- {2.2029999999999994}  ERRORS:{2.2029999999999994}
     BFBRGN.Cr -- {1}  ERRORS:{1}
    BFBadsM.Dt -- {15}  ERRORS:{15}
    BFBadsT.dx -- {0.06239700000000001}  ERRORS:{0.06239700000000001}
    BFBadsB.Lb -- {2.085}  ERRORS:{2.085}
    BFBadsT.Dt -- {15}  ERRORS:{15}
  BFBRGNTop.Dt -- {9.195}  ERRORS:{9.195}
    BFBadsB.dx -- {0.0127}  ERRORS:{0.0127}
            Kd -- {100}  ERRORS:{100}

[boverhof]

BFB Byron runs

• occurrence of errors by parameter
• with db at 0.00015
• set of variables that succeeded and errored

  (py3.9) joshuas-mbp:foqussessiondev1563311335 boverhof$ python analyze.py --summary
  JOBS: 20989
  FILTER BY VAR: ('dp', 0.00015)
  TOTAL: 24 24
  BFBadsM.Lb -- SUCCESS=1055  ERRORS=194
     fg_flow -- SUCCESS=5  ERRORS=5
  BFBadsB.Dt -- SUCCESS=1077  ERRORS=207
  GHXfg.GasIn.T -- SUCCESS=1  ERRORS=1
  BFBadsM.dx -- SUCCESS=975  ERRORS=180
  GHXfg.A_exch -- SUCCESS=1046  ERRORS=197
          dp -- SUCCESS=1  ERRORS=1
  BFBadsM.Cr -- SUCCESS=1  ERRORS=1
  GHXfg.GasIn.P -- SUCCESS=1  ERRORS=1
   BFBRGN.Dt -- SUCCESS=1094  ERRORS=204
  BFBRGNTop.Cr -- SUCCESS=1  ERRORS=1
  BFBadsT.Cr -- SUCCESS=1  ERRORS=1
  BFBRGNTop.Lb -- SUCCESS=1050  ERRORS=197
   BFBRGN.Lb -- SUCCESS=1053  ERRORS=196
  BFBadsB.Cr -- SUCCESS=1  ERRORS=1
  BFBadsT.Lb -- SUCCESS=1039  ERRORS=192
   BFBRGN.Cr -- SUCCESS=1  ERRORS=1
  BFBadsM.Dt -- SUCCESS=491  ERRORS=85
  BFBadsT.dx -- SUCCESS=1079  ERRORS=201
  BFBadsB.Lb -- SUCCESS=1060  ERRORS=200
  BFBadsT.Dt -- SUCCESS=595  ERRORS=108
  BFBRGNTop.Dt -- SUCCESS=1053  ERRORS=194
  BFBadsB.dx -- SUCCESS=649  ERRORS=103
          Kd -- SUCCESS=1  ERRORS=1

[boverhof]

Range of Values Error and Success

(py3.9) joshuas-mbp:foqussessiondev1563311335 boverhof$ python analyze.py 
JOBS: 20989
FILTER BY VAR: ('dp', 0.00015)
TOTAL: 24 24
    BFBadsM.Lb -- RANGE=(1.5345,2.4095)  RANGE ERRORS=(1.5345,2.1031248943341145)
       fg_flow -- RANGE=(70263.9,110414.7)  RANGE ERRORS=(70263.9,110414.7)
    BFBadsB.Dt -- RANGE=(10.647,14.026297553110737)  RANGE ERRORS=(10.647,14.026297553110737)
 GHXfg.GasIn.T -- RANGE=(54,54)  RANGE ERRORS=(54,54)
    BFBadsM.dx -- RANGE=(0.051956667357578534,0.075)  RANGE ERRORS=(0.055544874168780206,0.075)
  GHXfg.A_exch -- RANGE=(15541.651765281696,17000)  RANGE ERRORS=(15715.284569969244,16950.830664530607)
            dp -- RANGE=(0.00015,0.00015)  RANGE ERRORS=(0.00015,0.00015)
    BFBadsM.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
 GHXfg.GasIn.P -- RANGE=(1.01325,1.01325)  RANGE ERRORS=(1.01325,1.01325)
     BFBRGN.Dt -- RANGE=(8.041,10.450362376771725)  RANGE ERRORS=(8.041,10.118615592286677)
  BFBRGNTop.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsT.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
  BFBRGNTop.Lb -- RANGE=(5.4426,8.942599999999999)  RANGE ERRORS=(5.4426,8.942599999999999)
     BFBRGN.Lb -- RANGE=(8.68849218074504,8.971499999999999)  RANGE ERRORS=(8.69678556017329,8.906625648676997)
    BFBadsB.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsT.Lb -- RANGE=(1.7884795890544831,2.42575)  RANGE ERRORS=(1.7884795890544831,2.42575)
     BFBRGN.Cr -- RANGE=(1,1)  RANGE ERRORS=(1,1)
    BFBadsM.Dt -- RANGE=(12.5,15)  RANGE ERRORS=(12.5,15)
    BFBadsT.dx -- RANGE=(0.04616453190727447,0.07184925)  RANGE ERRORS=(0.05227637499275295,0.07184925)
    BFBadsB.Lb -- RANGE=(1.77375,2.3962499999999998)  RANGE ERRORS=(1.77375,2.3962499999999998)
    BFBadsT.Dt -- RANGE=(12.5,15)  RANGE ERRORS=(12.5,15)
  BFBRGNTop.Dt -- RANGE=(8.195,10.195)  RANGE ERRORS=(8.195,10.195)
    BFBadsB.dx -- RANGE=(0.0127,0.04385)  RANGE ERRORS=(0.0127,0.04385)
            Kd -- RANGE=(100,100)  RANGE ERRORS=(100,100)

[boverhof]

OPTIMIZATION

BFBadsM.Lb set outside error range and test

• 2.11, 2.5, 2.2
• RANGE=(1.5345,2.4095)
• RANGE ERRORS=(1.5345,2.1031248943341145)
• result 2 errors, 1 stuck

BFBRGN.Lb

• 8.91, 9.0,8.886
• RANGE=(8.68849218074504,8.971499999999999)
• RANGE ERRORS=(8.69678556017329,8.906625648676997)
• had a couple errors but seems to complete, so no convergence terminations

BFBadsT.dx

• 0.0127, 0.050, 0.048

[boverhof]