OpenFAST / r-test

Apache License 2.0
50 stars 87 forks source link

Update of lin baselines for 4 cases #102

Closed ebranlard closed 1 year ago

ebranlard commented 1 year ago

43 - 5MW_Land_BD_Linear (Failed) 44 - 5MW_OC4Semi_Linear (Failed)

45 - StC_test_OC4Semi_Linear_Nac (Failed) (small differences, 8.618 instead of 8.602) 46 - StC_test_OC4Semi_Linear_Tow (Failed) (small differences, 8.606 instead of 8.602)

ebranlard commented 1 year ago

With the tuning in rtol atol, only those two tests fails: 44 - 5MW_Land_BD_Linear (Failed) 45 - 5MW_OC4Semi_Linear (Failed)

The frequency/damping test indicate some changes in damping that occured.

44:  Case: 5MW_Land_BD_Linear: freq_ref: [0.72878 1.12103 2.09079 3.78    4.95992 5.65912 8.45789 9.93836] [Hz]
44:  Case: 5MW_Land_BD_Linear: freq_new: [0.72931 1.1223  2.09171 3.77941 4.96181 5.65907 8.45812 9.93833] [Hz]
44:  Case: 5MW_Land_BD_Linear: damp_ref: [0.21179 0.33626 0.62722 1.17288 1.53229 1.75916 2.6449  3.09872] [%]
44:  Case: 5MW_Land_BD_Linear: damp_new: [0.44912 0.46434 1.31406 1.58554 3.09832 3.86349 3.34208 6.81007] [%]
44:
44:
44: Error:  Case: 5MW_Land_BD_Linear: Failed to compare A-matrix damping ratios
44:     Linfile: [..]/build-double-release/reg_tests/glue-codes/openfast\5MW_Land_BD_Linear\5MW_Land_BD_Linear.1.BD1.lin.
44:     Exception:
44:     Not equal to tolerance rtol=0.01, atol=0.1
44:
44:     Mismatched elements: 9 / 10 (90%)
44:     Max absolute difference: 3.7113488
44:     Max relative difference: 1.19770363
44:      x: array([0.449119, 0.464341, 1.314057, 1.58554 , 3.098321, 3.863494,
44:            3.342082, 6.810069, 5.997717, 4.684149])
44:      y: array([0.211794, 0.336262, 0.627221, 1.172881, 1.532291, 1.759163,
44:            2.644899, 3.098721, 3.635833, 4.684131])
45:  Case: 5MW_OC4Semi_Linear: freq_ref: [0.00887 0.00887 0.01262 0.03147 0.03892 0.03911 0.04956 0.05786] [Hz]
45:  Case: 5MW_OC4Semi_Linear: freq_new: [0.00887 0.00887 0.01337 0.03147 0.0468  0.04719 0.04956 0.05786] [Hz]
45:  Case: 5MW_OC4Semi_Linear: damp_ref: [ 0.99833  0.99669  0.5148  56.73884  1.12806  1.12051 64.05133  1.13575] [%]
45:  Case: 5MW_OC4Semi_Linear: damp_new: [ 0.99824  0.9968   0.66051 56.73884  0.24683  0.93971 64.05133  1.13575] [%]
45:
45:
45: Error:  Case: 5MW_OC4Semi_Linear: Failed to compare A-matrix damping ratios
45:     Linfile: [..]/reg_tests/glue-codes/openfast\5MW_OC4Semi_Linear\5MW_OC4Semi_Linear.1.lin.
45:     Exception:
45:     Not equal to tolerance rtol=0.01, atol=0.1
45:
45:     Mismatched elements: 3 / 10 (30%)
45:     Max absolute difference: 0.88122953
45:     Max relative difference: 0.78118733
45:      x: array([ 0.998244,  0.996797,  0.660512, 56.738842,  0.246835,  0.939708,
45:            64.051334,  1.135753, 23.225509, 11.672431])
45:      y: array([ 0.998335,  0.996689,  0.514802, 56.738842,  1.128064,  1.120507,
45:            64.051334,  1.135754, 23.225509, 11.672431])