usnistgov / F4DE

Framework for Detection Evaluation (F4DE) : set of evaluation tools for detection evaluations and for specific NIST-coordinated evaluations
Other
24 stars 11 forks source link

Tests fail for perl 5.28.1 #5

Open jtrmal opened 5 years ago

jtrmal commented 5 years ago

My perl: This is perl 5, version 28, subversion 1 (v5.28.1) built for x86_64-linux-thread-multi The test does work with perl 5.24

Computing Mean Average Precision                                                                                                                                                                       [10/4033]
  Combined Block DET
    Checking the number of points...  Ok
    Checking points...Ok
    Checking Global Measures MAP, MAPP .. ok
    Checking Overall Optimum and Supremum ..
  Error!!! OPTIMUMCOMB computation failed for attribute COMB but expected 0.8555, got 0.712380952380952
$VAR1 = {
          'COMB' => '0.712380952380952',
          'DETECTIONSCORE' => undef,
          'MMISS' => '0.712380952380952',
          'BLOCKS' => {
                        'blk-3' => {
                                     'COMB' => '0.666666666666667',
                                     'DETECTIONSCORE' => 1,
                                     'MMISS' => '0.666666666666667',
                                     'MFA' => '0'
                                   },
                        'blk-4' => {
                                     'COMB' => '0.428571428571429',
                                     'DETECTIONSCORE' => '0.86',
                                     'MMISS' => '0.428571428571429',
                                     'MFA' => '0'
                                   },
                        'blk-1' => {
                                     'COMB' => '0.8',
                                     'DETECTIONSCORE' => 1,
                                     'MMISS' => '0.8',
                                     'MFA' => '0'
                                   },
                        'blk-2' => {
                                     'COMB' => '0.666666666666667',
                                     'DETECTIONSCORE' => 1,
                                     'MMISS' => '0.666666666666667',
                                     'MFA' => '0'
                                   },
                        'blk-7' => {
                                     'COMB' => 1,
                                     'DETECTIONSCORE' => '0.15',
                                     'MMISS' => '1',
                                     'MFA' => '0'
                                   }
                      },
          'MFA' => '0'
        };
Makefile:11: recipe for target 'check' failed
make[3]: *** [check] Error 1
make[3]: Leaving directory '/export/babel/data/software/F4DE/common/test'
Makefile:272: recipe for target 'commoncheck' failed
make[2]: *** [commoncheck] Error 2
make[2]: Leaving directory '/export/babel/data/software/F4DE'
Makefile:255: recipe for target 'mincheck' failed
make[1]: *** [mincheck] Error 2
make[1]: Leaving directory '/export/babel/data/software/F4DE'
Makefile:259: recipe for target 'check' failed
make: *** [check] Error 2
jtrmal commented 4 years ago

This still fails in perl 5.30:

This is perl 5, version 30, subversion 2 (v5.30.2
l2009312042 commented 4 years ago

i meet the same question ,anyone solve it ? This is perl 5, version 26, subversion 1 (v5.26.1) built for x86_64-linux-gnu-thread-multi

jtrmal commented 4 years ago

I just ignore the error and use f4de regardless. I think it's connected only to the changes how dicts are implemented in the new(er) Perla Y.

On Wed, Sep 2, 2020 at 03:51 l2009312042 notifications@github.com wrote:

i meet the same question ,anyone solve it ?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/usnistgov/F4DE/issues/5#issuecomment-685233953, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYX2OSEMYOV3F7ZMHGILSDWQKRANCNFSM4G75LTXA .