dtcenter / METviewer

Tool that creates plots using MET verification statistics output and the R statistical package
http://www.dtcenter.org/met/metviewer/
Apache License 2.0
14 stars 1 forks source link

MODE CSI statistics produces spurious results #516

Closed bikegeek closed 8 months ago

bikegeek commented 8 months ago

Describe the Problem

There is an issue with the way the MODE CSI statistics are being calculated (inconsistent with what is documented, and results are not consistent). This was discovered and reported in the METplus Github Discussion:

This is calculated in the R script code. A similar issue exists in METcalcpy:

Expected Behavior

Provide a clear and concise description of what you expected to happen here.

Environment

Describe your runtime environment: 1. Machine: (e.g. HPC name, Linux Workstation, Mac Laptop) 2. OS: (e.g. RedHat Linux, MacOS) 3. Software version number(s)

To Reproduce

Describe the steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll down to '....' 4. See error Post relevant sample data following these instructions: https://dtcenter.org/community-code/model-evaluation-tools-met/met-help-desk#ftp

Relevant Deadlines

List relevant project deadlines here or state NONE.

Funding Source

Define the source of funding and account keys here or state NONE.

Define the Metadata

Assignee

Labels

Projects and Milestone

Define Related Issue(s)

Consider the impact to the other METplus components.

Bugfix Checklist

See the METplus Workflow for details.

bikegeek commented 8 months ago

The fix apparently does not work. @CPKalb tested on 'dakota' and the issue persists.

bikegeek commented 8 months ago

Fix is working for @CPKalb , closing again.

CPKalb commented 8 months ago

The python version is also affected by the same issue and likely needs to be updated as well

bikegeek commented 8 months ago

There is already an issue for the Python version: https://github.com/dtcenter/METcalcpy/issues/360

Minna Win Pronouns: she/her National Center for Atmospheric Research DTC/Research Applications Lab Phone: 303-497-8423

My work hours may not be your work hours. Please do not feel obliged to reply to this email outside of your normal working hours.

On Fri, Feb 16, 2024 at 11:29 AM Christina Kalb @.***> wrote:

The python version is also affected by the same issue and likely needs to be updated as well

— Reply to this email directly, view it on GitHub https://github.com/dtcenter/METviewer/issues/516#issuecomment-1949071243, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4UJHUGFFAY7BCN4IFNEWDYT6QRFAVCNFSM6AAAAABDJFPB6WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNBZGA3TCMRUGM . You are receiving this because you modified the open/close state.Message ID: @.***>

CPKalb commented 8 months ago

Ah, great. Let me know if you want me to test the python issue. I have xmls saved that make it easy to test