SainsburyWellcomeCentre / crabs-exploration

A toolkit for detecting and tracking crabs in the field.
BSD 3-Clause "New" or "Revised" License
7 stars 0 forks source link

Evaluate script: review of command-line arguments #172

Closed sfmig closed 5 months ago

sfmig commented 7 months ago

This PR changes the CLI arguments of the evaluate script to better match the training script.

The most common use would be to run:

evaluate-detector ---trained_model_path <path-to-ckpt>

This will load the trained model and use its config to run the evaluation. Note that it is important that we use the config used in training, to make the same dataset and use the correct test split.

However, if a dataset or config file is specified via CLI, the parameters will be overwritten.

Other additions

I will do the tests in a separate PR 😬 ---> #199

codecov-commenter commented 7 months ago

Codecov Report

Attention: Patch coverage is 41.80328% with 71 lines in your changes missing coverage. Please review.

Project coverage is 37.11%. Comparing base (5a47ee0) to head (8bb9d9c).

Files Patch % Lines
crabs/detection_tracking/evaluate_utils.py 51.16% 42 Missing :warning:
crabs/detection_tracking/evaluate_model.py 0.00% 28 Missing :warning:
crabs/detection_tracking/visualization.py 85.71% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #172 +/- ## ========================================== - Coverage 37.73% 37.11% -0.63% ========================================== Files 20 20 Lines 1349 1412 +63 ========================================== + Hits 509 524 +15 - Misses 840 888 +48 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.