allenai / allennlp

An open-source NLP research library, built on PyTorch.
http://www.allennlp.org
Apache License 2.0
11.71k stars 2.24k forks source link

Mismatched found in ensure_batch_predictions_are_consistent. Is is important? #5692

Closed huhk-sysu closed 1 year ago

huhk-sysu commented 1 year ago

Hi, I'm using allennlp.common.testing.model_test_case to test my model, and it reports lots of mismatched, though the value seems small. image

  1. I'm not sure if it is important to me. Do I need to fix it?
  2. If so, what would be the cause and how can I fix it?

    ps: I notice that my prediction (which are calculated based on the logits) are the same.

github-actions[bot] commented 1 year ago

This issue is being closed due to lack of activity. If you think it still needs to be addressed, please comment on this thread 👇