search

asahi417 / lm-question-generation

Multilingual/multidomain question generation datasets, models, and python library for question generation.
https://www.autoqg.net
MIT License
313 stars 30 forks source link

I have this error #14

Closed nhatmin2002 closed 4 months ago

nhatmin2002 commented 1 year ago

raceback (most recent call last): File "/usr/local/bin/lmqg-eval", line 8, in sys.exit(main()) File "/usr/local/lib/python3.10/dist-packages/lmqg/lmqg_cl/model_evaluation.py", line 50, in main metric = evaluate( File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 291, in evaluate metric[_split] = get_metric(_split, _hypothesis_file, None) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 272, in get_metric __metric = compute_metrics( File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation.py", line 148, in compute_metrics score, scores = scorer.computescore(gts, resfiltered) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation_tool/meteor/meteor.py", line 116, in compute_score stat = self._stat(hypo, gts[i]) File "/usr/local/lib/python3.10/dist-packages/lmqg/automatic_evaluation_tool/meteor/meteor.py", line 150, in _stat self.meteor_p.stdin.flush() BrokenPipeError: [Errno 32] Broken pipe

nhatmin2002 commented 1 year ago

when run !lmqg-eval -m "/content/drive/MyDrive/testmodel/lmqg_output/t5-small-squad-ae/model_rcgffo/epoch_4" -e "/content/eval_metrics" -d "lmqg/qg_squad" -l "en" --max-length 256

nhatmin2002 commented 1 year ago

Can you help me please

nhatmin2002 commented 1 year ago

No description provided.

asahi417 commented 10 months ago

Hi, I actually have the error BrokenPipeError: [Errno 32] Broken pipe in one of my server, and I am not sure why it happens on some specific machines. For sure that it's caused by the JAVA software to compute METEOR metric, so I will perhaps consider to change the implementation to something else, to make it free from JAVA.