Closed jm-glowienke closed 3 years ago
Reason:
The input to fairseq-interactive is already BPE processed, so it gets double BPE processed, causing bad perfomance
fairseq-interactive
Resolve by:
model_input
evaluation alignment
Traceback (most recent call last): File "src_eiopa/query_results_evaluation.py", line 101, in <module> acc, results = compare_results(g, queries) File "src_eiopa/query_results_evaluation.py", line 41, in compare_results if result_true[index] == result_generated[index]:
For subword processing
Reason:
The input to
fairseq-interactive
is already BPE processed, so it gets double BPE processed, causing bad perfomanceResolve by:
model_input
folder, which are not BPE processed when evaluatingevaluation alignment
General:
use zip formulationuse for loop for reference results and in formulation for checking