As a software developer, I want to try out replacing fast_align with the AWESoME word aligner to see if this improves the dictionary creator's F1 score.
Motivation: improve alignment -> reduce FPs -> increase DC's precision
Tasks
[x] Install awesome align
[x] Adapt dictionary_creator to use eflomal instead of fast_align
[x] Evaluate DC for eng-fra, eng-tpi without fine-tuning
[x] Evaluate DC for eng-meu without fine-tuning
[ ] Fine-tune DC for eng-tpi on with NVIDIA/CUDA GPU or cluster (takes ~70h on notebook CPU)
Goal
As a software developer, I want to try out replacing fast_align with the AWESoME word aligner to see if this improves the dictionary creator's F1 score. Motivation: improve alignment -> reduce FPs -> increase DC's precision
Tasks
dictionary_creatorto use eflomal instead of fast_alignF1* / MRR