johnml1135
commented
11 months ago We should investigate beam diversity:
- https://arxiv.org/pdf/1610.02424.pdf
- https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig.num_beam_groups
This should help greatly in getting better results.
Add capability to create word graphs by tying into the hugging face BEAM search. These word graphs are then available in batch as pretranslated suggestions.