cisnlp / simalign

Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
MIT License
345 stars 47 forks source link

Batching alignments #43

Open sinking-point opened 10 months ago

sinking-point commented 10 months ago

Thanks for this project, it's really useful.

It would be even more useful if you could do alignments in batches. This could make doing lots of alignments on a GPU much faster.

masoudjs commented 10 months ago

Hi,

Thank you for the comment. :) I have the code for batch alignment and it's been a while that I want to push it. Sorry for the delay. I will test it and push it soon.

sinking-point commented 10 months ago

Fantastic, thanks!

sinking-point commented 9 months ago

@masoudjs In the meantime, would you mind pushing the WIP code you have to a feature branch? It would be really useful for me.