lukas-blecher / LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.
https://lukas-blecher.github.io/LaTeX-OCR/
MIT License
12.7k stars 1.03k forks source link

Clarifications on loss definition #373

Open JuanseHevia opened 8 months ago

JuanseHevia commented 8 months ago

Hi! thanks for your amazing work! I'm currently working on expanding it to handwritten and multiline LaTeX. However, I'm facing a bit of a struggle understanding the loss function you are using during training.

Could you help me get some more clarity on the loss you are using and how you are computing it? I see that, during training, you refer to model.data_parallel but then I don't see a specific call to a loss function computation.

Thanks again! Looking forward to your reply.