Model generates wrong LaTeX codes (five fonts, 3 versions of LaTeXOCR)

[mailanmi]

I tried to generate LateX codes for a few equations in all five fonts mentioned in the README (Latin Modern Math, GFSNeohellenicMath.otf, Asana Math, XITS Math, Cambria Math) using 3 versions of the program (GUI, Colab version, pix2tex command line tool) However, in some cases I got incorrect outputs.

Here are a few examples:

1 a. Input file:

b. Output generated by pix2tex tool

• Latex code \textstyle{\frac{n}{k-1}}n!
• Compiled LateX code:

2. a. Input file

b. Output generated by pix2tex tool

-Latex code: \sqrt{\left(\operatorname*{lim}{x\rightarrow0}\frac{-\ln(1+25(e^{-x}-1))}{x}\right)^{2}}-\left(\sum{k=0}^{\infty}\Bigg(\frac{23}{24}\Bigg)^{k}

• Compiled Latex code:

3. a. Input file

b. Output generated by GUI version

[lukas-blecher]

Sometimes the model is not sure about the output and the second time you input the same image the result might be different. When I tried out your example images with the cli I got

1. \prod_{i=1}^{n}n! (correct)
2. • \sqrt{\left(\operatorname*{lim}_{x\to0}\frac{-\ln(1+25(e^{-x}-1))}{x}\right)^{2}}-\left(\sum_{k=0}^{\infty}\frac{\left(23\right)^{k}}{(24)}\right)^{2} (incorrect)
   • {\sqrt{\left(\operatorname*{lim}_{x\to0}{\frac{\ln(1+25(e^{-x}-1))}{x}}\right)^{2}-\left(\sum_{k=0}^{\infty}\left({\frac{23}{24}}\right)^{k}\right)^{2}}} (correct) second time around
3. \prod_{i=1}^{n}n! (correct)

So maybe just try again next time. Sometimes the model just doesn't know, it's not perfect. And the GUI might be broken on macOS.

[lukas-blecher]

What pytorch version do you have installed?

[mailanmi]

Thank you for your reply.

My pytorch version is 1.11.0.

When it comes to the errors, I tried to run the program multiple times, but every time I got the same error (as attached in the previous message).