search

lukas-blecher / LaTeX-OCR

pix2tex: Using a ViT to convert images of equations into LaTeX code.
https://lukas-blecher.github.io/LaTeX-OCR/
MIT License
12.52k stars 1.03k forks source link

fails on very simple image #335

Open murphyk opened 11 months ago

murphyk commented 11 months ago

It fails to generate a valid latex string for the simple image below.

Code to reproduce this: https://colab.research.google.com/gist/murphyk/7727c1ecd1169c16d02600001818c487/latex-ocr-test.ipynb

280550504-198d0b52-d8ea-4e74-b540-834b3875e15b

kevinlinxc commented 11 months ago

I feel like this was meant for actual latex, not handwriting

SWHL commented 11 months ago

The model provided by the repo is only trained based on the printed formula.

runvnc commented 6 months ago

@murphyk did you find a solution for handwritten math recognition?

murphyk commented 6 months ago

no. but google gemini (internal version) is looking promising...