dfsbora / latex-math-model

0 stars 0 forks source link

Implement dataloader with meaningful blocks separation #11

Closed dfsbora closed 3 months ago

dfsbora commented 3 months ago

When splitting the data for training, we want to avoid splitting a single block (e.g. a proof environment in latex) in different parts if they could fit all together in a segment.

dfsbora commented 3 months ago

implemented, but testing and running some experiments before pushing