Liyan06 / MiniCheck

MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents [EMNLP 2024]
Apache License 2.0
106 stars 11 forks source link

Update inference.py with doc chunk caching #6

Closed PrasannS closed 3 months ago

PrasannS commented 3 months ago

Should make tokenization step way faster in certain cases where same doc is re-used a lot.