search

shmsw25 / FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
https://arxiv.org/abs/2305.14251
MIT License
238 stars 32 forks source link

fix bugs in retrieval #15

Closed absolute-nil closed 1 year ago

absolute-nil commented 1 year ago

Fixed MAX_LENGTH missing and typo in SPECIAL_SEPARATOR and added truncation to tokenizer.

shmsw25 commented 1 year ago

close PR since it was already reflected in d768d81. Instead of truncating the long sequence, we are splitting them into multiple blocks.