AssertionError: `topic` in your data (Jessie Mae Brown Beavers) is likely to be not a valid title in the DB.

shmsw25 / FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

https://arxiv.org/abs/2305.14251

MIT License

238 stars 32 forks source link

AssertionError: `topic` in your data (Jessie Mae Brown Beavers) is likely to be not a valid title in the DB. #37

Open clawnotfound opened 5 months ago

clawnotfound commented 5 months ago

AssertionError: topic in your data (Jessie Mae Brown Beavers) is likely to be not a valid title in the DB.

martiansideofthemoon commented 4 months ago

hi @clawnotfound, thanks for reporting this issue. Did you use a custom prompt set / database?