search

shmsw25 / FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
https://arxiv.org/abs/2305.14251
MIT License
275 stars 40 forks source link

make factscore use chatgpt for atomic fact generation #42

Open dojoteef opened 7 months ago

dojoteef commented 7 months ago

@martiansideofthemoon here's the code i used to make atomic fact generation use the chat api rather than the legacy completion api

shrusti-ghela commented 7 months ago

To make the changes work, you need to use the openai version 0.28. You might want to update the requirements.txt file accordingly.