GAIR-NLP factool issues

GAIR-NLP / factool

FacTool: Factuality Detection in Generative AI

https://ethanc111.github.io/factool_website/

Apache License 2.0

787 stars 60 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Halu-J

#47 EQ3A2A opened 6 days ago
0
Add feature: Print the total cost of querying the various APIs for a given run

#46 tanay2001 opened 3 months ago
0
AttributeError: 'ClientResponseError' object has no attribute 'get'

#45 HandleGod101 closed 4 months ago
0
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 5856: character maps to <undefined>

#44 murban-create opened 4 months ago
0
Add feature: Evaluate factuality of LLMs on our benchmark with one command.

#43 EthanC111 opened 5 months ago
0
Code for claim extraction evaluation

#42 BrMarco99 opened 5 months ago
1
Exception handling when calculate average claim_level_factuality

#41 EthanC111 opened 6 months ago
0
Error with Factool Installation and Execution

#40 kentrachmat opened 7 months ago
7
How many shots are used for evaluation of HumanEval?

#39 zhimin-z opened 7 months ago
3
Where to download FactPrompts dataset?

#38 zhimin-z closed 7 months ago
4
###evaluate###kbqa###error

#37 C-YEE00 closed 7 months ago
2
请教一下如何使用azure接口的openai api-key?

#36 wwngh1233 closed 7 months ago
1
How are the metrics: acc, precision, recall of claim level calculated？

#35 LeiyanGithub opened 10 months ago
4
ChineseFactEval update and some bugs fix

#34 EthanC111 closed 10 months ago
0
RuntimeError in Jupyter Notebook

#33 ch-au closed 10 months ago
2
Create LICENSE

#32 EthanC111 closed 10 months ago
0
add law counsel qa pipeline

#31 EQ3A2A opened 11 months ago
0
update readme for medical record revision scenario

#30 EQ3A2A closed 11 months ago
0
Allow users/developers to customized llms of different modules (e.g., claim extraction, question generation)

#29 pfliu-nlp opened 11 months ago
0
create a doc to detail how to change openai-based models to customized models

#28 pfliu-nlp opened 11 months ago
0
Add mode for factool - Standards for judging factuality

#27 EthanC111 opened 11 months ago
0
add example for med doc qa

#26 EQ3A2A closed 11 months ago
0
An error of google serper

#25 RZFan525 closed 11 months ago
4
Change the current prompts to OpenAI function calling prompts

#24 EthanC111 opened 11 months ago
0
add feature: medical doc summarization

#23 EQ3A2A closed 11 months ago
0
encapsulate for environment variable reference

#22 EQ3A2A opened 11 months ago
0
Improving the implementation of env variables in gradio

#21 pfliu-nlp opened 11 months ago
0
Add support for Azure, OpenAI, Palm, Anthropic, Cohere, Replicate Models - using litellm

#20 ishaan-jaff opened 11 months ago
2
"When" word in the prompt that appears to be a mistake

#19 lklimkiewicz7 closed 11 months ago
1
Add features: gradio app & local chatbot support

#18 EQ3A2A closed 11 months ago
1
Add GitHub action

#17 pfliu-nlp closed 11 months ago
0
add github action

#16 pfliu-nlp closed 11 months ago
0
bump version 0.1.1

#15 pfliu-nlp closed 11 months ago
0
update README

#14 EQ3A2A closed 11 months ago
0
Add feature: local retrieve & source link for evidences

#13 EQ3A2A closed 11 months ago
1
Implement a frontend interface (e.g Gradio) to allow users to use FacTool easily without having to deploy it locally

#12 EthanC111 closed 11 months ago
0
Look into whether the following proxy setting is the general solution for accessing openai api via proxy

#11 EthanC111 opened 11 months ago
0
update avg_claim_level_factuality calculation

#10 EthanC111 closed 11 months ago
1
add catching APIConnectionError

#9 EthanC111 closed 11 months ago
0
openai.error.APIConnectionError: Error communicating with OpenAI

#8 YaxinFAN1 opened 12 months ago
3
add feature: local retrieve

#7 EQ3A2A closed 12 months ago
0
Integrate Factool into other chatbots (not just chatgpt)

#6 pfliu-nlp opened 12 months ago
0
add source link of search results

#5 EQ3A2A closed 12 months ago
0
Toggling Public knowledge and Private knowledge

#4 fire17 opened 12 months ago
4
请教一下，openai账号和key单独测试可用，已经设置OPENAI_API_KEY，但是程序一直提示链接不上OPENAI

#3 ahong007007 closed 12 months ago
6
Fix typo in agreement_verification.yaml

#2 eltociear closed 12 months ago
1
can i use this to detect fake news?

#1 ralyodio opened 12 months ago
1