issues
search
kasnerz
/
factgenie
A Toolkit for Annotating and Visualizing LLM Hallucinations
MIT License
1
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Document properly the LLM output file json format
#38
oplatek
opened
23 hours ago
0
Confusing URL for crowdsource campaign creators
#37
oplatek
opened
1 day ago
0
The host prefix is not used for the factgenie url in the logo
#36
oplatek
opened
1 day ago
0
add practicald2t sharedtask 2024 (st24 prefixed) datasets
#35
oplatek
closed
1 day ago
0
Cli api llm eval
#34
oplatek
closed
5 days ago
0
Duplicate Human / LLM eval from existing campaign
#33
oplatek
opened
1 week ago
0
Add CLI API to factgenie for LLM eval
#32
oplatek
closed
4 days ago
1
Annotations in the crowdsourcing interface cannot overlap
#31
oplatek
opened
1 week ago
0
Page Annotations is always empty?
#30
oplatek
opened
1 week ago
0
Link examples to the README how to prepare instructions for crowdsourcing campaign
#29
oplatek
opened
1 week ago
0
Humeval for logicnlg: factuality and interesting claims
#28
oplatek
closed
1 week ago
0
After LLM annotation is finished offer possible actions
#27
oplatek
opened
1 week ago
0
Simplify defining span annotations categories
#26
oplatek
opened
1 week ago
0
It is possible to "continue" LLM eval campaign after it is finished
#25
oplatek
opened
1 week ago
0
add llm-eval, documenting and testing LLM evaluation
#24
oplatek
closed
1 week ago
0
Changing llm-eval model name renames the llm-evaluation campaign which cannot be loaded anymore
#23
oplatek
opened
1 week ago
1
Pausing LLM evaluation causes bug
#22
oplatek
opened
1 week ago
0
Add logicsql
#21
oplatek
closed
2 weeks ago
0
Adding LogicNLG with custom annotations
#20
oplatek
closed
1 week ago
1
Prevent users from accessing other pages
#19
kasnerz
opened
2 weeks ago
1
Support other crowdsourcing services
#18
kasnerz
opened
2 weeks ago
0
Add export LLM eval functionality
#17
oplatek
opened
2 weeks ago
0
Explicitly ask for OPENAI_API_KEY
#16
kasnerz
opened
2 weeks ago
0
Uploading model outputs
#15
kasnerz
opened
3 weeks ago
0
OpenWeather do not have any annotations at the
#14
oplatek
opened
3 weeks ago
1
Data management page
#13
kasnerz
opened
3 weeks ago
0
LLM eval instructions
#12
kasnerz
opened
3 weeks ago
0
Stress testing
#11
kasnerz
opened
3 weeks ago
0
Display individual examples for each batch
#10
kasnerz
opened
3 weeks ago
0
Extra annotation attributes
#9
kasnerz
opened
3 weeks ago
0
Change the default highlight color
#8
kasnerz
opened
3 weeks ago
0
Anonymization
#7
kasnerz
closed
1 week ago
1
Improve the way LLM eval runs in the background
#6
kasnerz
opened
3 weeks ago
0
User-friendly configuration for LLM eval
#5
kasnerz
opened
3 weeks ago
2
Example datasets
#4
kasnerz
opened
3 weeks ago
0
Pip package
#3
kasnerz
opened
3 weeks ago
0
Document the configuration file
#2
kasnerz
opened
3 weeks ago
0
Move instructions to wiki
#1
kasnerz
opened
3 weeks ago
0