target-benchmark target issues

target-benchmark / target

TARGET is a benchmark for evaluating Table Retrieval for Generative Tasks such as Fact Verification and Text-to-SQL

https://target-benchmark.github.io

Apache License 2.0

14 stars 6 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Optimization for dataset loaders

#43 jixy2012 opened 3 days ago
0
Fix/rerun tests

#42 jixy2012 opened 6 days ago
0
Fix/nih evaluation dataset naming

#41 jixy2012 opened 1 week ago
0
fix: added better embedding tolerance logic for openai embedding

#40 jixy2012 closed 6 days ago
0
Multi-Table Retrieval Metrics

#39 parkervg closed 5 days ago
1
feat: adding a demo notebook

#38 jixy2012 opened 1 week ago
0
Tenacity fix

#37 parkervg closed 1 week ago
0
fix: fix openai client to only be created when needed

#36 jixy2012 closed 2 weeks ago
0
Add Section for Available Baselines in README

#35 jixy2012 opened 2 weeks ago
0
Manual Update Required for New Task Types in Query Type Field

#34 jixy2012 opened 2 weeks ago
1
Integrate needle-in-haystack as separate task

#33 jixy2012 opened 3 weeks ago
0
Feature/parallel openai requests

#32 jixy2012 closed 3 weeks ago
0
`OpenAIError: The api_key client option must be set` Error on Initial Library Import

#31 parkervg closed 2 weeks ago
1
Text2SQLGenerater -> Text2SQLGenerator

#30 parkervg closed 4 weeks ago
0
Feature/needle in haystack task 2

#29 jixy2012 closed 2 weeks ago
0
Consolidate Configs

#28 jixy2012 opened 1 month ago
0
Patch/api request retries

#27 jixy2012 closed 1 month ago
1
Update issue templates

#26 target-benchmark closed 1 month ago
0
Adjust setup

#25 jixy2012 closed 1 month ago
0
Retrieval result persistence

#24 jixy2012 closed 2 months ago
0
Feature/retriever eval

#23 madelonhulsebos closed 2 months ago
0
Run evals

#22 jixy2012 closed 2 months ago
0
Add new and changed retrievers

#21 madelonhulsebos closed 2 months ago
0
Precommit hooks

#20 jixy2012 closed 2 months ago
0
Setup pypi

#19 jixy2012 closed 2 months ago
0
Add embedding latency recording

#18 jixy2012 closed 3 months ago
1
Feature/retriever llamaindex

#17 jixy2012 closed 3 months ago
1
Add dataset options to target class

#16 jixy2012 closed 4 months ago
0
Feature/retriever eval

#15 madelonhulsebos closed 4 months ago
0
Text 2 sql ver2

#14 jixy2012 closed 4 months ago
0
Update data models add openai baseline, move and add table stringify func

#13 madelonhulsebos closed 5 months ago
0
Fix split

#12 jixy2012 closed 5 months ago
0
Feature/hyse

#11 madelonhulsebos closed 5 months ago
2
Fix/change class name

#10 jixy2012 closed 6 months ago
0
Support standardized embedding

#9 jixy2012 closed 6 months ago
0
Fact verification implementation

#8 jixy2012 closed 6 months ago
0
Table qa implementation

#7 jixy2012 closed 6 months ago
3
Refactor old ver python

#6 jixy2012 closed 6 months ago
1
Generators implementation

#5 jixy2012 closed 7 months ago
0
Actually implemented the evaluator class

#4 jixy2012 closed 7 months ago
0
Task Base Class implementation (despite the branch being called Evaluator implementation)

#3 jixy2012 closed 7 months ago
0
Retriever implementation

#2 jixy2012 closed 8 months ago
1
update ri branch

#1 jixy2012 closed 8 months ago
0