IAAR-Shanghai CRUD_RAG issues

IAAR-Shanghai / CRUD_RAG

CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models

https://arxiv.org/abs/2401.17043

233 stars 20 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Eliminate some unnecessary warnings

#24 haruhi-sudo closed 1 week ago
0
运行出现除0等错误

#23 kikiLQQ closed 17 hours ago
1
Update README

#22 haruhi-sudo closed 1 week ago
0
项目中QA类型为什么用answers 去向量库召回文档，而不是使用questions？

#21 pluiest closed 1 month ago
2
split_merged.json 是怎么生成的？是人工标注的还是基于大模型生成的

#20 pluiest closed 1 month ago
1
我测试出来quest eval（quest eval model 用gpt-3.5）时，gpt 3.5 的得分比gpt-4o 还要高

#19 Syno8 closed 2 months ago
4
关于复现论文指标时的数据集选用的问题

#18 mzh1996 closed 2 months ago
2
我们的千问1.5-7B模型，复现论文结果，发现比论文结果偏低，长度看起来比论文中更长，请问可能是什么原因呐？

#17 Syno8 closed 2 months ago
4
输出中result和overall为空，且显示如下报错信息

#16 zhaoruchen closed 2 months ago
6
bm25.py 这个文件里面我看也没有实现bm检索？是还没有写好吗

#15 wxhheian closed 3 months ago
1
llama_index and langchain version issue

#14 XinyuYe-Intel closed 3 months ago
2
Low Evaluation Speedup for Local Model

#13 mi-iro closed 3 months ago
1
Remove redundant items

#12 haruhi-sudo closed 3 months ago
0
Bump llama-index from 0.9.32 to 0.10.13

#11 dependabot[bot] closed 3 months ago
1
How to fill data_path docs_path ,collection_name?

#10 aixiaodewugege closed 3 months ago
11
TypeError: object HeadApiResponse can't be used in 'await' expression

#9 applepieiris closed 4 months ago
2
milvus库怎么创建？

#8 Congcong-Song closed 5 months ago
2
提供的数据有错误？

#7 SingL3 closed 5 months ago
3
CustomBM25Retriever的construct_index的作用是什么？

#6 SingL3 closed 5 months ago
1
How much GPU memory is required for default set running? any comments?

#5 yxm0513 closed 6 months ago
1
Request for Test Set Generation Prompts

#4 EnzoWuu closed 6 months ago
1
Dev local

#3 haruhi-sudo closed 8 months ago
0
TypeError: QuestAnswer1Doc.__init__() got an unexpected keyword argument 'use_quest_eval'

#2 songkq closed 8 months ago
1
Dev local

#1 zhiyulee-RUC closed 8 months ago
0