search

FudanDISC / DISC-LawLLM

[中文法律大模型] DISC-LawLLM: an intelligent legal system powered by large language models (LLMs) to provide a wide range of legal services.
Apache License 2.0
563 stars 66 forks source link

Different evaluation results #35

Open zjintheroom opened 11 months ago

zjintheroom commented 11 months ago

你好，问您一下，为什么在评测分支下，用您这边提供的DISC-lawLLM测评 评测集的结果与仓库底下评测的结果略有差距呢？

是跟解码方式有关么，另外，咱们的外挂知识库，代码里有用到么。谢谢

Charlie-XIAO commented 11 months ago

The eval branch is not finalized yet, and our evaluation does not include the retrieval module.

zjintheroom commented 11 months ago

The eval branch is not finalized yet, and our evaluation does not include the retrieval module.

Thank you for your reply, and I'd like to ask you when our final review branch will be available

Charlie-XIAO commented 11 months ago

I'm sorry but this is not something I can decide. Perhaps @yueshengbin would be able to give an approximate release date.

zjintheroom commented 11 months ago

I'm sorry but this is not something I can decide. Perhaps @yueshengbin would be able to give an approximate release date.

谢谢您的回复。如果您@yueshengbin 这边后续有完善评价分支的话，可以回复告诉我一下么。谢谢您

zjintheroom commented 11 months ago

还有个问题，想问一下。咱们在评测的过程中，generate的decode配置参数是什么，可以提供么。是用的贪心策略么还是其他的。@yueshengbin @Charlie-XIAO