search

stanford-futuredata / ARES

https://ares-ai.vercel.app/
Apache License 2.0
372 stars 41 forks source link

[Feature Request] Multilingual support #20

Closed sociengineer closed 2 months ago

sociengineer commented 3 months ago

Hi, thank you for sharing the wonderful project. I'd like to evaluate my Korean RAG applications, there's no RAG evaluation framework supporting multilingual. Could you add this feature for non english developers? If you guide me how to add codes to support multilingual, I'll contribute to it.

Thanks.

robbym-dev commented 2 months ago

Hi @sociengineer,

Thank you for your interest in our project! ARES recently has gone under new development and now supports multilingual evaluations, including for Korean RAG applications. You would need to swap out the ARES judge used to ensure it can appropriately handle multilingual content, a process made flexible with the use of vLLM, refer here. For more information view our quick start guide, and if you need further guidance on how to make these modifications within ARES, we'd be happy to help.