search

CoIR-team / coir

A Comprehensive Benchmark for Code Information Retrieval.
https://archersama.github.io/coir/
Apache License 2.0
59 stars 11 forks source link

Multi GPU Evaluation #5

Open RuiranYan opened 1 month ago

RuiranYan commented 1 month ago

excellent work！I'm writing to inquire about the possibility of adding support for multi-GPU evaluation to your evaluation framework. Currently, it seems that the existing evaluations are only designed to run on a single GPU, which can become quite time-consuming when evaluating larger models, such as 7B models.

archersama commented 1 month ago

certainly，welcome to add multi gpu support

RuiranYan commented 1 month ago

Does your team have any plans to add multi gpu support in the near future?

archersama commented 1 month ago

Currently, there are no plans for this. So, if you are interested, we welcome you add the multi-GPU support for Coir.