How much time is needed for the evaluation process to be completed?

iKala / ievals

Official github repo for TMMLU+, Large scale traditional chinese massive multitask language understanding

MIT License

43 stars 2 forks source link

How much time is needed for the evaluation process to be completed? #3

Open Enjoy-Ur-Life opened 7 months ago

Enjoy-Ur-Life commented 7 months ago

As title, when I used the GPT API in my tests, I've observed variations in computation time. For instance, processing 420 data took 25 minutes, while 954 data took 9 minutes. Have you ever encountered a similar situations? What is a reasonable amount of time for inference?

螢幕擷取畫面 2024-02-20 182249