search

mlabonne / llm-autoeval

Automatically evaluate your LLMs in Google Colab
MIT License
460 stars 77 forks source link

Docker setup for runpod #5

Closed johannhartmann closed 3 months ago

johannhartmann commented 5 months ago

Hi maxime, first: Thanks for your awesome tools and insights! I am currently trying to provide support for german benchmarks (https://github.com/mayflower/llm-autoeval-de). Since i need to use a different template on runpod, could you give me a hint what the docker setup looks like? Thank you, Johann

mlabonne commented 5 months ago

Hi @johannhartmann, that's really cool! If you don't mind, could you please use my template? I receive a small commission from it – $1 for every 10 days of runtime.

I've updated the LLM AutoEval notebook to allow you to specify the URL of your repo. It will git clone it and run the runpod.sh script inside.

johannhartmann commented 5 months ago

Perfect! Thank you!