Follow-up: Use a JSON configuration file to set up an evaluation run

symflower / eval-dev-quality

DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.

MIT License

137 stars 5 forks source link

Open ruiAzevedo19 opened 3 months ago

ruiAzevedo19 commented 3 months ago

Original issue: #282

[ ] Also store and load custom provider urls so that they don't need to be carried over manually