ibm-granite-community / pm

Granite Community Project Management
0 stars 0 forks source link

[4.1.1:3a] Text to model evaluation benchmark #43

Open fayvor opened 3 months ago

fayvor commented 3 months ago
  1. Model Evaluator: Specifies a set of models and a set evaluations/benchmark suites for which execution code is desired.
  2. System: Returns the code required to setup, build, and run the evaluations.