WukLab / preble

Stateful LLM Serving
Apache License 2.0
32 stars 4 forks source link

Multi Experiment support #52

Closed vikranth22446 closed 5 months ago

vikranth22446 commented 5 months ago

Currently we couple a single expeirment to a single policy. However, each experiment we might want to test a different combination of runtime arguments