WukLab / preble

Stateful LLM Serving
Apache License 2.0
38 stars 6 forks source link

Feat/simulator #29

Closed jiange91 closed 8 months ago

jiange91 commented 8 months ago
  1. Small change to ReAct example workload.
  2. Add hot-cold policy
  3. Change experimental info from logging.debug to logging.info
    • Use logging.debug for things you don't wish to see in the final experiment log