yale-sys / prompt-cache

Modular and structured prompt caching for low-latency LLM inference
MIT License
14 stars 1 forks source link

Quick reload of benchmarks #5

Closed sarda-nikhil closed 8 months ago

sarda-nikhil commented 9 months ago

We should have a way to do a quick reload of schemas for rapid experimentation.

ingim commented 9 months ago

I'll add a feature to unload/reload schemas

shsym commented 8 months ago

@ingim Is it now (kind of) supported by remove_all_schemas?

ingim commented 8 months ago

Yes. I am closing this issue