search

yale-sys / prompt-cache

Modular and structured prompt caching for low-latency LLM inference
MIT License
48 stars 4 forks source link

Dev sslee #9

Closed shsym closed 11 months ago

shsym commented 11 months ago

I reorganized the repo and clean up the multi news dataset so that it can work with new eval.py