yale-sys / prompt-cache

Modular and structured prompt caching for low-latency LLM inference
MIT License
14 stars 1 forks source link

Development setup #2

Closed shsym closed 9 months ago

shsym commented 9 months ago

I added transformer as a submodule