OpenRouterTeam / openrouter-runner

Inference engine powering open source models on OpenRouter
https://openrouter.ai
MIT License
517 stars 49 forks source link

perf: reduce container idle timeout for neuralchat & psyfighter1 #84

Closed sambarnes closed 5 months ago

sambarnes commented 5 months ago

Details

the other psyfighter has a lot more traffic that won't be hitting these idle timeouts

Code of Conduct