Add plugins - Githubissues

codelion / optillm

Optimizing inference proxy for LLMs

Apache License 2.0

1.6k stars 128 forks source link

Closed codelion closed 4 weeks ago

codelion commented 4 weeks ago

Plugins are loaded in the following order

from package plugins folder
current directory/optillm/plugins folder for same SLUG we will override with local plugins