issues
search
chenhunghan
/
ialacol
🪶 Lightweight OpenAI drop-in replacement for Kubernetes
MIT License
143
stars
17
forks
source link
Reduce memory usage for large models
#61
Closed
chenhunghan
closed
1 year ago
chenhunghan
commented
1 year ago
Drop support for
DOWNLOAD_DEFAULT_MODEL
Use singleton on app.startup
DOWNLOAD_DEFAULT_MODEL