search

bricks-cloud / BricksLLM

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
https://trybricks.ai/
MIT License
863 stars 60 forks source link

use koanf #61

Closed GingerMoon closed 3 months ago

GingerMoon commented 3 months ago

I want to use cfg_dev/test/prod.json + env for configuration. json cfg is for ordinary cfg. env is for db cnn string which will be set by CICD. env cfg overrides json cfg.

I made this draft PR to see if you agree to use https://github.com/knadh/koanf. Please feel free to let me know if you have any concern about using koanf.

spikelu2016 commented 3 months ago

this requires some manual testing and contains potential breaking changes. let me see if i can get to it by the end of tmr

GingerMoon commented 3 months ago

I made a newer PR for this: https://github.com/bricks-cloud/BricksLLM/pull/62