For certain use cases e.g., cli scripts and web apps, it is important to provide some mechanism to externally set the default LLM provider and configuration
Work Items
set LLMX_CONFIG environment variable which should be a path to the configuration for a model
in llmx.generators.text.textgen.py , check for an available config and use to instantiate llm() . Merge provided kwargs with the content of the config file, with kwargs taking precedence
What
For certain use cases e.g., cli scripts and web apps, it is important to provide some mechanism to externally set the default LLM provider and configuration
Work Items
llmx.generators.text.textgen.py
, check for an available config and use to instantiatellm()
. Merge provided kwargs with the content of the config file, with kwargs taking precedence