search

lastmile-ai / aiconfig

AIConfig is a config-based framework to build generative AI applications.
https://aiconfig.lastmileai.dev
MIT License
960 stars 79 forks source link

Updating model for config (+ documentation) #319

Open tanya-rai opened 12 months ago

tanya-rai commented 12 months ago

I want to easily be able to update the model of my config that has many prompts from GPT4 to llama. Would be nice to have a set_model function that does this for all prompts in my config.

I wish there was a clear example on how to update models in the set_metadata docs. I can imagine this being a common change to config and so having specific docs on this would be nice.

I feel set_metadata is a little broad and important metadata like the model deserves its own function but maybe there are design choices I'm missing context on.

rossdanlm commented 11 months ago

Edit: nm, we're talking about serializing and deserializing into abstract level completion params, not just completion params specific to a specific API (ex: openAI may have "num_return_sequences" while Llama may call the same functionality "num_results")

I think this might be similar to https://github.com/lastmile-ai/aiconfig/pull/507?