This PR makes it possible to choose different API-based models. There are several things involved:
Creating a global API agent
Using the global API agent in various parts of the code
Updating the notebook-based demo
There is also one somewhat unrelated change (apologies for conflating this) in making max_tokens configurable for the API-based agents. This is because I tried with my Cohere account, and was having trouble due to the default max_token setting for Cohere (20 tokens).
I still haven't been able to do a run-through of the entire pipeline with an API other than OpenAI, I'll try to do that next.
Description
This PR makes it possible to choose different API-based models. There are several things involved:
There is also one somewhat unrelated change (apologies for conflating this) in making
max_tokensconfigurable for the API-based agents. This is because I tried with my Cohere account, and was having trouble due to the defaultmax_tokensetting for Cohere (20 tokens).I still haven't been able to do a run-through of the entire pipeline with an API other than OpenAI, I'll try to do that next.
References
Blocked by