OpenBB-finance / openbb-agents

R&D playground to play with agents and OpenBB
73 stars 15 forks source link

OpenAI vs VertexAI #25

Open mmistroni opened 3 weeks ago

mmistroni commented 3 weeks ago

Hey this is not a bug, rather a request for info First off great project! Secondly, you mention in README that i need an OpenAI key to leverage openbb agents. Unfortunately i exhausted my credits with OpenAI and now i cannot do anything. Wanted to leverage VertexAI (or Claude) but i cannot see in the code base where is the link between openbb agents and OpenAI... the only link i can find is import from langchain_openai import OpenAIEmbeddings

So i guess if i can somehow 'inject' this package langchain-google-vertexai in the flow, i shoud be able to use your openbb agents with VertexAI?

Could you please advise and perhaps suggest some resources i can have a look at to get familiar with this langchain stuff? FYI i am already an OpenBB user.... so i guess i just need to learn 'the other half' of the openbb agents equation

Many thanks Marco

mnicstruwig commented 3 weeks ago

Hey @mmistroni,

Thanks for reaching out.

We use magentic (Github) as our LLM framework in openbb-agents.

By default, we use GPT-4o as our model. magentic has good support for Anthropic models (eg. Opus), and I think VertexAI via LiteLLM (but I'll have to confirm).

Give me a few days, and I'll add something to allow you to specify which model to use.

I can't guarantee those models will perform as well as GPT-4o (which is really good at function calling), and our system prompts are specifically targeting GPT-4o, but there's no harm in opening things up and trying.

mmistroni commented 3 weeks ago

That would be great, thank you! But let me try it myself so I can learn how all of this fit together.i have no urgency for this.thanks

On Fri, 14 Jun 2024, 08:19 Michael Struwig, @.***> wrote:

Hey @mmistroni https://github.com/mmistroni,

Thanks for reaching out.

We use magentic (Github https://github.com/jackmpcollins/magentic) as our LLM framework in openbb-agents.

By default, we use GPT-4o as our model. magentic has good support for Anthropic models (eg. Opus), and I think VertexAI via LiteLLM (but I'll have to confirm).

Give me a few days, and I'll add something to allow you to specify which model to use.

I can't guarantee those models will perform as well as GPT-4o (which is really good at function calling), and our system prompts are specifically targeting GPT-4o, but there's no harm in opening things up and trying.

— Reply to this email directly, view it on GitHub https://github.com/OpenBB-finance/openbb-agents/issues/25#issuecomment-2167393993, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACPNCDVYXSVL6ZWUC3TOXOTZHKKQZAVCNFSM6AAAAABJAYJLKSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNRXGM4TGOJZGM . You are receiving this because you were mentioned.Message ID: @.***>