RamiAwar / dataline

Chat with your data - AI data analysis and visualization on CSV, Postgres, MySQL, Snowflake, SQLite...
https://dataline.app
GNU General Public License v3.0
129 stars 6 forks source link

Allow model selection on the frontend #187

Open anthony2261 opened 1 month ago

anthony2261 commented 1 month ago

Issue #, if available:

171

Description of changes: Add listbox on the settings page to allow choosing preferred model

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

RamiAwar commented 1 month ago

I was about to work on this yesterday, I thought adding this on the conversation itself is nicer (then you can easily switch). What do you think?

Edit: Also what chatgpt does

image
anthony2261 commented 1 month ago

Yeah I like the way it looks, how about both on the settings page and in the chat?

RamiAwar commented 3 weeks ago

After our discussion, agreed to delay this for a while.

Other models seems to be performing much worse in some ways (even though they are more powerful). So let's wait until we have a regression test suite, then we can enable some of those models after testing them thoroughly.

RamiAwar commented 2 weeks ago

I think once we tackle this again, it makes sense to refactor it in a generic way so as to support different LLMs + local LLMs potentially. Code for this is pretty unorganized and very specific to open AI right now (settings and validation, selecting the LLM in code, etc.)

syedazharmbnr1 commented 6 hours ago

After our discussion, agreed to delay this for a while.

Other models seems to be performing much worse in some ways (even though they are more powerful). So let's wait until we have a regression test suite, then we can enable some of those models after testing them thoroughly.

waiting for your feedback update for above