search

gladcolor / LLM-Geo

GNU General Public License v3.0
293 stars 50 forks source link

Ollama Support #2

Closed orkutmuratyilmaz closed 10 months ago

orkutmuratyilmaz commented 1 year ago

Hello and thanks for this beautiful repository.

Do you have plans for integrating self hosted open source LLMs? If so, can you please consider using Ollama?

Best, Orkut

gladcolor commented 1 year ago

Thanks for your comments, Orkut!

Our team is closely watching the progress of open-sourced LLMs; however, we have no confidence that some of them are better than GPT-4 in terms of task planning and coding. The cheaper GPT-3.5 API cannot perform the task also. So, our team has no plan to introduce other LLMs yet. If you need to use other LLMs, you can override the functions requesting LLM response in the LLm_Geo_kernel.py file. These functions have "LLM" in their names.

Thanks very much, Huan

orkutmuratyilmaz commented 1 year ago

Dear Huan,

Thanks for your kind reply and beautiful recommendation. I'll give it a try on overriding, as you mentioned.

Best, Orkut

paolaos commented 1 year ago

Hi @orkutmuratyilmaz! Did you end up giving it a try? Interested to know how it performed :)

orkutmuratyilmaz commented 1 year ago

Not yet, but I have plans for trying it next week:)

vamsivarma commented 9 months ago

Hello,

Do you have any plans to support ollama models ? or is it already in place

gladcolor commented 9 months ago

Currently no such plans. Per my knowledge, most other models are still at the level of GPT 3.5, which is insufficient to create the qualified solution graphs during our test last year. May Gemini 1.0 Ultra or above have the same or better capability than GPT-4. We will consider Gemini in the future. Our current financial status does not support having other API subscriptions. Therefore, we also pay very close attention to the open source LLMs.