search

langflow-ai / langflow

Langflow is a low-code app builder for RAG and multi-agent AI applications. It’s Python-based and agnostic to any model, API, or database.
http://www.langflow.org
MIT License
33.35k stars 4.06k forks source link

does not seem to work with Groq or Ollama #4398

Open atanudasgupta opened 6 hours ago

atanudasgupta commented 6 hours ago

Bug Description

the playground freezes trying to use anything other than openAI, is it supported?

Reproduction

choose model component from the tray, anything other than OpenAI, use one of the default templates, I tried hello world chat

Expected behavior

it should have worked just like using Openai model

Who can help?

No response

Operating System

using your cloud hosted version

Langflow Version

latest

Python Version

None

Screenshot

No response

Flow File

No response

dosubot[bot] commented 6 hours ago

Hey @atanudasgupta! I'm here to help you with the issue you're facing. I'm a bot designed to assist with bug fixes, questions, and contributions. Let's work together to solve this!

Langflow does support models other than OpenAI, such as Groq, as indicated by the presence of the GroqModel class designed to work with the Groq API [1]. However, there is no specific information available about support for Ollama models or any known issues related to the playground freezing when using these models.

Langflow implements error handling and logging using the loguru library, which could provide insights into why the playground might freeze. Reviewing the logs might help diagnose the issue [2][3].

If the problem persists, it might be helpful to check the logs for any error messages or consider whether there are any specific configurations in the cloud-hosted version that could affect model compatibility.

To continue talking to Dosu, mention @dosu.