-
### Bug Description
Integrated with langchain, Qwen-7B-Chat model is deployed under FastChat and vLLM, which OpenAI API is employed. When the number of input tokens is more than 2048, it raise
```…
Hspix updated
9 months ago
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
Having an LLM router implementation would be cool. Can take [RouteLLM](https://github.com/lm-sys/RouteLLM) implementation for example.
-
### Willingness to contribute
Yes. I can contribute this feature independently.
### Proposal Summary
Langchain flavor does not permit to log a chain in MLflow with a custom LLM model wrapper (llm t…
-
I'm building a very simple LangChain application that takes as an input a customer feedback string and categorizes it into the following pydantic class:
```
class AnalysisAttributes(BaseModel):
…
-
Python version 3.11.9
Poetry version 1.8.2
Make version 3.81
Running make install runs fine, but when running make run-app I get the following logs:
cd backend/app && poetry run uvicorn app.ma…
-
Add to an `/examples` directory that uses docker compose with Arize Phoenix to run "real-world" applications
- [x] #108
- [ ] [Python] Langchain using lang-serve
-
I tried to built a new endpoint in openai-compatible server which calls langchain in it and got an error.
Here's how I start the OpenAI compatible server:
```
python -m fastchat.serve.controller
…
-
嵌入模型：nomic-embed-text:latest
对话模型：llama/llama3:latest
URL: /api/models/chat User: null
Chat with knowledge base with id: 23
Knowledge base aaa with embedding "nomic-embed-text:latest"
Creating…
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing ans…