-
### How are you running AnythingLLM?
Docker (local)
### What happened?
When the workspace uses a visual model, the system functions normally if the system default visual model is used, but if the s…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
To aid in the design for both of these:
- #331
- #556
I'm going to gather a bunch of examples of how different LLMs accept multi-modal inputs. I'm particularly interested in the following:
- …
-
请问跑minicpm-llama3-v-2_5(int4)支持并发调用接口么?2个及以上并发调用就报错了,单个没有问题。。。。
![微信截图_20240619180246](https://github.com/xorbitsai/inference/assets/167763677/caba7bf3-199d-4a24-88a3-b0e9833b50b2)
![微信截图_2024061918…
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
只有fineture.py (下面代码)里能看到包含一个vpm和llm。
没有https://huggingface.co/openbmb/MiniCPM-V-2_6/blob/main/modeling_minicpmv.py
if not…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
执行minicpm-V-2最佳实践,在推理时,输入prompt与图片路径后,程序不输出任何结果,也不报错.
![企业微信截图_17249886876962](https://githu…
-
1. What are the maximum lengths of query and message when you train model `bge-reranker-v2-minicpm-layerwise`?
2. Why these setting in data.py?
a.
![image](https://github.com/FlagOpen/FlagEmbeddin…
aagq updated
3 months ago
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Motivation
I found that the input token logprob is supported by Offline Inference Pipeline, as mentioned in [doc](https://lmdeploy.readthedocs.io/en/latest/inference/vl_pipeline.html#calculate-lo…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing…