-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
Fellow MiniCPM-Llama3-V 2.5 project authors, a few days ago I discovered a shocking fact.There is a large amount of work in the llama3-V (https://github.com/mustafaaljadery/llama3v) project that is su…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Motivation
I found that the input token logprob is supported by Offline Inference Pipeline, as mentioned in [doc](https://lmdeploy.readthedocs.io/en/latest/inference/vl_pipeline.html#calculate-lo…
-
请问跑minicpm-llama3-v-2_5(int4)支持并发调用接口么?2个及以上并发调用就报错了,单个没有问题。。。。
![微信截图_20240619180246](https://github.com/xorbitsai/inference/assets/167763677/caba7bf3-199d-4a24-88a3-b0e9833b50b2)
![微信截图_2024061918…
-
运行日志如下:
~/llm/demo/server_demo$ sudo python flask_server.py --target_platform rk3588 --rkllm_model_path ../../model/minicpm.rkllm
=========init....===========
rkllm-runtime version: 1.0.1, rknpu d…
-
- [x] MiniCPM-Llama3-V-2_5
- [x] Florence 2
- [x] Phi-3-vision
- [x] Bunny
- [x] Dolphi-vision-72b
- [x] Llava Next
- [ ] Idefics 3
- [ ] Llava Interleave
- [ ] Llava onevision
- [ ] internlm…
-
torchrun \
--nnodes $ARNOLD_WORKER_NUM \
--node_rank $ARNOLD_ID \
--master_addr $METIS_WORKER_0_HOST \
--nproc_per_node $ARNOLD_WORKER_GPU \
--master_port $port \
example…
-
Below are the benchmark results on both THUDM/chatglm3-6b and openbmb/MiniCPM-2B-sft-bf16, from which we can see that chatglm3-6b has better throughput than miniCPM-2b. Considering MiniCPM-2b is a 2…
-
1. What are the maximum lengths of query and message when you train model `bge-reranker-v2-minicpm-layerwise`?
2. Why these setting in data.py?
a.
![image](https://github.com/FlagOpen/FlagEmbeddin…
aagq updated
3 months ago