-
Subscribe to this issue and stay notified about new [weekly trending repos in Jupyter Notebook](https://github.com/trending/jupyter-notebook?since=weekly).
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
使用最新版的lmdeploy 0.5.1在多卡V100或者…
-
您好,我使用lmdeploy部署internvl2-72b模型,想要实现batch inference。但是实际发现internvl仍然是一个请求处理完再处理下一个,没有实现真正的batch inference。而batch inference又很重要。非常感谢
-
Do you have plans to support other LLM models like Llama 3?
Or would it be easy to modify code implementing interface to OpenAI. I would like inerface using Ollama.
Any hints would be appreciate…
-
export const keys = {
groq: '',
ollama: 'http://localhost:11434/api/chat',
openai: ''
};
-
Hello. I am trying to replicate the baseline results for Target unlearning from the paper, however I have been getting consistently worse results for both LLama3-8B-instruct and Phi-3 Mini-4K-Instruct…
-
just tried this on Windows 10 Pro x64.
Adding image and asking about the image doesn't work.
"I can't see the image you're referring to. I'm a large language model, I don't have the capability to vi…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related iss…
-
在用MiniCPM-Llama3-V-2_5-int4进行微调测试时出现如下错误。
[2024-09-07 13:00:42,421] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING] async_io requires the …
-
lease help, why can I run Ollama 3.1 locally, but comfyui gives an error when I enter the model name?
![Snipaste_2024-07-28_02-55-25](https://github.com/user-attachments/assets/d6d0311a-0ec1-4ab5-9f6…