-
### Describe the bug
我好像没有找到用internevo训练然后转换成对应的hf的脚本?请问有提供嘛?
### Environment
官方代码
### Other information
_No response_
-
vllm==0.3.0
from vllm import LLM, SamplingParams
llm = LLM(
model="internlm/internlm2-chat-20b",
gpu_memory_utilization=.85,
max_model_len=2000 ,
trust_remote_code=True
)…
-
尊敬的茴香豆开发人员您好,我在学习研究项目时有以下问题仍然有点困惑请求解答:
1. web search超出免费限额的费用标准? 是否可以关闭web search功能?
2. 本地部署支持的llm种类以及服务框架(fastchat?vllm?lmdeploy?)?是否支持自己微调后的模型?
3. 本地单卡部署茴香豆,llm为finetune后internlm2-chat-20b,推荐显卡配置…
-
I have a few questions regarding the 'additional_imports' argument. I noticed that the BFS prover sets additional_imports=['Mathlib.Tactics']. Could you please clarify if this has any positive impact …
-
# 8卡finetune llava-interlm2时遇到错误
# 环境
8卡 l40,internlm2 1.8B,
-
作者您好,我注意到目前InternLM2_Chat模型好像只有对chat能力微调的代码,没有对工具调用能力进行微调的样例。之后是否有相关的更新计划呢?
-
Is Poppler required to be downloaded for this project?
-
Dear Developers, I can perform inference using the script you provided, but I encounter an object type mismatch during training. Specifically, I checked the data type, and the image input is already a…
nzomi updated
3 weeks ago
-
我在训练时输出以下内容后,程序就停止了,请问这种情况该如何解决?
`2024-05-15 09:29:44.939294: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plug…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
启动微调后的模型,回答带有很多重复(微调的i…
xxg98 updated
6 months ago