-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
给一个1-20万字的文本,让它总结文本内容,只要超过1万字…
-
Hi,
I noticed that the repository currently lacks support for the InternLM2.5-7B (1.8B, 20B) model, which may cause compatibility issues or missing steps for users trying to implement it. It would …
-
when I use "Change specific numbers:" to augment problem using internlm2-math-20b to, the model answering the question instead of augment it~
import torch
from transformers import AutoTokenizer, A…
-
背景:
模型internlm2.5-7b-chat
单机4卡A10,单卡24GB
问题:
1. xtuner能实现模型切分么?即多个卡共用一个模型,而不是在每个卡上都单独加上一个模型再去微调训练,这样的话很容易会显存不足;能做到说模型切分到了某张卡运行,其余的卡加载数据训练吗?
2. 按官方要求的多轮对话格式训练时,其中的单个message json就达到了几百个,且暂时不拆分数…
-
微调的时候出现这个问题,请问大佬们如何解决
(base) root@91bd5febc58b:/data/nlp_translate# CUDA_VISIBLE_DEVICES=2,3 NPROC_PER_NODE=2 xtuner train /data/nlp_translate/train_for_internlm/internlm2_5_chat_7b_qlora.py --d…
-
-
warnings.warn(
Traceback (most recent call last):
File "/share/ai/InternLM-XComposer-main/./demo_asset/serve_utils.py", line 65, in gentask
ret = self.mfunc(callback=_callback, **self.kwarg…
-
Is Poppler required to be downloaded for this project?
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…
-
I have a few questions regarding the 'additional_imports' argument. I noticed that the BFS prover sets additional_imports=['Mathlib.Tactics']. Could you please clarify if this has any positive impact …