-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…
-
I am trying to fine tune a model using FastLanguageModel, and I only want to train the last few layers. When I am passing the target module/layer, it is throwing error saying that it only allows "acce…
-
I have a device containing 4 Nvidia L40 GPUs. I am trying to use the full_finetune_distributed llama3_1/8B_full recipe. My configuration for dataset in the config file is given below:
dataset:
_c…
-
pixel_values = torch.cat([pv for pv in all_pixel_values if pv is not None], dim=0) if any(all_pixel_values) else None
RuntimeError: Boolean value of Tensor with more than one value is ambiguous
su…
-
This is an excellent piece of work, but I am unable to reproduce the results presented in the paper. After three days of communication with the author and repeatedly modifying the code, I still cannot…
-
**Describe the bug**
What the bug is, and how to reproduce, better with screenshots(描述bug以及复现过程,最好有截图)
I am resume training from a checkpoint for model `/internlm-xcomposer2-7b-chat`, but met "Size …
-
想要在自有中文检索数据集上应用internvideo2,看了下最接近的是vatex_cn中使用internvideo2_clip模型,但是在加载过程中遇到些疑问。
1. 共计需要加载哪些ckpt?
目前看是这几个组件
chinese_alpaca_lora_7b
InternVideo2-stage2_1b-224p-f4.pt
1B_clip.pth
internvl_c_13b…
-
图片合成推理是否可以做成服务,通过api的方式调用?
微调后的推理加载不同的lora怎么办呢,是用哪个lora就启动哪个lora吗?
-
Does ONNX support LoRA models? Is there any good examples how to use them and should I convert LoRA models like other models to onnx format?
-
**Describe the problem you have/What new integration you would like**
Add support for LoRa WAN protocol like RFM95
**Please describe your use case for this integration and alternatives you've …