-
Hi Team,
I tried to change codegeex2 cuda-based python example code to xpu-based python code with codegeex2-6b mode file,
but the program always crashed.
The cuda-based python file is here,
ht…
-
命令行:
swift deploy --model_type yi-1_5-6b --model_id_or_path 01ai/Yi-1.5-6B-Chat --host 0.0.0.0 --port 8001
错误:
[INFO:swift] Start time of running main: 2024-05-19 09:44:09.371086
[INFO:swift] c…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
请问是否能进行codegeex2-6b的微调?
### Expected behavior
_No response_
### System Info
_No response_
### Other…
-
ValueError: model_type: 'llava1d6-yi-34b-instruct' is not registered. The model_type you can choose: ['mengzi3-13b-base', 'baichuan-7b', 'baichuan-13b-chat', 'xverse-moe-a4_2b', 'xverse-7b', 'xverse-7…
-
-
**Describe the bug**
运行微调命令
```
$env:PYTHONPATH="C:\Users\Administrator\AppData\Local\Programs\Python\Python310\python.exe"
$env:CUDA_VISIBLE_DEVICES="0"
python llm_sft.py `
--model_type qwe…
-
python 3.11 / Debian12
复现步骤
按照README做到 `python3 chatglm_cpp/convert.py...` 之前, 然后
```bash
HF_ENDPOINT=https://hf-mirror.com
mkdir models
IN=./models
OUT=./models
pip install -U huggingface_h…
-
大佬,
安卓端版mnn-llm.apk加载chatglm3-6b-mnn无法操作,按照[https://github.com/wangzhaode/mnn-llm/releases/tag/mnn-llm-apk](url) adb传入模型后,“选择模型文件夹”有目录选项,但点击“加载模型”后,显示的还是24.56M的block块下载,如图请问如何处理啊?
![Screenshot_20240…
-
拜读公众号文章《**CodeFuse-MFTCoder提升CodeGeeX2-6B代码能力**》https://mp.weixin.qq.com/s/kWMtHIoe3ytN8pRVi_CHZg 文章指出可以使用MFT对codegeex2进行微调。
在peft中未找到对应codegeex2的config,我是否可以直接使用chatglm2 config进行微调使用?我想进行微调验证的时候,发…
-
i tried codegeex2-6b's building and running with chatglm2-6B example, but it resulted incorrectly.
the result listed as follows:
root@***:/app/tensorrt_llm/examples/chatglm2-6b# python3 run.py --inp…