-
### System Info / 系統信息
Miniconda3_3.10 ubuntu22.04 CUDA 12.1
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
- [ ] docker / docker
- [ ] pip install / 通过 pip install 安装
- [X] …
-
我用本地下载好的模型权重和本地数据进行sft的时候，这样启动，但是报模型没注册，现在还不支持加载本地的模型权重吗？
export NPROC_PER_NODE=8 \
export ASCEND_RT_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 \
export HCCL_SOME_VARIABLE=value \
export OMP_NUM_THREADS=192
…
-
When I run:
python llm_export.py --type Qwen-7B-Chat --path /mnt/LLM_Data/Qwen-7B-Chat --export_split --export_token --export_mnn --onnx_path /mnt/LLM_Data/Qwen-7B-Chat-onnx --mnn_path /mnt/LLM_Data/…
-
## Goal
- Remove the need to press the button, detect the voice
- Medium-term
- Enables ambient voice detection
- Enables interruptibility
- Small model that has binary classifier for vo…
-
### System Info / 系統信息
操作系统：Ubuntu20.04以及24.04
### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
- [X] docker / docker
- [X] pip install / 通过 pip install 安装
- [ ] installation from s…
-
bug:
```shell
Traceback (most recent call last):
File "/DATA/DATA1/renxiaoyu/202403_mllm/code/internlm-xcomposer_inference.py", line 33, in
model = InternLMXComposer2QForCausalLM.from_quant…
-
**Describe the bug**
A clear and concise description of what the bug is.
Using the latest cosyvoice code to load the model failed:
```python
TypeError: ('Invalid argument to class cosyvoice.llm.…
-
ERROR:root:Traceback (most recent call last):
File "L:\stable-diffusion\extensions\sd-webui-comfyui\ComfyUI\execution.py", line 155, in recursive_execute
output_data, output_ui = get_output_da…
-
### System Info / 系統信息
python=3.11.10
vllm=0.6.3.post1
transformers=0.6.3.post1
vllm-cpp-python=0.3.1
Ubuntu="18.04.6 LTS (Bionic Beaver)"
### Running Xinference with Docker? / 是否使用 Docker 运行 Xi…
-
python demo.py
2023-12-27 13:25:47,978 - modelscope - INFO - PyTorch version 2.1.2 Found.
2023-12-27 13:25:47,981 - modelscope - INFO - TensorFlow version 2.15.0.post1 Found.
2023-12-27 13:25:47…