-
## ⚙️ Request New Models
- Link to an existing implementation (e.g. Hugging Face/Github): https://huggingface.co/internlm
- Is this model architecture supported by MLC-LLM? (the list of [support…
-
Excuse me. I would like to check the effectiveness on the datasets I get by running the code in github. However, the necessary models, such as DMR and InternLM2-7B, are unknown. Could you please give…
-
How can i run internlm2_5-7b-chat-1m in ktransformers?
I have downloaded the internlm2_5-7b-chat-1m model file and converted it to a gguf file. But ktransformer still reports an error like that:
…
-
```
ModuleNotFoundError: No module named 'termcolor'
Traceback:
File "anaconda3/envs/torch/lib/python3.9/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error…
-
vllm cli: ```CUDA_VISIBLE_DEVICES=6,7 python -m vllm.entrypoints.openai.api_server --served-model-name Qwen2-7B-Instruct --port 8001 --model ../models/Qwen2-7B-Instruct --tensor-parallel-size 2 --api-…
-
### 先决条件
- [X] 我已经搜索过 [问题](https://github.com/open-compass/opencompass/issues/) 和 [讨论](https://github.com/open-compass/opencompass/discussions) 但未得到预期的帮助。
- [X] 错误在 [最新版本](https://github.com/open-com…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue y…
-
Support finetuning LLaVA 1.6
-
转换报错：Error: Internal: src/sentencepiece_processor.cc(1101) [model_proto->ParseFromArray(serialized.…
-
mlx version: 0.16
mlx-lm version: 0.15.2
python version: Python 3.12.4
Steps to duplicate:
```
python -m mlx_lm.convert \
--hf-path internlm/internlm2_5-20b-chat \
-q --q-bits 8 \
…