-
distill_logits.py script generates cuda oom issue while starting the training.
-
### Bug
- Follow this [guide](https://skypilot.readthedocs.io/en/latest/gallery/llms/qwen.html)
- Expect the vLLM server to come up, but the job fails instead due to no CUDA drivers
- I looked thro…
-
### What is the issue?
A request was made to ollama and never returned, after restarting ollama I found that the request was processed for 30 minutes, doesn't ollama have a timeout mechanism for pr…
-
Subscribe to this issue and stay notified about new [daily trending repos in all languages](https://github.com/trending?since=daily)!
-
modelscope 下载的Qwen2-7B，下载模型地址为git clone https://www.modelscope.cn/qwen/Qwen2-7B.git为啥推理的时候，我问他的名字和开发者，回答的是chatgpt和openai
ValueError: The following `model_kwargs` are not used by the model: ['stop_words_ids'] (note: typos …
-
Thank you for your excellent work!
You provide the code to use Qwen for image captioning, can you provide the code for Shikra?
-
### The model to consider.
I am interested in deploying the HuatuoGPT-Vision 7B model, as detailed in the repository [HuatuoGPT-Vision](https://github.com/FreedomIntelligence/HuatuoGPT-Vision). Howev…
-
### Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general).
- [X] I have s…