NexaAI / nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.
https://docs.nexa.ai/
Apache License 2.0
4.49k stars 664 forks source link

[QUESTION] <title>error pulling model from modelscope #291

Open mi804 opened 5 days ago

mi804 commented 5 days ago

Question or Issue

When installing nexaai using Executable Installer curl -fsSL https://public-storage.nexa4ai.com/install.sh | sh and run nexa run -ms Qwen/Qwen2.5-Coder-7B-Instruct-GGUF, the following error occured

Error accessing repository 'Qwen/Qwen2.5-Coder-7B-Instruct-GGUF'. Please make sure you have access to the ModelScope repository first.
ERROR:root:An error occurred while pulling the model: name 'exit' is not defined. The model path provided (Qwen/Qwen2.5-Coder-7B-Instruct-GGUF) may not exist.

It seems that the issue might be related to the Executable Installer not including the necessary modelscope dependencies. Could you kindly inform me when the Installer is expected to be updated?

OS

Ubuntu2204

Python Version

No response

Nexa SDK Version

0.0.9.5

GPU (if using one)

No response