search

NexaAI / nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.
https://docs.nexaai.com/
Apache License 2.0
685 stars 92 forks source link

Error Downloading Llama3-8B-Lexi-Uncensored Model: 503 Server Error #97

Open mwzkhalil opened 1 day ago

mwzkhalil commented 1 day ago

Issue Description

I'm experiencing issues with downloading the Llama3-8B-Lexi-Uncensored:fp16 model. The error message indicates a 503 Server Error: Service Temporarily Unavailable when attempting to fetch the model from the provided URL. The process fails with the following error messages:

Downloading Llama3-8B-Lexi-Uncensored/fp16.gguf... An error occurred while downloading or processing the model: 503 Server Error: Service Temporarily Unavailable for url: https://public-storage.nexa4ai.com/Llama3-8B-Lexi-Uncensored/fp16.gguf Failed to pull model Llama3-8B-Lexi-Uncensored:fp16

Steps to Reproduce

  1. Run the command: nexa run Llama3-8B-Lexi-Uncensored:fp16
  2. Observe the error messages related to downloading the model.

OS

Windows

Python Version

3.10.13

Nexa SDK Version

0.0.8.3

GPU (if using one)

Nan

Davidqian123 commented 20 hours ago

Hi, could you tell me what region you are in? We did receive some issues about the limit zone access of our cloud server. We are investigating it.