Nexa SDK is a comprehensive toolkit for supporting ONNX and GGML models. It supports text generation, image generation, vision-language models (VLM), auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.
I get error when use nexa server command
nexaai server Qwen2.5-Coder-1.5B-Instruct:q4_0
Error
TypeError: unsupported operand type(s) for |: 'type' and 'type'
Steps to Reproduce
I install nexaai on my phone using termux
Chat is running fine but when run server as below
nexaai server Qwen2.5-Coder-1.5B-Instruct:q4_0
Traceback (most recent call last):
File "/usr/local/bin/nexaai", line 8, in
sys.exit(main())
File "/usr/local/lib64/python3.9/site-packages/nexa/cli/entry.py", line 190, in main
run_ggml_inference(args)
File "/usr/local/lib64/python3.9/site-packages/nexa/cli/entry.py", line 9, in run_ggml_inference
from nexa.gguf.server.nexa_service import run_nexa_ai_service as NexaServer
File "/usr/local/lib64/python3.9/site-packages/nexa/gguf/server/nexa_service.py", line 28, in
from nexa.gguf.sd.stable_diffusion import StableDiffusion File "/usr/local/lib64/python3.9/site-packages/nexa/gguf/sd/stable_diffusion.py", line 822, in
def validate_dimensions(dimension: int | float, attribute_name: str) -> int:
TypeError: unsupported operand type(s) for |: 'type' and 'type'
Alias4D
commented
2 days ago
Issue Description
I get error when use nexa server command nexaai server Qwen2.5-Coder-1.5B-Instruct:q4_0
Error TypeError: unsupported operand type(s) for |: 'type' and 'type'
Steps to Reproduce
I install nexaai on my phone using termux Chat is running fine but when run server as below
nexaai server Qwen2.5-Coder-1.5B-Instruct:q4_0Traceback (most recent call last): File "/usr/local/bin/nexaai", line 8, in
sys.exit(main())
File "/usr/local/lib64/python3.9/site-packages/nexa/cli/entry.py", line 190, in main
run_ggml_inference(args)
File "/usr/local/lib64/python3.9/site-packages/nexa/cli/entry.py", line 9, in run_ggml_inference
from nexa.gguf.server.nexa_service import run_nexa_ai_service as NexaServer
File "/usr/local/lib64/python3.9/site-packages/nexa/gguf/server/nexa_service.py", line 28, in
from nexa.gguf.sd.stable_diffusion import StableDiffusion File "/usr/local/lib64/python3.9/site-packages/nexa/gguf/sd/stable_diffusion.py", line 822, in
def validate_dimensions(dimension: int | float, attribute_name: str) -> int:
TypeError: unsupported operand type(s) for |: 'type' and 'type'
OS
Android, Termux fedora distro
Python Version
3.9.9
Nexa SDK Version
0.8.5
GPU (if using one)
No response