gpt-omni / mini-omni

open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.
https://arxiv.org/abs/2408.16725
MIT License
2.43k stars 240 forks source link

can u help me? #17

Closed tiandaoyuxi closed 1 week ago

tiandaoyuxi commented 1 week ago

(omni) D:\mini-omni>python server.py --ip '0.0.0.0' --port 60808

A module that was compiled using NumPy 1.x cannot be run in NumPy 2.0.2 as it may crash. To support both 1.x and 2.x versions of NumPy, modules must be compiled with NumPy 2.0. Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.

If you are a user of the module, the easiest solution will be to downgrade to 'numpy<2' or try to upgrade the affected module. We expect that some modules will need time to support NumPy 2.

Traceback (most recent call last): File "D:\mini-omni\server.py", line 6, in from inference import OmniInference File "D:\mini-omni\inference.py", line 2, in import lightning as L File "C:\Users\win11.conda\envs\omni\lib\site-packages\lightning__init.py", line 18, in from lightning.fabric.fabric import Fabric # noqa: E402 File "C:\Users\win11.conda\envs\omni\lib\site-packages\lightning\fabric__init.py", line 30, in from lightning.fabric.fabric import Fabric # noqa: E402 File "C:\Users\win11.conda\envs\omni\lib\site-packages\lightning\fabric\fabric.py", line 35, in import torch File "C:\Users\win11.conda\envs\omni\lib\site-packages\torch__init__.py", line 2120, in from torch._higher_order_ops import cond File "C:\Users\win11.conda\envs\omni\lib\site-packages\torch_higher_order_ops\init__.py", line 1, in from .cond import cond File "C:\Users\win11.conda\envs\omni\lib\site-packages\torch_higher_order_ops\cond.py", line 5, in import torch._subclasses.functional_tensor File "C:\Users\win11.conda\envs\omni\lib\site-packages\torch_subclasses\functional_tensor.py", line 42, in class FunctionalTensor(torch.Tensor): File "C:\Users\win11.conda\envs\omni\lib\site-packages\torch_subclasses\functional_tensor.py", line 258, in FunctionalTensor cpu = _conversion_method_template(device=torch.device("cpu")) C:\Users\win11.conda\envs\omni\lib\site-packages\torch_subclasses\functional_tensor.py:258: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at C:\actions-runner_work\pytorch\pytorch\builder\windows\pytorch\torch\csrc\utils\tensor_numpy.cpp:84.) cpu = _conversion_method_template(device=torch.device("cpu")) Traceback (most recent call last): File "D:\mini-omni\server.py", line 6, in from inference import OmniInference File "D:\mini-omni\inference.py", line 24, in import whisper File "C:\Users\win11.conda\envs\omni\lib\site-packages\whisper.py", line 69, in libc = ctypes.CDLL(libc_name) File "C:\Users\win11.conda\envs\omni\lib\ctypes\init.py", line 364, in init__ if '/' in name or '\' in name: TypeError: argument of type 'NoneType' is not iterable

tiandaoyuxi commented 1 week ago

(omni) D:\mini-omni>pip install PyAudio==0.2.14 Collecting PyAudio==0.2.14 Downloading PyAudio-0.2.14-cp310-cp310-win_amd64.whl.metadata (2.7 kB) Downloading PyAudio-0.2.14-cp310-cp310-win_amd64.whl (164 kB) Installing collected packages: PyAudio Successfully installed PyAudio-0.2.14

tiandaoyuxi commented 1 week ago

OS:win11

zoldaten commented 1 week ago

theres a problem with numpy or torch: UserWarning: Failed to initialize NumPy: _ARRAY_API not found

which versions u use ?

*dont forget to start with python3 (not python)?

mini-omni commented 1 week ago

@zoldaten thanks for your help. @tiandaoyuxi sorry, we only tested on the linux environment, and I'm not familier with DL settings for WinOS. But my suggestion will be: check the modules' version and make sure you run the right way.

AgainstEntropy commented 1 week ago

There are some hints in error info and requirements.txt actually. Try installing numpy with a version below 2:

pip install numpy<2
mini-omni commented 1 week ago

as @AgainstEntropy mentioned, you may try: pip install numpy==1.26.3, this numpy version works for me.

pli2014 commented 1 week ago

pip install numpy==1.26.3 which resolve this issure.

mini-omni commented 1 week ago

I close it for now, feel free to re-open.