start agent error: data did not match any variant of untagged enum ModelWrapper at line 757479 column 3

Kingdroper commented 2 weeks ago

Self Checks

[X] This template is only for bug reports. For questions, please visit Discussions.
[X] I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文日本語 Portuguese (Brazil)
[X] I have searched for existing issues, including closed ones. Search issues
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
[X] Please do not modify this template and fill in all required fields.

Cloud or Self Hosted

Cloud

Environment Details

Ubuntu22.04

python _libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
absl-py 2.1.0 pypi_0 pypi aiofiles 23.2.1 pypi_0 pypi aiohttp 3.9.5 pypi_0 pypi aiosignal 1.3.1 pypi_0 pypi aliyun-python-sdk-core 2.15.1 pypi_0 pypi aliyun-python-sdk-kms 2.16.3 pypi_0 pypi annotated-types 0.7.0 pypi_0 pypi antlr4-python3-runtime 4.9.3 pypi_0 pypi anyio 4.4.0 pypi_0 pypi async-timeout 4.0.3 pypi_0 pypi attrs 23.2.0 pypi_0 pypi audioread 3.0.1 pypi_0 pypi av 12.3.0 pypi_0 pypi baize 0.22.1 pypi_0 pypi bzip2 1.0.8 h5eee18b_6
ca-certificates 2024.9.24 h06a4308_0
cachetools 5.4.0 pypi_0 pypi certifi 2024.7.4 pypi_0 pypi cffi 1.16.0 pypi_0 pypi charset-normalizer 3.3.2 pypi_0 pypi click 8.1.7 pypi_0 pypi coloredlogs 15.0.1 pypi_0 pypi contourpy 1.2.1 pypi_0 pypi crcmod 1.7 pypi_0 pypi cryptography 43.0.0 pypi_0 pypi ctranslate2 4.3.1 pypi_0 pypi cycler 0.12.1 pypi_0 pypi datasets 2.18.0 pypi_0 pypi decorator 5.1.1 pypi_0 pypi dill 0.3.8 pypi_0 pypi docker-pycreds 0.4.0 pypi_0 pypi editdistance 0.8.1 pypi_0 pypi einops 0.8.0 pypi_0 pypi einx 0.2.2 pypi_0 pypi exceptiongroup 1.2.2 pypi_0 pypi fastapi 0.112.0 pypi_0 pypi faster-whisper 1.0.3 pypi_0 pypi ffmpy 0.4.0 pypi_0 pypi filelock 3.15.4 pypi_0 pypi fish-speech 0.1.0 pypi_0 pypi flatbuffers 24.3.25 pypi_0 pypi fonttools 4.53.1 pypi_0 pypi frozendict 2.4.4 pypi_0 pypi frozenlist 1.4.1 pypi_0 pypi fsspec 2024.2.0 pypi_0 pypi funasr 1.1.4 pypi_0 pypi gitdb 4.0.11 pypi_0 pypi gitpython 3.1.43 pypi_0 pypi gradio 4.40.0 pypi_0 pypi gradio-client 1.2.0 pypi_0 pypi grpcio 1.65.4 pypi_0 pypi h11 0.14.0 pypi_0 pypi httpcore 1.0.5 pypi_0 pypi httpx 0.27.0 pypi_0 pypi huggingface-hub 0.24.5 pypi_0 pypi humanfriendly 10.0 pypi_0 pypi hydra-core 1.3.2 pypi_0 pypi idna 3.7 pypi_0 pypi importlib-resources 6.4.0 pypi_0 pypi jaconv 0.4.0 pypi_0 pypi jamo 0.4.1 pypi_0 pypi jieba 0.42.1 pypi_0 pypi jinja2 3.1.4 pypi_0 pypi jmespath 0.10.0 pypi_0 pypi joblib 1.4.2 pypi_0 pypi kaldiio 2.18.0 pypi_0 pypi kiwisolver 1.4.5 pypi_0 pypi kui 1.8.1 pypi_0 pypi lazy-loader 0.4 pypi_0 pypi ld_impl_linux-64 2.40 h12ee557_0
libffi 3.4.4 h6a678d5_1
libgcc-ng 11.2.0 h1234567_1
libgomp 11.2.0 h1234567_1
librosa 0.10.2.post1 pypi_0 pypi libstdcxx-ng 11.2.0 h1234567_1
libuuid 1.41.5 h5eee18b_0
lightning 2.4.0 pypi_0 pypi lightning-utilities 0.11.6 pypi_0 pypi llvmlite 0.43.0 pypi_0 pypi loguru 0.7.2 pypi_0 pypi loralib 0.1.2 pypi_0 pypi markdown 3.6 pypi_0 pypi markdown-it-py 3.0.0 pypi_0 pypi markupsafe 2.1.5 pypi_0 pypi matplotlib 3.9.1.post1 pypi_0 pypi mdurl 0.1.2 pypi_0 pypi modelscope 1.17.1 pypi_0 pypi mpmath 1.3.0 pypi_0 pypi msgpack 1.0.8 pypi_0 pypi multidict 6.0.5 pypi_0 pypi multiprocess 0.70.16 pypi_0 pypi natsort 8.4.0 pypi_0 pypi ncurses 6.4 h6a678d5_0
networkx 3.3 pypi_0 pypi numba 0.60.0 pypi_0 pypi numpy 1.26.4 pypi_0 pypi nvidia-cublas-cu12 12.1.3.1 pypi_0 pypi nvidia-cuda-cupti-cu12 12.1.105 pypi_0 pypi nvidia-cuda-nvrtc-cu12 12.1.105 pypi_0 pypi nvidia-cuda-runtime-cu12 12.1.105 pypi_0 pypi nvidia-cudnn-cu12 9.1.0.70 pypi_0 pypi nvidia-cufft-cu12 11.0.2.54 pypi_0 pypi nvidia-curand-cu12 10.3.2.106 pypi_0 pypi nvidia-cusolver-cu12 11.4.5.107 pypi_0 pypi nvidia-cusparse-cu12 12.1.0.106 pypi_0 pypi nvidia-nccl-cu12 2.20.5 pypi_0 pypi nvidia-nvjitlink-cu12 12.6.20 pypi_0 pypi nvidia-nvtx-cu12 12.1.105 pypi_0 pypi omegaconf 2.3.0 pypi_0 pypi onnxruntime 1.18.1 pypi_0 pypi opencc-python-reimplemented 0.1.7 pypi_0 pypi openssl 3.0.15 h5eee18b_0
orjson 3.10.7 pypi_0 pypi ormsgpack 1.5.0 pypi_0 pypi oss2 2.18.6 pypi_0 pypi packaging 24.1 pypi_0 pypi pandas 2.2.2 pypi_0 pypi pillow 10.4.0 pypi_0 pypi pip 24.2 py310h06a4308_0
platformdirs 4.2.2 pypi_0 pypi pooch 1.8.2 pypi_0 pypi protobuf 5.27.3 pypi_0 pypi psutil 6.0.0 pypi_0 pypi pyarrow 17.0.0 pypi_0 pypi pyarrow-hotfix 0.6 pypi_0 pypi pyaudio 0.2.14 pypi_0 pypi pycparser 2.22 pypi_0 pypi pycryptodome 3.20.0 pypi_0 pypi pydantic 2.8.2 pypi_0 pypi pydantic-core 2.20.1 pypi_0 pypi pydub 0.25.1 pypi_0 pypi pygments 2.18.0 pypi_0 pypi pynndescent 0.5.13 pypi_0 pypi pyparsing 3.1.2 pypi_0 pypi pyrootutils 1.0.4 pypi_0 pypi python 3.10.15 he870216_1
python-dateutil 2.9.0.post0 pypi_0 pypi python-dotenv 1.0.1 pypi_0 pypi python-multipart 0.0.9 pypi_0 pypi pytorch-lightning 2.4.0 pypi_0 pypi pytorch-wpe 0.0.1 pypi_0 pypi pytz 2024.1 pypi_0 pypi pyyaml 6.0.1 pypi_0 pypi readline 8.2 h5eee18b_0
regex 2024.7.24 pypi_0 pypi requests 2.32.3 pypi_0 pypi resampy 0.4.3 pypi_0 pypi rich 13.7.1 pypi_0 pypi ruff 0.6.1 pypi_0 pypi safetensors 0.4.4 pypi_0 pypi scikit-learn 1.5.1 pypi_0 pypi scipy 1.14.0 pypi_0 pypi semantic-version 2.10.0 pypi_0 pypi sentencepiece 0.2.0 pypi_0 pypi sentry-sdk 2.13.0 pypi_0 pypi setproctitle 1.3.3 pypi_0 pypi setuptools 75.1.0 py310h06a4308_0
shellingham 1.5.4 pypi_0 pypi silero-vad 5.1 pypi_0 pypi six 1.16.0 pypi_0 pypi smmap 5.0.1 pypi_0 pypi sniffio 1.3.1 pypi_0 pypi soundfile 0.12.1 pypi_0 pypi soxr 0.4.0 pypi_0 pypi sqlite 3.45.3 h5eee18b_0
starlette 0.37.2 pypi_0 pypi sympy 1.13.2 pypi_0 pypi tensorboard 2.17.1 pypi_0 pypi tensorboard-data-server 0.7.2 pypi_0 pypi tensorboardx 2.6.2.2 pypi_0 pypi threadpoolctl 3.5.0 pypi_0 pypi tk 8.6.14 h39e8969_0
tokenizers 0.19.1 pypi_0 pypi tomlkit 0.12.0 pypi_0 pypi torch 2.4.0 pypi_0 pypi torch-complex 0.4.4 pypi_0 pypi torchaudio 2.4.0 pypi_0 pypi torchmetrics 1.4.1 pypi_0 pypi torchvision 0.19.0 pypi_0 pypi tqdm 4.66.5 pypi_0 pypi transformers 4.44.2 pypi_0 pypi triton 3.0.0 pypi_0 pypi typer 0.12.4 pypi_0 pypi typing-extensions 4.12.2 pypi_0 pypi tzdata 2024.1 pypi_0 pypi umap-learn 0.5.6 pypi_0 pypi urllib3 2.2.2 pypi_0 pypi uvicorn 0.30.6 pypi_0 pypi vector-quantize-pytorch 1.15.3 pypi_0 pypi wandb 0.17.7 pypi_0 pypi websockets 12.0 pypi_0 pypi werkzeug 3.0.3 pypi_0 pypi wheel 0.44.0 py310h06a4308_0
xxhash 3.5.0 pypi_0 pypi xz 5.4.6 h5eee18b_1
yarl 1.9.4 pypi_0 pypi zlib 1.2.13 h5eee18b_1
zstandard 0.23.0 pypi_0 pypi

Steps to Reproduce

python -m tools.api --llama-checkpoint-path checkpoints/fish-agent-v0.1-3b/ --mode agent --compile

✔️ Expected Behavior

I followed the instructions in start_agent.md to start this agent and encountered an unexpected error.

❌ Actual Behavior

I followed the instructions in start_agent.md to start this agent and encountered an unexpected error.

ERROR: Traceback (most recent call last): File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/kui/asgi/lifespan.py", line 34, in call result = handler(app) File "/data/agent/fish-speech/tools/api.py", line 888, in initialize_app llama_queue, tokenizer, config = launch_thread_safe_queue_agent( File "/data/agent/fish-speech/tools/llama/generate.py", line 928, in launch_thread_safe_queue_agent tokenizer = AutoTokenizer.from_pretrained(checkpoint_path) File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, *kwargs) File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained return cls._from_pretrained( File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained tokenizer = cls(init_inputs, **init_kwargs) File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/models/qwen2/tokenization_qwen2_fast.py", line 120, in init super().init( File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in init fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file) Exception: data did not match any variant of untagged enum ModelWrapper at line 757479 column 3

ERROR: Application startup failed. Exiting.

Kingdroper commented 2 weeks ago

I tried loading the default llama-checkpoint (checkpoints/fish-speech-1.4) and it is fine. But the fish-agent checkpoint (checkpoints/fish-agent-v0.1-3b/) is not loading properly.

AnyaCoder commented 2 weeks ago

try redownloading?

Kingdroper commented 2 weeks ago

try redownloading?

Yes, I tried re-downloading it twice, but it didn't work. The download command is:HF_ENDPOINT=https://hf-mirror.com huggingface-cli download fishaudio/fish-agent-v0.1-3b --local-dir checkpoints/fish-agent-v0.1-3b

AnyaCoder commented 2 weeks ago

transformers 4.44.2 pypi_0 pypi

update it to transformers >= 4.45.2

Kingdroper commented 2 weeks ago

transformers 4.44.2 pypi_0 pypi

update it to transformers >= 4.45.2

OK it works! Thank you!

fishaudio / fish-speech