MLX `local_web` failure

FL33TW00D commented 1 month ago

When attempting to use the MLX local_web server with the following:

~/Code/moshi-inference feature/simple* 15s ❯ PYTHONPATH=moshi_mlx python -m moshi_mlx.local_web  \                                                                                                                                                                                                                                                    
    --hf-repo kmhf/msh-v0.1 \
    --quantized 8

[Info] [SERVER] loading text tokenizer /Users/fleetwood/.cache/huggingface/hub/models--kmhf--msh-v0.1/snapshots/40f03604e663efba897d22492655239af48af3a2/tokenizer_spm_32k_3.model
[Info] [SERVER] loading weights /Users/fleetwood/.cache/huggingface/hub/models--kmhf--msh-v0.1/snapshots/40f03604e663efba897d22492655239af48af3a2/moshiko_mlx_301e30bf@120.q8.safetensors
[Info] [SERVER] weights loaded
[Info] [SERVER] model warmed up
[Info] [SERVER] connected!
[Info] [CLIENT] received 'start' from server, starting...
[Info] retrieving the static content
[Info] serving static content from /Users/fleetwood/.cache/huggingface/hub/models--kmhf--msh-v0.1/snapshots/40f03604e663efba897d22492655239af48af3a2/dist
[Info] listening to ws://localhost:8998
[Info] accepted connection

Navigating to: http://localhost:8998/ The audioDecoder fails with an OOB read: decoderWorker.min-DI6rkCrP.js:1 Uncaught (in promise) RangeError: Offset is outside the bounds of the DataView

Everything is functional minus the ability to hear Moshi.

adefossez commented 1 month ago

you should make sure to have sphn up to date, Laurent fixed a bug this weekend, maybe that?

FL33TW00D commented 1 month ago

Works with 0.1.4 my bad.

kyutai-labs / moshi

MLX `local_web` failure #33