kyutai-labs / moshi

Apache License 2.0
6.37k stars 481 forks source link

moshi listens only for ~15 seconds then quits, does not talk. Installed via Pinokio on Macbook Air M2. #141

Open improvethings opened 3 hours ago

improvethings commented 3 hours ago

Backend impacted

The MLX implementation

Operating system

Mac OS X

Hardware

CPU

Description

Installed on a Macbook Air m2 via Pinokio. When I run moshi in pinokio, Firefox, or Chrome, it starts and listens to me for about 15 seconds until it closes the connection, and no text appears in the bottom right text box, and nothing is heard during that time. I've attached a few relevant screenshots:

Extra information

Screenshot 2024-10-18 at 12 30 12 AM Screenshot 2024-10-18 at 12 27 47 AM Screenshot 2024-10-18 at 12 27 17 AM

Environment

Fill in the following information on your system.

If the backend impacted is PyTorch:

If the backend is MLX:

LaurentMazare commented 3 hours ago

How much memory does your Mac have? You seem to be using the bf16 version of the weights for which you would probably need 24GB of memory, if you have less than that you may want to try the quantized versions.