search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

Failed to send message - Error in iterating prediction stream: TypeError: bfloat16 arrays cannot be converted directly to NumPy. #147

Closed HenkPoley closed 1 month ago

HenkPoley commented 1 month ago

When using mlx-community/Llama-3.2-1B-Instruct-bf16 LM Studio 0.3.4 gives me this error at the end 🤔 (MacBook M1).

Failed to send message Error in iterating prediction stream: TypeError: bfloat16 arrays cannot be converted directly to NumPy.

It otherwise just works.

cristian-rivera commented 1 month ago

++

yagil commented 1 month ago

This should be fixed with 0.3.4 build 5, available here https://lmstudio.ai/download

HenkPoley commented 1 month ago

No more error in LM Studio 0.3.4 build 5.