transformerlab / transformerlab-app

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
https://transformerlab.ai/
GNU Affero General Public License v3.0
299 stars 14 forks source link

Check for supported file formats when displaying available inference engines #106

Open dadmobile opened 3 months ago

dadmobile commented 3 months ago

Specifically MLX only supports some weight file formats (safetensors and nfz I think?). We currently only check architecture which means you sometimes get a "No safetensors for..." error when trying to run a model with MLX.

There are several possible ways to address: