-
Hi,
First of all, thank you for providing the swift example implementations, which helped me understand many components inside MLX. I am implementing an inference for a quantized Flan-T5 model and ca…
r4ghu updated
6 months ago
-
First off, thanks for building and maintaining this repo -- it's super exciting.
Second, I'm new to Swift, so this might just be a dumb mistake on my part. But upon installing `0.10.0` via Xcode, …
-
Hi!
I was wondering if you would be interested in adding `bf16` support to MFA or at least the GEMM kernels? For `mlx` Apple defined a custom type: https://github.com/ml-explore/mlx/blob/76c919b4ec…
-
I'm adding a repetitionPenalty to the GenerateParameters constructor. Regardless what values I set (I tried 0.5, 1, 1.2, 1.5), it crashes the program immediate as the evaluator runs. I was testing var…
-
In `Libraries/LLM/Load.swift`, the tokenizer is first loaded. As part of this process, `config.json` is downloaded if it hasn't been downloaded already. Then that same file is included in `modelFiles`…
-
Hi,
I am at a loss atm. I am getting this error when I try to build the app on my phone.
```
Failed to install the app on the device.
Domain: com.apple.dt.CoreDeviceError
Code: 3002
Failur…
h21k updated
7 months ago
-
Hi
I'm using swift-mlx to implement the Whisper model. The encoder runs on CoreML, and the decoder runs on MLX. Everything works fine for the `tiny`, `tiny.en`, `base` and `base.en`, `small.en` mod…
-
When i try and upload a build which uses the MLX library to TestFlight in Xcode i'm receiving the following error.
Invalid Bundle Identifier. The application bundle contains a tool or framework _N…
-
**Describe the bug**
From https://github.com/ml-explore/mlx-swift/issues/82 -- compiled code produces
```
ValueError: [eval] Attempting to eval an array without a primitive
```
**To Reprodu…
-
Consider allowing a function to have a custom VJP function attached to it.
awni updated
4 months ago