-
### New Packages
https://github.com/ml-explore/mlx-swift.git
-
### New Packages
https://github.com/ml-explore/mlx-swift/.git
-
I tried to follow the documentation for advanced indexing to implement top_p as shown in https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/sample_utils.py#L21-L25 in Python.
After fo…
mzbac updated
7 months ago
-
I tested both `mlx-swift` and `mlx-lm`, and it seems there is a problem with memory allocation when processing longer prompts.
I have used this snippet to run the LLM.
```python
from mlx_lm …
-
### System Information:
Model loaded: quantized Gemma 2b
### Error Message
`EXC_BAD_ACCESS (code=1, address=0x8)`
Clicking the generate button would result in crash occasionally with the f…
-
This is possibly a dumb question (since I believe the explicit/expressed goal here is to target various Apple/ARM hardware) but would `mlx-swift` work for Linux Swift users? And if not are the blocker…
-
Snippet to reproduce:
```
let src = MLX.full([1,2,3], values: MLXArray(100))
let url = URL.temporaryDirectory.appending(path: "xxx.npy")
try MLX.save(array: src, url: url)
let dest = …
-
Maybe I missed something, but I am currently working on a swift mlx server implementation following the examples at https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/LLM/Tokenizer.s…
mzbac updated
8 months ago
-
After following the steps for building with `CMake` in https://github.com/ml-explore/mlx-swift#cmake, the `ninja` command fails to run with the output:
```sh
$ ninja
[1/8] Linking Swift static li…
-