-
**Describe the bug**
matmul behavior change between GPU and CPU as seen in https://github.com/ml-explore/mlx-swift/issues/94
**To Reproduce**
Include code snippet
```python
import mlx.core …
-
Hi, so I've been trying to convert the Gemma model to mlx and can't understand why the model sizes decrease more than expected (which I believe is the source of the error below when running in Xcode).…
-
I know there is an issue with async generation but the sync version is also now crashing in debug. This is with the current state of the repo, and no command-line args (so all defaults). Get's a `EXC_…
rudro updated
7 months ago
-
Steps to reproduce:
1. Move LLMTool.swift `@main` annotation from `SyncGenerator` to `AsyncGenerator`.
2. Run llm-tool target.
Result: `Thread 4: EXC_BAD_ACCESS (code=2, address=0x16ff1bfe0)`
…
-
Has anyone else got this error:
`Package.resolved file is corrupted or malformed; fix or delete the file to continue`
Had to remove this file to get the project to build the dependencies:
`rm…
-
When trying to load Qwen1.5, the model downloads fully but doesn't appear to load in to memory on MacOS or iOS. After typing a prompt, the error output is "Failed: unhandledKeys(base: "Embedding", key…
-
Is the word `whisperkit-cli` missing from the README?
```
swift run whisperkit-cli transcribe --model-path "Models/whisperkit-coreml/openai_whisper-large-v3" --audio-path ~/.cache/whisper/alice.mp…
-
impossible to run the iOS version I get :
import MLX - No such module 'MLX'
-
**Describe the bug**
mlx fails to update a slice of an array, equivalent in numpy works
(surfaced in mlx-swift, checked with python/numpy as per below)
suspected bug in mlx::core
Edit: perhaps …
-
I want to implement the function of switching models, but after switching the model, the memory is not released, and the memory accumulates. May I ask if there is any way to free memory?