Was trying to work on #412, but ended up side-tracked by this. The most problematic thing is the Arc non-Send/Sync lint; I went back and forth on this, but I was able to mostly convince myself that our current use is OK because we offer abstractions with different sync guarantees.
Still not 100% convinced though, I feel like our GGML bindings need a rethink to better fit Rust safety guarantees 😅
Was trying to work on #412, but ended up side-tracked by this. The most problematic thing is the
Arcnon-Send/Synclint; I went back and forth on this, but I was able to mostly convince myself that our current use is OK because we offer abstractions with different sync guarantees.Still not 100% convinced though, I feel like our GGML bindings need a rethink to better fit Rust safety guarantees 😅