search

huggingface / candle

Minimalist ML framework for Rust
Apache License 2.0
15.79k stars 949 forks source link

Memory64 Support #1034

Open limcheekin opened 1 year ago

limcheekin commented 1 year ago

Hi there,

Do you guys have any plan for getting around that 4GB memory limit by supporting memory64?

Please see the following implementation status of the WebAssembly runtimes: https://github.com/WebAssembly/memory64/blob/main/proposals/memory64/Overview.md

image

Hope to hear from you.

Thank you.

LaurentMazare commented 1 year ago

I would have hoped for memory64 and wasm64 to be something a bit independent of candle and that will be a change on the rust toolchain side that we would just benefit from, but maybe that's not the case and it introduces specific apis that we should use? Good if you can give us some pointers for this if that's the case.

limcheekin commented 1 year ago

I wish I have the expertise and capable enough to give you some pointers. I considered myself is a Rust beginner and an user of WASM modules. So far you guys did a great job to deliver the features and code examples of candle, everyone here should be appreciated. Keep up the great works!

By the way, I try to find out what could we expect on memory64 support, I think it will not happen in months, but years, right? Even so, we can build some usable apps to fit around the 4G memory constraint.

Hope to hear from you soon :)