search

zama-ai / concrete-ml

Concrete ML: Privacy Preserving ML framework using Fully Homomorphic Encryption (FHE), built on top of Concrete, with bindings to traditional ML frameworks.
Other
913 stars 135 forks source link

GPU acceleration in concrete-ml ? #831

Closed S1eepeng closed 1 month ago

S1eepeng commented 1 month ago

Hello, to the best of our knowledge, concrete-ml currently doesn't support GPU acceleration in q_module.forward(). We found that most fhe-ml libraries doesn't support GPU yet. Could you explain what is the main difficulty in supporting GPU acceleration in fhe-ml?Or are there any fhe-ml libraries that supports GPU acceleration? Thank you a lot for your reply,we will greatly appreciate it!

bcm-at-zama commented 1 month ago

Hello. Concrete was delivered in Q2 with a support for GPU. Next quarter, Concrete ML will have this support. It's not a particular difficulty, it's just a matter of patience. Cheers

S1eepeng commented 1 month ago

Thanks for your reply,cheers!

bcm-at-zama commented 1 month ago

Stay tuned with our Zama releases! eg, in https://www.zama.ai/blog