search

KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.51k stars 758 forks source link

Fix: TPU driver error #306

Closed Zurnaz closed 1 year ago

Zurnaz commented 1 year ago

to_dlpack/from_dlpack was causing issues with tensor with new jax version

arcticlinux commented 1 year ago

Nice, I made a fix that definitely didn't fix the things you did here, but I found the main hurdle I was having was just getting a connection with jax/jaxlib and google's driver for the tpu.