search

jxmorris12 / vec2text

utilities for decoding deep representations (like sentence embeddings) back to text
Other
738 stars 85 forks source link

Apple Silicon support #72

Open sibeliu opened 5 days ago

sibeliu commented 5 days ago

Thanks Jack for your very interesting project. I see that MPS support is implemented in the code, but I'm not seeing it used on my machine. On my machine, torch.backends.mps.is_available() shows true, but vec2text.invert_embeddings is running on just one core. Any suggestions? Thanks!

jxmorris12 commented 5 days ago

Hi @sibeliu - do you want to do training or inference?

We don't support either now but inference could realistically be added.

sibeliu commented 4 days ago

At the moment just inference. I took a further look at the code--might just be a few added .to(device) ?

jxmorris12 commented 4 days ago

@sibeliu that sounds right to me. Feel free to give it a shot and open a pull request!