search

paperswithcode / galai

Model API for GALACTICA
Apache License 2.0
2.67k stars 275 forks source link

Anyone know the easiest way to run Galactica? #80

Open d3netxer opened 1 year ago

d3netxer commented 1 year ago

Either locally or using a cloud-based service. I want to demo it using the least amount of effort possible : )

shahab00x commented 1 year ago

I used oobabooga text generation UI to run the 1.3b model. I selected transformers from the drop-down and it works fine. I'm sure you can run the bigger models too if you have enough VRAM