search

paperswithcode / galai

Model API for GALACTICA
Apache License 2.0
2.67k stars 275 forks source link

Galai library doesn't seem to work #55

Closed saptarshi059 closed 1 year ago

saptarshi059 commented 1 year ago

Hi,

I'm trying to use the galai quickstart prompt. This is what I'm running: 

import galai as gal

model = gal.load_model("standard")
model.generate("Scaled dot product attention:\n\n\\[")
# Scaled dot product attention:\n\n\\[ \\displaystyle\\text{Attention}(Q,K,V)=\\text{softmax}(\\frac{QK^{T}}{\\sqrt{d_{k}}}%\n)V \\]

However, I'm getting TypeError: 'type' object is not subscriptable

mkardas commented 1 year ago

Hi @saptarshi059, I cannot reproduce this. Can you try with galai==1.1.1? If it's still broken can you paste in the full stack trace?

mkardas commented 1 year ago

Based on the stack trace from #59 the issue should be fixed with galai==1.1.2. It didn't fail for me as I was testing it on python 3.9.

saptarshi059 commented 1 year ago

@mkardas Thank you for the solution from #59 ... I upgraded accelerate and it now works!