sayef / fsner

Few-shot Named Entity Recognition
119 stars 6 forks source link

KeyError : Sizes #4

Closed samuelzxu closed 2 years ago

samuelzxu commented 2 years ago

I am attempting to test out your module, but the model can't find the sizes entry in the tokens dict. Indeed, I am giving the tokenizer a list of lists (verified with all([isinstance(s,list) for s in supports])) but it still cannot find the key 'sizes'. Could you run with the latest version of torch and transformers to see if there are any errors that arise?

sayef commented 2 years ago

Hi sorry that I was not notified by GitHub. Why is the issue closed? Did tou solve it?

samuelzxu commented 2 years ago

Hi! Yes, it was a problem on my end. However, there is another actual bug when I try to use only one query for one array of supports - there is an index error. I'm not currently using the library anymore, though I may try again in the near future. I'll open another issue in that case.