TypeError: argument 'ids': 'NoneType' object cannot be converted to 'Sequence'

[Maryam142]

I face this error whenever I trying to evaluate a model with a benchmark type generation or (Open Question) like triviaqa, nq_open and truthfulqa

Is there anyone face this problem ?

[haileyschoelkopf]

Without more information we can't help you solve this issue.

What command are you running when you receive this error? What model type and specific model are being used for evaluation? What are any other relevant system details?

[Maryam142]

I tried this command in the picture to evaluate model: huawei-noah/TinyBERT_General_4L_312D also I tried it with model: Intel/dynamic_tinybert and I tried it with these tasks: triviaqa, nq_open and truthfulqa

in every time I got this error

[ahagyue]

Is there any update?