runtime error: cannot fit 'int' into an index-sized integer

[yuedajiong]

File "/opt/anaconda3/envs/v3d/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 3682, in _pad encoded_inputs["attention_mask"] = encoded_inputs["attention_mask"] + [0] * difference OverflowError: cannot fit 'int' into an index-sized integer

[lizhiqi49]

Where does this error occur? Could you please provide me the complete error message?

[yuedajiong]

pipeline_mvcontrol.py #Line: 247 print('jjjjjjjjjjjjjjjjjj', prompt, self.tokenizer.model_max_length)

not 77, but long.max: 1000000000000000019884624838656

bypass: if isinstance(self, TextualInversionLoaderMixin): prompt = self.maybe_convert_prompt(prompt, self.tokenizer) print('$$$$$$$$$$$$$$$$$$$$$$$$$$$', prompt, self.tokenizer.model_max_length) #Here self.tokenizer.model_max_length = 77 #Here text_inputs = self.tokenizer(