TencentARC / SEED-Story

SEED-Story: Multimodal Long Story Generation with Large Language Model
https://arxiv.org/abs/2407.08683
Other
692 stars 54 forks source link

eoi_token issue #19

Open SidharthTecnicasReunidas opened 1 month ago

SidharthTecnicasReunidas commented 1 month ago

I'm facing issue on ValueError: EOI_TOKEN not found in input_ids. how to solve this issue??

AndysonYs commented 1 month ago

When did you meet this issue? I think it is about the dataloader. For example, you give an image input but you do not build an "..." sequence in the input_ids.

CJ416 commented 1 week ago

When did you meet this issue? I think it is about the dataloader. For example, you give an image input but you do not build an "..." sequence in the input_ids.

hi, I have the same issue. image Though prompt indeed has EOI , and its id is 1533, however, there does not exist in the input_ids. You can run the command: python3 /src/data/gen_george.py to have a look