[BUG] Generating text is timing out

mlfoundations / open_flamingo

An open-source framework for training large multimodal models.

MIT License

3.74k stars 284 forks source link

[BUG] Generating text is timing out #263

Open sejalgupta opened 1 year ago

sejalgupta commented 1 year ago

I am trying to run the Generating Text from the README.md. However, every time I run the command below it never finishes running and I have to manually stop it. I have waited like 5-10 minutes each time.

generated_text = model.generate(
        vision_x=vision_x,
        lang_x=lang_x["input_ids"],
        attention_mask=lang_x["attention_mask"],
        max_new_tokens=20,
        num_beams=3,
    )

anas-awadalla commented 1 year ago

Please follow the format for bug reports so we can reproduce the issue. For instance it would be very useful to know which model you are running and where you are running it (are you using a GPU etc.).