ValueError: Unable to create tensor, you should probably activate padding with 'padding=True' to have batched tensors with the same length

NVlabs / EAGLE

EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

https://arxiv.org/pdf/2408.15998

Apache License 2.0

541 stars 45 forks source link

ValueError: Unable to create tensor, you should probably activate padding with 'padding=True' to have batched tensors with the same length #11

Closed thebazshah closed 2 months ago

thebazshah commented 2 months ago

Hi, I am getting this issue. I am running it on following system. I followed the instructions given in README.

Ubuntu 24.04
Intel Core i7
16GB RAM
Anaconda
Pytorch CPU Only version (I don't have a Nvidia GPU)

Any idea about how to solve this issue?

Screenshot from 2024-09-08 07-58-00

flyinglynx commented 2 months ago

Sorry, we currently do not support CPU-based inference or training. I plan to explore additional optimizations and inference frameworks for LLMs when I have more time. Apologies for the inconvenience. Feel free to try our online demo.