rese1f / MovieChat

[CVPR 2024] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
https://rese1f.github.io/MovieChat/
BSD 3-Clause "New" or "Revised" License
534 stars 41 forks source link

Can not run local demo #9

Closed yuzhms closed 1 year ago

yuzhms commented 1 year ago

Dear author,

I encounter the following errors when running the local gradio demo:

IndexError: index 64 is out of bounds for dimension 0 with size 64

Any hints?

Thanks

Espere-1119-Song commented 1 year ago

64 is the length of long memory, and index64 indicates that it is out of bounds when reading position embedding. Long memory needs to be cleared after reading a video and questioning, so it seems like you upload a new video directly without re-running the code after uploading a new video.

yuzhms commented 1 year ago

You mean that I need to relaunch the demo for each new video?

Espere-1119-Song commented 1 year ago

Currently, it is needed to relaunch. We will update the code to solve this problem in the future.

yuzhms commented 1 year ago

Thanks. It works.