search

OpenGVLab / LAMM

[NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
https://openlamm.github.io/
296 stars 16 forks source link

Enable batch inference in some datasets #27

Closed lighten001 closed 1 year ago

lighten001 commented 1 year ago

now there are some dataset which can only use single inference, such as:

single_infernce_dataset = [
    'FSC147','SQAimage','AI2D'
]

maybe it's possible to enable batch for some of them

Coach257 commented 1 year ago

Thank you for your issue and your interest in our work. We appreciate your feedback and agree that there is room for optimization in our code. However, we would like to let you know that we have identified bugs in the datasets (FSC147, SQAimage, AI2D) you mentioned during batch inference testing. We will work on fixing this issue in the near future.