Open mingtouyizu opened 2 months ago
The issue is as follows:Lack of Q-former , llm-project and vision-projection weights:
Could you plrease provide a configuration file for the model evaluation and the related code? I have found builders such as flickr, textvqa, nocaps, as well as the corresponding evaluation code. Although I have tried to write the evaluation code like LAVIS, it doesn't work.Thanks.
NotImplemented def evaluation(self, model, data_loader, cuda_enabled=True): pass
Sorry we didn't not incorporate the evaluation code into our codebase, it's a bit messy to put in here, and all the evaluation code is under the LAVIS repo.
Thank you, I have found the corresponding test code in the LAVIS repository and evaluated on NoCaps and Flickr30k, but the results are not ideal.
Could you plrease provide a configuration file for the model evaluation and the related code? I have found builders such as flickr, textvqa, nocaps, as well as the corresponding evaluation code. Although I have tried to write the evaluation code like LAVIS, it doesn't work.Thanks.