google-research / big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
Apache License 2.0
2.2k stars 147 forks source link

Could you please give me an instruction on how to use paligemma's evaluator? #123

Open handsomelys opened 2 months ago

handsomelys commented 2 months ago

I want to evaluate paligemma's instance segmentation capabilities, but I don't understand how to organize the test data. I found that the tool https://github.com/googleresearch/big_vision/blob/main/big_vision/evaluators/proj/paligemma/transfers/segmentation.py is available in the repository, but I don’t know how to use it. Could you please generously provide a tutorial on using this tool?