Open kyleliang919 opened 1 month ago
Have you checked the AVAILABLE_MODELS dict in lmms_eval/models/init.py?
yes, llava_hf is listed in the init.py. I didn't modify that part of code.
You might want to print out the error when trying to import llava_hf. It is likely an ImportError. I can't reproduce this error using the main branch.
Perhaps this is due to a package import error, such as the Transformers version not matching, causing the lava_hf.py not to be properly parsed. this works for me
When running with
--model llava_hf
, doesn't seem to be properly registered and recognized as a model typeMy llms_eval version is as follows: