nlp-uoregon / mlmm-evaluation

Multilingual Large Language Models Evaluation Benchmark
Apache License 2.0
110 stars 18 forks source link

Please add support for Adapter Models #10

Open 1rsh opened 5 months ago

1rsh commented 5 months ago

The scripts look for config.json in the hf repo. But for models whch are finetuned / adapter models that file is adapter_config.json wherein I might also need to give the adapter weights as well

chiennv2000 commented 5 months ago

Thanks for your question. Currently, we do not support adapter directly. However, we recommend merging your adapter into the base model, so it will be compatible with our framework and it also can improve your inference time.