From pretrained library

microsoft / mttl

Building modular LMs with parameter-efficient fine-tuning.

MIT License

73 stars 7 forks source link

Closed sordonia closed 2 months ago

sordonia commented 2 months ago

Adds MultiExpertModel.from_pretrained_library("....", selector_config=ArrowSelectorConfig())
Every selector (PG, Hidden, Arrow) can now load their own prototypes from the library automatically