Adds info container as forward context

microsoft / mttl

Building modular LMs with parameter-efficient fine-tuning.

MIT License

73 stars 7 forks source link

Closed sordonia closed 1 month ago

sordonia commented 1 month ago

adds info container as forward context in ExpertModel
changes expert containers to using getitem and setitem to get / set experts
some refactoring about Mixin inheritance
handles bug with expert merging in container