Suggestion: add support for multiple types of models

r-three / phatgoose

Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"

https://arxiv.org/abs/2402.05859

MIT License

68 stars 3 forks source link

Open DataCTE opened 5 months ago

jaxball commented 2 months ago

I believe there is support. You can also customize them in architecture_specific.py