issues
search
TorchMoE
/
MoE-Infinity
PyTorch library for cost-effective, fast and easy serving of MoE models.
Apache License 2.0
107
stars
8
forks
source link
TODO for first release
#1
Open
drunkcoding
opened
10 months ago
drunkcoding
commented
10 months ago
[x] API design
[x] Document for installation and PyPI
[x] performance table
[x] Support Mixtral multi-GPU
[ ] Load trace