issues
search
TorchMoE
/
MoE-Infinity
PyTorch library for cost-effective, fast and easy serving of MoE models.
Apache License 2.0
99
stars
7
forks
source link
TODO for first release
#1
Open
drunkcoding
opened
8 months ago
drunkcoding
commented
8 months ago
[x] API design
[x] Document for installation and PyPI
[x] performance table
[x] Support Mixtral multi-GPU
[ ] Load trace