Extract ScatterMoE TriTon Kernels from Kernel Hyperdrive Fork

foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

Apache License 2.0

6 stars 12 forks source link

Extract ScatterMoE TriTon Kernels from Kernel Hyperdrive Fork #105

Open fabianlim opened 3 weeks ago

fabianlim commented 3 weeks ago

In #99, we install the fork of kernel hyperdrive as a dependency. The probelm is that this fork is not releasd on PyPI, so the installation has to be manual.

since it is a fork, it may not make sense to release it on PyPI since we are not the real maintainers.

The other option, is to deprecate the fork, and just copy the kernels into the repository.