search

foundation-model-stack / fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
Apache License 2.0
6 stars 12 forks source link

Create fused_CEloss.py #80

Closed wynterl closed 1 month ago

wynterl commented 2 months ago

Create fused CE Loss from Liger kernels available at https://github.com/linkedin/Liger-Kernel/blob/main/src/liger_kernel/ops/fused_linear_cross_entropy.py

fabianlim commented 1 month ago

superceeded by #93