register fused rmsnorm as pytorch custom op - Githubissues

pytorch / torchtitan

A native PyTorch Library for large model training

BSD 3-Clause "New" or "Revised" License

1.29k stars 115 forks source link

register fused rmsnorm as pytorch custom op #296

Open tianyu-l opened 2 months ago

tianyu-l commented 2 months ago

Stack from ghstack (oldest at bottom):

-> #296