search

pytorch / torchtitan

A native PyTorch Library for large model training
BSD 3-Clause "New" or "Revised" License
2.29k stars 170 forks source link

freezeing some part of the model #306

Open tianyu-l opened 5 months ago

tianyu-l commented 5 months ago

this could be easily done with lazy init