replit / ReplitLM

Inference code and configs for the ReplitLM model family
https://huggingface.co/replit
Apache License 2.0
918 stars 75 forks source link

Does ReplitLM support gradient checkpoints? #32

Open sxthunder opened 11 months ago

sxthunder commented 11 months ago

Does ReplitLM support gradient checkpoints?

madhavatreplit commented 9 months ago

Yes, gradient checkpointing should work out of the box.