Changes the torch.compile strategy to only apply to individual Linear modules.
This is not for land, just creating to help with reproducing an issue with torch.compile.
Test Plan:
// run debug model
with-proxy CONFIG_FILE="./train_configs/debug_model.toml" ./run_llama_train.sh --training.compile --activation_checkpoint.mode none
// will see this error
// https://gist.github.com/vkuzo/2caa399a3ef7df2a79b9c1788c27ac7b
Summary:
Changes the torch.compile strategy to only apply to individual
Linearmodules.This is not for land, just creating to help with reproducing an issue with torch.compile.
Test Plan:
Reviewers:
Subscribers:
Tasks:
Tags: