Open haitian-jiang opened 1 year ago
How did you set to run the ogbn-papers100M with SANCUS? I've tried shortened hidden dimension and half precision on A100 GPUs but it still goes out of GPU memory.
How did you set to run the ogbn-papers100M with SANCUS? I've tried shortened hidden dimension and half precision on A100 GPUs but it still goes out of GPU memory.