feat(compiler): implement last-seen heuristic for resharding source

alpa-projects / alpa

Training and serving large-scale neural networks with auto parallelization.

https://alpa.ai

Apache License 2.0

3.08k stars 360 forks source link

Open jon-chuang opened 1 year ago

jon-chuang commented 1 year ago

Not sure of lifetime of the src array, for instance, if it is donated.

I can't run any tests locally as I have no CUDA device.