openxla / xla

A machine learning compiler for GPUs, CPUs, and ML accelerators
Apache License 2.0
2.75k stars 440 forks source link

Change the default partitioning method for gather and scatter to kExplicitBatch. #19809

Open copybara-service[bot] opened 6 days ago

copybara-service[bot] commented 6 days ago

Change the default partitioning method for gather and scatter to kExplicitBatch.

The default method is preferred and always has zero cost. We move BatchedGatherScatterNormalizer after partitioner, we will encounter more cases with explicit batch dims, compared with the implicit batch dims.