In-place argument updates with device affinities fails - Githubissues

iree-org / iree

A retargetable MLIR-based machine learning compiler and runtime toolkit.

http://iree.dev/

Apache License 2.0

2.79k stars 604 forks source link

In-place argument updates with device affinities fails #18802

Open sogartar opened 1 week ago

sogartar commented 1 week ago

What happened?

This program in-place-sharded-tensor.zip fails to do a proper in-place update.

The program is equivalent to

arg0 += 1
arg1 += 1

What I observe is that the 2 tensor arguments don't change. It is exported from the test ShardedTensorTest.testInPlaceUpdate from this PR.

Steps to reproduce your issue

Extract the archive and run compile.sh
You can't verify the result with iree-run-module as it does not support validating the arguments post execution. You can use the test from the referenced PR for that.

What component(s) does this issue relate to?

Compiler

Version information

You may need this patch. I was using it when testing.

Additional context

No response

sogartar commented 5 days ago

I found one of the problems #18870. It is in the Python bindings.