google / trax

Trax — Deep Learning with Clear Code and Speed
Apache License 2.0
8.01k stars 813 forks source link

[JAX] Replace uses of jax.devices("cpu") with jax.local_devices(backend="cpu"). #1791

Closed copybara-service[bot] closed 7 months ago

copybara-service[bot] commented 7 months ago

[JAX] Replace uses of jax.devices("cpu") with jax.local_devices(backend="cpu").

An upcoming change to JAX will include non-local (addressable) CPU devices in jax.devices() when JAX is used multicontroller-style, where there are multiple Python processes.

This change preserves the current behavior by replacing uses of jax.devices("cpu"), which previously only returned local devices, with jax.local_devices("cpu"), which will return local devices both now and in the future.

This change is always be safe (i.e., it should always preserve the previous behavior) but it may sometimes be unnecessary if code is never used in a multicontroller setting.