search

tensorflow / community

Stores documents used by the TensorFlow developer community
Apache License 2.0
1.26k stars 576 forks source link

RFC: API to synchronize devices #434

Open reedwm opened 1 year ago

reedwm commented 1 year ago
Status Proposed
RFC # 434
Author(s) Reed Wanderman-Milne (reedwm@google.com), Jonathan Dekhtiar (jdekhtiar@nvidia.com)
Sponsor Rohan Jain (rohanj@google.com)
Updated 2022-10-25

Objective

This document proposes a simple API to synchronize TensorFlow devices: tf.test.sync_devices(). This is important in accurately measuring execution time in TensorFlow GPU benchmarks, especially in microbenchmarks.

/CC @DEKHTIARJonathan @rohan100jain

penpornk commented 1 year ago

cc: @Jianhui-Li, @jzhoulon, @yiqianglee, @kulinseth, @wchao1115, and @PatriceVignola for PluggableDevices.

sun51 commented 1 year ago

LGTM, thanks

DEKHTIARJonathan commented 1 year ago

@reedwm can you please link the commit that adds the feature or the PR/CL here ?

Thanks