IBM / tensorflow-large-model-support

Large Model Support in Tensorflow
Apache License 2.0
202 stars 38 forks source link

Update to new implemenation for TensorFlow 2 #23

Closed smatzek closed 4 years ago

smatzek commented 4 years ago

TensorFlow 2's default eager execution mode does not have a whole static graph view that is necessary for the standalone tensorflow-large-model-support's static graph modification strategy.

A non-graph based implementation of large model support is necessary to support eager execution.

A new implementation of TensorFlow Large Model Support has been written which is compiled into TensorFlow. It provides similar tensor swapping capability and has easier usage than the separate graph-base module.