search

gretelai / gretel-synthetics

Synthetic data generators for structured and unstructured text, featuring differentially private learning.
https://gretel.ai/platform/synthetics
Other
579 stars 87 forks source link

[BUG] `gast` minimum version incompatible with TensorFlow 2.4.x default #70

Closed zredlined closed 3 years ago

zredlined commented 3 years ago

Are you reporting a bug or FR?

What version of synthetics are you using? 0.15.0

What would you like to see / What problem are you having? Gretel-synthetics defines a gast verison of gast==0.4.0, which is ahead of gast==0.3.3 that is currently pinned to the TensorFlow 2.4.x release. This results in the following warnings while running training in differentially private mode.

Epoch 1/100

WARNING:tensorflow:Converting IndexedSlices(indices=Tensor("gradient_tape/sequential/embedding/embedding_lookup/Reshape_1:0", shape=(1600,), dtype=int32), values=Tensor("gradient_tape/sequential/embedding/embedding_lookup/Reshape:0", shape=(1600, 256), dtype=float32), dense_shape=Tensor("gradient_tape/sequential/embedding/embedding_lookup/VariableShape:0", shape=(2,), dtype=int32)) to a dense representation may make it slow. Alternatively, output the indices and values of the IndexedSlices separately, and handle the vectorized outputs directly.
2020-11-18 22:10:05,297 : MainThread : WARNING : Converting IndexedSlices(indices=Tensor("gradient_tape/sequential/embedding/embedding_lookup/Reshape_1:0", shape=(1600,), dtype=int32), values=Tensor("gradient_tape/sequential/embedding/embedding_lookup/Reshape:0", shape=(1600, 256), dtype=float32), dense_shape=Tensor("gradient_tape/sequential/embedding/embedding_lookup/VariableShape:0", shape=(2,), dtype=int32)) to a dense representation may make it slow. Alternatively, output the indices and values of the IndexedSlices separately, and handle the vectorized outputs directly.
WARNING:tensorflow:AutoGraph could not transform <function WhileV2.__call__.<locals>.while_fn at 0x7fe4a013a6a8> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: module 'gast' has no attribute 'Index'

Gast is not called explicitly by gretel-synthetics, and removing the dependency fixes the warning.

Configuration Params

Running the default diff_privacy.ipynb example notebook

Are you using GPU or a CPU?

GPU

What environment are you working in?

Colab

What version of python are you using?

3.75

Describe the shape / types of the data you are training on Provided sample data (netflix)

Please provide any tracebacks or error messages you are receiving Above