GoogleCloudPlatform / ml-design-patterns

Source code accompanying O'Reilly book: Machine Learning Design Patterns
Apache License 2.0
1.87k stars 527 forks source link

Chapter 6: Storm Reports #17

Open mshearer0 opened 3 years ago

mshearer0 commented 3 years ago

With tfx==0.24 had to substitute:

from tfx.extensions.google_cloud_big_query.example_gen.component import BigQueryExampleGen

Also transform step fails with kernel restart, see: https://github.com/tensorflow/tfx/issues/2598

mshearer0 commented 3 years ago

tfx 0.24.1 seems to fix kernel restart but transform steps fails with 'StopIteration'. See https://github.com/tensorflow/tfx/issues/2668

mshearer0 commented 3 years ago

See https://github.com/tensorflow/tfx/issues/2668#issuecomment-712662548 to resolve StopIteration issue

mshearer0 commented 3 years ago

Had to use google-cloud-bigquery-storage==1.0.0 google-cloud-bigquery==1.26.1 to avoid TypeError: to_pandas() got an unexpected keyword argument 'timestamp_as_object', see: https://github.com/GoogleCloudPlatform/python-docs-samples/issues/4573