GoogleCloudPlatform / vertex-pipelines-end-to-end-samples

Apache License 2.0
218 stars 85 forks source link

refactor: remove redundant get_current_time component #34

Closed ghost closed 1 year ago

ghost commented 1 year ago

Description

Simplifies the ML pipelines by removing the get_current_time component and replacing its logic with SQL. The component takes an input timestamp - if it is an empty string (or None), it returns the current time, otherwise it returns the input timestamp as-is. This PR:

How has this been tested?

Successful pipeline runs with both a timestamp and an empty string as input

Tests running successfully in the Datatonic repo here

Checklist

ghost commented 1 year ago

thanks @felix-datatonic !

@Linchin this is ready to merge :)