search

mberneaud / us-weather-alerts

Le Wagon Data Engineering bootcamp final project
2 stars 1 forks source link

Transfer to bigquey #27

Closed MouadRS closed 5 months ago

MouadRS commented 5 months ago

Two functions have been created:

gcs_recent_file: This function retrieves the name of the most recently pushed file to a specified Google Cloud Storage (GCS) bucket.

load_to_bigquery: This function loads a specified file into a BigQuery table.

To combine these functions and transfer the most recent file available in the bucket to BigQuery, we will use the function transfer_recent_file_to_bigquery

mberneaud commented 5 months ago

This has been superseded by #29