search

mberneaud / us-weather-alerts

Le Wagon Data Engineering bootcamp final project
2 stars 1 forks source link

Upload From GCS to Bigquery #18

Open MouadRS opened 5 months ago

MouadRS commented 5 months ago

Two functions have been created:

gcs_recent_file: This function retrieves the name of the most recently pushed file to a specified Google Cloud Storage (GCS) bucket.

load_to_bigquery: This function loads a specified file into a BigQuery table.

To combine these functions and transfer the most recent file available in the bucket to BigQuery, we will use the function transfer_recent_file_to_bigquery