mberneaud us-weather-alerts issues

mberneaud / us-weather-alerts

Le Wagon Data Engineering bootcamp final project

2 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Dbt update gold

#42 janinewin closed 3 months ago
0
add dbt tasks to dag & add gold source

#41 MouadRS closed 3 months ago
0
Dbt dag tasks

#40 MouadRS closed 3 months ago
0
Update dbt silver

#39 janinewin closed 3 months ago
0
Update dbt silver

#38 janinewin closed 3 months ago
0
update schema

#37 MouadRS closed 3 months ago
0
Upload dbt seeds

#36 janinewin closed 3 months ago
0
Upload zone county seeds

#35 janinewin closed 3 months ago
0
update schema

#34 MouadRS closed 3 months ago
0
Dbt model silver and gold

#33 janinewin closed 3 months ago
0
Create presentation for Demo Day

#32 mberneaud opened 3 months ago
0
Revisions to Looker Studio dashboard

#31 mberneaud opened 3 months ago
0
Deployment using Cloud Run

#30 MouadRS opened 3 months ago
0
Add new Airflow Dag

#29 MouadRS closed 3 months ago
0
Airflow Tasks ( Load alerts table - bronze dataset)

#28 MouadRS closed 3 months ago
0
Transfer to bigquey

#27 MouadRS closed 3 months ago
1
revised scraper to only scrape land alerts and to use SAME as the geocode instead of UGC#

#26 mberneaud closed 3 months ago
2
looker exploration

#25 MouadRS opened 3 months ago
1
Use DBT seed Folder for counties file

#24 MouadRS closed 3 months ago
0
Revise scraper code to only query region_type = land

#23 mberneaud opened 3 months ago
0
Create a DBT model that merges Centroids from Zone-county Correlation File and the alerts. ( Gold Layer)

#22 mberneaud opened 3 months ago
1
Create table for the shapefile lookup file. ( BQ - once shot)

#21 mberneaud opened 3 months ago
2
Brainstorming Entities Diagram

#20 MouadRS closed 3 months ago
0
Create DBT Models ( Silver Layer)

#19 MouadRS opened 3 months ago
2
Upload From GCS to Bigquery

#18 MouadRS opened 3 months ago
0
create new bucket ( us_weather_alerts)

#17 MouadRS closed 3 months ago
3
Upload to GCS

#16 MouadRS closed 3 months ago
0
Migrate landing zone layer to GCS

#15 MouadRS closed 3 months ago
0
Store polygon_coordinates

#14 MouadRS opened 4 months ago
0
Metabase (POC)

#13 MouadRS closed 3 months ago
1
Local setup

#12 MouadRS closed 3 months ago
2
20240319 mberneaud initial api scrape

#11 mberneaud closed 4 months ago
0
Create schemas for bronze layer tables

#10 mberneaud opened 4 months ago
0
Airflow initial setup

#9 mberneaud closed 3 months ago
0
dbt initial setup

#8 mberneaud closed 3 months ago
0
Set up Metabase deployment on GCP

#7 mberneaud closed 3 months ago
0
Create Python functions to scrape API and transfer data to data lake bronze layer.

#6 mberneaud opened 4 months ago
1
Create setup for local development

#5 mberneaud closed 3 months ago
0
Create BigQuery and Firestore DB resources and grant team access to them

#4 mberneaud closed 3 months ago
0
Explore Firestore as bronze layer and define structure of the bronze layer database

#3 mberneaud closed 3 months ago
0
Set up and populate GH project

#2 mberneaud closed 3 months ago
0
Update README.md

#1 mberneaud closed 4 months ago
0