issues
search
mberneaud
/
us-weather-alerts
Le Wagon Data Engineering bootcamp final project
2
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Dbt update gold
#42
janinewin
closed
8 months ago
0
add dbt tasks to dag & add gold source
#41
MouadRS
closed
8 months ago
0
Dbt dag tasks
#40
MouadRS
closed
8 months ago
0
Update dbt silver
#39
janinewin
closed
8 months ago
0
Update dbt silver
#38
janinewin
closed
8 months ago
0
update schema
#37
MouadRS
closed
8 months ago
0
Upload dbt seeds
#36
janinewin
closed
8 months ago
0
Upload zone county seeds
#35
janinewin
closed
8 months ago
0
update schema
#34
MouadRS
closed
8 months ago
0
Dbt model silver and gold
#33
janinewin
closed
8 months ago
0
Create presentation for Demo Day
#32
mberneaud
opened
8 months ago
0
Revisions to Looker Studio dashboard
#31
mberneaud
opened
8 months ago
0
Deployment using Cloud Run
#30
MouadRS
opened
8 months ago
0
Add new Airflow Dag
#29
MouadRS
closed
8 months ago
0
Airflow Tasks ( Load alerts table - bronze dataset)
#28
MouadRS
closed
8 months ago
0
Transfer to bigquey
#27
MouadRS
closed
8 months ago
1
revised scraper to only scrape land alerts and to use SAME as the geocode instead of UGC#
#26
mberneaud
closed
8 months ago
2
looker exploration
#25
MouadRS
opened
8 months ago
1
Use DBT seed Folder for counties file
#24
MouadRS
closed
8 months ago
0
Revise scraper code to only query region_type = land
#23
mberneaud
opened
8 months ago
0
Create a DBT model that merges Centroids from Zone-county Correlation File and the alerts. ( Gold Layer)
#22
mberneaud
opened
8 months ago
1
Create table for the shapefile lookup file. ( BQ - once shot)
#21
mberneaud
opened
8 months ago
2
Brainstorming Entities Diagram
#20
MouadRS
closed
8 months ago
0
Create DBT Models ( Silver Layer)
#19
MouadRS
opened
8 months ago
2
Upload From GCS to Bigquery
#18
MouadRS
opened
8 months ago
0
create new bucket ( us_weather_alerts)
#17
MouadRS
closed
8 months ago
3
Upload to GCS
#16
MouadRS
closed
8 months ago
0
Migrate landing zone layer to GCS
#15
MouadRS
closed
8 months ago
0
Store polygon_coordinates
#14
MouadRS
opened
8 months ago
0
Metabase (POC)
#13
MouadRS
closed
8 months ago
1
Local setup
#12
MouadRS
closed
8 months ago
2
20240319 mberneaud initial api scrape
#11
mberneaud
closed
8 months ago
0
Create schemas for bronze layer tables
#10
mberneaud
opened
8 months ago
0
Airflow initial setup
#9
mberneaud
closed
8 months ago
0
dbt initial setup
#8
mberneaud
closed
8 months ago
0
Set up Metabase deployment on GCP
#7
mberneaud
closed
8 months ago
0
Create Python functions to scrape API and transfer data to data lake bronze layer.
#6
mberneaud
opened
8 months ago
1
Create setup for local development
#5
mberneaud
closed
8 months ago
0
Create BigQuery and Firestore DB resources and grant team access to them
#4
mberneaud
closed
8 months ago
0
Explore Firestore as bronze layer and define structure of the bronze layer database
#3
mberneaud
closed
8 months ago
0
Set up and populate GH project
#2
mberneaud
closed
8 months ago
0
Update README.md
#1
mberneaud
closed
8 months ago
0