issues
search
makikooni
/
DE_Engineering_Project
The project creates applications to Extract, Transform and Load data from a operational database for our client Terriffic Totes. The data is archived in a data lake, and is made available in a remodelled OLAP data warehouse hosted in AWS.
0
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fix auto-pep issues
#107
Pandangus
closed
1 year ago
0
Load docstrings
#106
Pandangus
closed
1 year ago
0
Deploy load
#105
atif-hussain-khan
closed
1 year ago
0
Extract docstrings
#104
Pandangus
closed
1 year ago
0
Pg8000loadlambda
#103
atif-hussain-khan
closed
1 year ago
0
Transform docstrings
#102
Pandangus
closed
1 year ago
0
Transform docstrings
#101
Pandangus
closed
1 year ago
0
Transform changed data
#100
atif-hussain-khan
closed
1 year ago
0
refactor transform lambda to include changes in data
#99
atif-hussain-khan
closed
1 year ago
0
Extract changed data
#98
atif-hussain-khan
closed
1 year ago
0
refactor extract function to extract only changes in the data
#97
atif-hussain-khan
closed
1 year ago
0
extract lambda docs
#96
atif-hussain-khan
opened
1 year ago
0
Create transformation lambda
#95
atif-hussain-khan
closed
1 year ago
0
fix head_bucket error
#94
atif-hussain-khan
closed
1 year ago
0
Extract transform trigger
#93
atif-hussain-khan
closed
1 year ago
0
refactor extract lambda to trigger transform lambda upon completion
#92
atif-hussain-khan
closed
1 year ago
0
Ifra setup
#91
atif-hussain-khan
closed
1 year ago
0
Ifra setup
#90
atif-hussain-khan
closed
1 year ago
0
Finish terraform infrastructure setup
#89
atif-hussain-khan
closed
1 year ago
0
change alarm period to 60 seconds and lambda trigger every two minutes
#88
atif-hussain-khan
closed
1 year ago
0
Extract sns
#87
atif-hussain-khan
closed
1 year ago
0
change cloudwatch trigger to test cw alarm and sns
#86
atif-hussain-khan
closed
1 year ago
0
Extract sns
#85
atif-hussain-khan
closed
1 year ago
0
change to be multiple of 60
#84
atif-hussain-khan
closed
1 year ago
0
Extract sns
#83
atif-hussain-khan
closed
1 year ago
0
Write the check update or add rows code
#82
tricia-mcmillan
opened
1 year ago
0
fix bug again
#81
atif-hussain-khan
closed
1 year ago
0
fix bugs
#80
atif-hussain-khan
closed
1 year ago
0
create iam infrastructure for extract, load and transform lambda's
#79
atif-hussain-khan
closed
1 year ago
0
fix s3_policy_resource bug
#78
atif-hussain-khan
closed
1 year ago
0
fix variables not allowed in provider error
#77
atif-hussain-khan
closed
1 year ago
0
swap variables for locals
#76
atif-hussain-khan
closed
1 year ago
0
LOAD: create test Database for load lambda testing
#75
tricia-mcmillan
opened
1 year ago
0
rename vars.tf to vars.tfvars to fix variables not allowed error in d…
#74
atif-hussain-khan
closed
1 year ago
0
Extract sns
#73
atif-hussain-khan
closed
1 year ago
0
EXTRACT: setup sns email notifications for extraction lambda
#72
atif-hussain-khan
closed
1 year ago
0
update test and deploy to implement dev-setup
#71
atif-hussain-khan
closed
1 year ago
0
passing extraction function
#70
atif-hussain-khan
closed
1 year ago
0
fix makefile
#69
atif-hussain-khan
opened
1 year ago
0
correct spelling in lambda arg layer should be layers
#68
atif-hussain-khan
closed
1 year ago
0
correct arg spelling
#67
atif-hussain-khan
closed
1 year ago
0
satisfy the flak8
#66
atif-hussain-khan
closed
1 year ago
0
Setup extract lambda layer
#65
atif-hussain-khan
closed
1 year ago
0
Setup extract lambda layer
#64
atif-hussain-khan
closed
1 year ago
0
LOAD: set appropriate permissions for the load process
#63
makikooni
opened
1 year ago
0
EXTRACT: adding util functions as lambda layers
#62
atif-hussain-khan
closed
1 year ago
0
changed name from every_one_minute to extraction_schedule
#61
atif-hussain-khan
closed
1 year ago
0
modify cloudwatch schedule for extraction lambda
#60
atif-hussain-khan
closed
1 year ago
0
BUGS; work out the right vertions needed for s3fs
#59
tricia-mcmillan
opened
1 year ago
0
feat(cicd): add deployment job to cicd workflow
#58
atif-hussain-khan
closed
1 year ago
0
Next