issues
search
makikooni
/
DE_Engineering_Project
The project creates applications to Extract, Transform and Load data from a operational database for our client Terriffic Totes. The data is archived in a data lake, and is made available in a remodelled OLAP data warehouse hosted in AWS.
0
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
INFRA: Update cicd to include deployment
#57
atif-hussain-khan
closed
1 year ago
0
LOAD: write load lambda
#56
tricia-mcmillan
opened
1 year ago
2
TRANSF: create transformation lambda function
#55
dabruge
opened
1 year ago
0
fixing aws credentails
#54
tricia-mcmillan
closed
1 year ago
0
TESTING: aws credentials GitHub access
#53
makikooni
closed
1 year ago
0
TESTING: was credentials Github Access - part 1
#52
makikooni
closed
1 year ago
0
🧹Add aws credentials to github
#51
tricia-mcmillan
closed
1 year ago
0
put extraction function into autopep
#50
tricia-mcmillan
closed
1 year ago
0
SET UP secrets manager using terraform
#49
tricia-mcmillan
opened
1 year ago
0
Create sns topic
#48
dabruge
closed
1 year ago
0
setup for aws Athena
#47
atif-hussain-khan
opened
1 year ago
0
TESTING: Extraction test
#46
LouKelly
closed
1 year ago
0
fixed bug on unit-tests command
#45
Pandangus
closed
1 year ago
0
BUGS: fix bug in Makefile
#44
Pandangus
closed
1 year ago
0
EXTRACT: add secrets manager to the extract lambda
#43
tricia-mcmillan
closed
1 year ago
0
TRANSF: setup transformation lambda
#42
Pandangus
closed
1 year ago
0
EXTRACT: setup cloudwatch schedule trigger to extraction lambda
#41
dabruge
opened
1 year ago
0
Create extraction lambda resource
#40
dabruge
closed
1 year ago
1
EXTRACT: Write and test extract lambda function
#39
tricia-mcmillan
closed
1 year ago
0
refactor(makefile): remove flake check on tests folder as there are c…
#38
atif-hussain-khan
closed
1 year ago
0
fix(makefile): fix path bug for run-flake command!
#37
atif-hussain-khan
closed
1 year ago
0
fix(makefile and extract.py): ammend run-autopep command to make chan…
#36
atif-hussain-khan
closed
1 year ago
0
update(cryptography): update package to latest to pass safety
#35
atif-hussain-khan
closed
1 year ago
0
fix(makefile): run security-test command inside of environment
#34
atif-hussain-khan
closed
1 year ago
0
fix(makefile): typo in run-checks command
#33
atif-hussain-khan
closed
1 year ago
0
Add testing cicd
#32
atif-hussain-khan
closed
1 year ago
0
TESTING: update cicd to include testing
#31
atif-hussain-khan
closed
1 year ago
0
🧹Outline the structure for transformed Data
#30
tricia-mcmillan
opened
1 year ago
0
test(cicd): changes to makefile to test cicd
#29
atif-hussain-khan
closed
1 year ago
0
🧹worked out how to get data form rds to s3
#28
tricia-mcmillan
opened
1 year ago
0
TESTING: test initial setup for ci/cd is working
#27
atif-hussain-khan
closed
1 year ago
0
file(cicd): moe .yml file to workflow folder
#26
atif-hussain-khan
closed
1 year ago
0
BUGS: Fix cicd workflow folder
#25
atif-hussain-khan
closed
1 year ago
0
fix(Makefile): fixed path in security-test
#24
atif-hussain-khan
closed
1 year ago
0
BUGS: fix path bug in make file
#23
atif-hussain-khan
closed
1 year ago
0
setup(cidi): setup and test cicd via github actions
#22
atif-hussain-khan
closed
1 year ago
0
fixing typo
#21
Pandangus
closed
1 year ago
0
bucket name typo fix
#20
Pandangus
closed
1 year ago
0
SET UP aws role and associated access keys for ci/cd process
#19
atif-hussain-khan
opened
1 year ago
1
fixing typo
#18
Pandangus
closed
1 year ago
0
initial file structure and gitignore
#17
Pandangus
closed
1 year ago
0
Update makefile
#16
atif-hussain-khan
closed
1 year ago
0
BUGS: Update makefile
#15
atif-hussain-khan
closed
1 year ago
0
SET UP ci/cd via github actions
#14
atif-hussain-khan
closed
1 year ago
0
EXTRACT: create lambda extraction resource
#13
dabruge
opened
1 year ago
0
SET UP create requirements.txt for project
#12
Pandangus
closed
1 year ago
0
SET UP: Create terraform S3 bucket resources
#11
Pandangus
closed
1 year ago
1
SET UP create providers.tf
#10
dabruge
opened
1 year ago
0
try and integrate github with slack for better notifications
#9
atif-hussain-khan
opened
1 year ago
1
Amend packaging version conflict in requirements
#8
dabruge
closed
1 year ago
0
Previous
Next