issues
search
ONSdigital
/
dp-data-pipelines
Pipeline specific python scripts and tooling for automated website data ingress.
MIT License
1
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
implement data ingress v1, task 2.
#70
mikeAdamss
closed
5 months ago
0
JJ/DIS-566
#69
RedWalters
closed
4 months ago
2
63_decorator
#68
nimshi89
closed
5 months ago
0
lock down regex, add more representative transform namespacing
#67
mikeAdamss
closed
5 months ago
0
Acceptance tests working
#66
SarahJohnsonONS
closed
5 months ago
1
tidy up schema and nomanclature
#65
mikeAdamss
closed
5 months ago
0
Jim/correcting locations
#64
JimBryant7
closed
5 months ago
0
decorator - enrich notifications
#63
mikeAdamss
closed
5 months ago
1
Run the python pipeline code against the existing Supply and Use Data and the GDP examples
#62
bailed22
closed
5 months ago
3
bug - fix relative path use in schema lookup
#61
mikeAdamss
closed
5 months ago
1
#quick fixing file structure
#60
NickPapONS
closed
5 months ago
0
Rearranging misplaced files
#59
NickPapONS
closed
5 months ago
0
S3 tar recieved
#58
nimshi89
closed
5 months ago
1
35 implement data ingress v1
#57
Moasib-Arif
closed
5 months ago
0
Create messages 2
#56
NickPapONS
closed
5 months ago
0
initial function to take an s3 object name
#55
mikeAdamss
closed
6 months ago
0
Minor tidy up
#54
mikeAdamss
closed
6 months ago
0
33 migrate python package ( Uber Commit )
#53
Moasib-Arif
closed
6 months ago
0
validate csv and test
#52
JimBryant7
closed
5 months ago
1
Data Transforms - Align to Latest Application Profile
#51
martynspooner
opened
6 months ago
0
logging - first pass
#50
mikeAdamss
opened
6 months ago
1
toggle off notifications for local development
#49
mikeAdamss
closed
4 months ago
2
Place Holder - Potential Meta data transform work to aid input file creation....
#48
martynspooner
opened
6 months ago
0
Transform Code Documentation.
#47
martynspooner
opened
6 months ago
1
Volume / Performance Testing (Ticket not ready - just a placeholder).
#46
martynspooner
opened
6 months ago
0
Data Transformation - Implement Validation / Testing / Notifications (not to be confused with file output validation).
#45
martynspooner
opened
6 months ago
2
#6 create message 1
#44
NickPapONS
closed
6 months ago
0
#33 Mirgrate to formal python package
#43
Moasib-Arif
closed
6 months ago
0
Run the python pipeline code against the existing Supply and Use Data and the GDP examples (Local Execution).
#42
martynspooner
closed
5 months ago
1
Issue 8 pipeline details
#41
JimBryant7
closed
6 months ago
0
acceptance prerequisite - notifications
#40
mikeAdamss
closed
5 months ago
2
acceptance tests backend
#39
mikeAdamss
closed
4 months ago
1
acceptance prerequisite: data_ingress_v1: 1 - data fixtures
#38
mikeAdamss
closed
5 months ago
2
tidy up repo structure
#37
mikeAdamss
closed
5 months ago
1
implement data_ingress_v1 - task 2
#36
mikeAdamss
closed
5 months ago
1
implement data_ingress_v1 - task 1
#35
mikeAdamss
closed
5 months ago
2
s3 tar recieved
#34
mikeAdamss
closed
5 months ago
2
migrate to formal python package
#33
mikeAdamss
closed
5 months ago
1
Pipeline Notification
#32
bailed22
closed
6 months ago
1
#10 schema path from config
#31
SarahJohnsonONS
closed
6 months ago
0
First pass at the SMDX 2.0 transform function
#30
RedWalters
closed
5 months ago
0
reorganised, tweaks, add Makefile, ran black
#29
mikeAdamss
closed
6 months ago
0
added the function, and test
#28
nimshi89
closed
6 months ago
0
added files, and tests
#27
nimshi89
closed
6 months ago
0
issue #4
#26
JimBryant7
closed
6 months ago
0
Create message 1
#25
MuazzamChaud
closed
6 months ago
0
Create docker image pipeline
#24
mikeAdamss
closed
6 months ago
1
Documentation
#23
mikeAdamss
closed
6 months ago
0
SDMX Transform - Investigate how best to Integrate Application Profile into our Codebase (Pipeline Configuration Code?)
#22
MartynBSpooner
closed
5 months ago
0
SDMX Transform - Design Dashboard for Metrics / Optics (Most likely based on Kibana)
#21
MartynBSpooner
opened
7 months ago
0
Previous
Next