ministryofjustice / modernisation-platform

A place for the core work of the Modernisation Platform • This repository is defined and managed in Terraform
https://user-guide.modernisation-platform.service.justice.gov.uk
MIT License
679 stars 289 forks source link

Create new environment for Data Engineering data sharing tool #6343

Closed lalithanagarur closed 5 months ago

lalithanagarur commented 5 months ago

Environment details

This environment will enable external suppliers upload data to MoJ and download data from MoJ. The current purpose is to serve data sharing capabilities for BOLD projects but will be enhanced in the future for other data engineering data sharing.

Application Name

data engineering data sharing

Description of application

The environment will host a SFTP server. Each data supplier will have a user role to connect to the SFTP server for upload and download of data. The uploaded data will immediately be moved to a landing bucket in the Analytical Platform using a managed workflow. The data for external suppliers to download will come from the Analytical Platform and will be stored in a S3 bucket and IAM Role + Policies will be used to control which bucket paths will be accessible and visible to each user.

diagram (2)

GitHub team slug

data-engineering-data-sharing

GitHub code owner team slug

No response

Environments

Environment access level Development

sandbox

Environment access level Test

No response

Environment access level Preproduction

developer

Environment access level Production

view-only

application

data engineering data sharing

business-unit

Platforms

infrastructure-support

Data engineering: dataengineering@digital.justice.gov.uk

owner

Data engineering: dataengineering@digital.justice.gov.uk

Subnet sets

How do users connect to the application

Over the public internet

Additional features

Please check any additional features required

Other information

No response

Definition of Done

Definition of Done

Gary-H9 commented 5 months ago

Superseded by #6364.

github-actions[bot] commented 5 months ago

Hello @lalithanagarur 👋 Welcome to the Modernisation Platform! Your new accounts have now been created. Please see our user guidance for details on how to build and access infrastructure in the Modernisation Platform. If you require help or assistance please contact us via the #ask-modernisation-platform Slack channel.