alphagov / data-standards-authority

Collaboration space for working on data standards and guidance for the DSA
https://alphagov.github.io/data-standards-authority/
Other
24 stars 11 forks source link

TCOP Point 10 - DRAFT document for discussion #71

Open gheye opened 2 years ago

gheye commented 2 years ago

We are committed to ensuring data is right at the heart of our strategic approach to delivering services that meets the needs of users. We are proposing to make changes to TCOP point 10 to provide more comprehensive coverage of data best practices, as well as improve the structure to make it easier to digest for those building, buying and assuring services. Our proposal is available here.

We would like feedback from users of TCOP Point 10, and are open to comments and suggestions from anyone involved in the data space or those building or assuring platforms and services in government. This early draft is a work in progress and will be iterated from feedback.

We really appreciate your help in developing one of the core pieces of guidance on GOV.UK

Please add your comments below by replying with a comment. If you do not have a GitHub account then please email us your thoughts to: data-standards-authority@digital.cabinet-office.gov.uk

gheye commented 2 years ago

For ease of reading the full contents are below with items in italics that have changed:

Make better use of data

Use data more effectively by improving your technology, infrastructure and processes.

To meet point 10 of the Technology Code of Practice (TCoP) your plans must show you’ve considered:

If you’re going through the spend control process you must explain how you’re trying to meet point 10.

How making better use of data use will help your programme

Your programme will benefit from:

Follow the required data regulations and consider data ethics

When using data you must follow the Data Protection Act 2018 and the EU General Data Protection Regulation (GDPR).

Make sure you only hold data for specified purposes and consider the:

Plan how you will manage your data throughout its lifecycle

Make sure your data is not dependent on the lifecycle of your technology or service. Define and manage your data’s lifecycle and storage in line with the rest of your organisation’s data estate so that you can continue to use the data for as long as you need it.

Consider using open standards to make sharing and reusing data easier. You should aim to make any of your data associated with your technology or service reusable by other government organisations. This does not include data that falls under GDPR rules or highly classified data.

Choosing the right technology, processes and training

You will need to choose the right data tools for collecting, storing, analysing, sharing and retiring data. Your choice should take into consideration the skills and capabilities you have within your organisation.

You should make sure your data collection practices meet user needs. You should also make sure your data tools and infrastructure are scalable and encourage collaboration.

Your data tools and infrastructure should:

Also consider whether your business processes include:

Include technical debt in your prioritisation

Technical debt can build up over time and make your service harder to maintain. Look at the hidden technical debt that may exist in your data processing and wherever possible simplify your data processing.

Highlight technical debt and data processing issues so that appropriate spending is allocated to fix long-term issues. Look at the hidden technical debt that may exist in your data processing and wherever possible simplify your data processing.

Agreeing and exiting supplier contracts

When you are using a supplier, you should make sure the contract provides you with access to all your data. Your contract must also specify the exit and renewal arrangements for your data. This includes making sure the supplier returns your data:

If you are agreeing a contract of over £20 million, the supplier must provide this API, as outlined in the Model Services Contract guidance.

Storing and standardising your data

The government’s Data Standards Authority and the Open Standards Board have approved a number of open standards for data for use by the government. Where possible and appropriate, you should use these standards to make it easier to analyse data and share it with other departments.

Make data available in a suitable format, for example as a CSV file or through an API. Read the guidance on using CSV file format and refer to the API technical and data standards.

You should also consider:

Securing and backing up your data

Consider what security protocols you should have in place to:

You should also prepare a disaster recovery plan or incident management protocol so that your team knows what to do in the event of a data breach, attack or loss of data. Read Point 6 of the Technology Code of Practice about how to make things secure. The National Cyber Security Centre (NCSC) has also guidance on incident management.

Publishing and sharing your data

Follow the Data Ethics Framework to make sure you’re using data based only on user needs.

Where possible you should work in the open and publish your data. If you plan to publish data, you should consider how you will follow the:

You should also consider:

When documenting your data architecture, consider whether you can explain concepts using text or whether you need a diagram supported by text. Follow the GOV.UK content design guidance on using images to make sure your documentation is accessible.

Archiving, deleting or renewing data

You should only keep data for as long as necessary. You will need to put a process in place to help you decide when to update, delete, retire or archive your data. You should have processes to:

The National Archives has guidance on information management and can help with archiving data.

Related guides

Policies and guidance available includes: