co-cddo / open-standards

Collaboration space for discussing and exploring technical and data standards
135 stars 18 forks source link

Data standard for interchange and querying of public services #77

Closed charleemg closed 6 months ago

charleemg commented 3 years ago

Data standard for interchange and querying of public services 

Category

Data

Challenge owners

Ben Unsworth Head of Service Transformation, Essex County Council

To feed back directly on this challenge, or for questions, contact data-standards-authority@digital.cabinet-office.gov.uk

Short description

When seeking assistance, users of public and voluntary sector services will find a huge amount of lists, registers, activities and advisors. This can prove difficult to navigate by service users, their carers, and by anyone else working in the public services sector who needs to find reliable information simply and quickly - and ideally from a single source.

A single organisation can have multiple directories itself, and these can have varying quality and richness. Data quality issues can also make organisations or even separate departments within them feel the need to create their own directories, instead of reusing existing ones from other places.

This can all lead to information that is not reliable, timely or complete enough to recommend services quickly, leading to delayed action by having to carry out further research.

This challenge seeks to find an agreed standard for directories of human services data that helps users find trusted, specific and personalised search results that are appropriate to where people live and what they need, in the time they have available. This standard seeks to cut down on long lists of potential service providers and reduce time people spend in finding the help they need.

The Open Referral UK data standard - a UK extension of the Open Referral standard - is already a very strong example of a possible standard, but we'd like to hear about other standards, or possible revisions of existing standards, to review during the consultation process.

User need

The basic user need for this standard is to make relevant content easier to find. The Adur & Worthing Councils OpenCommunity Beta for adopting the Open Referral UK data standard provides a good range of example user needs:

Expected benefits

We expect a good standard to:

We are looking for a standard that is compatible with UK-specific requirements. It should define the structure for human services data delivered primarily by local authorities, solely or in conjunction with other partners across the wider public or third sectors, as well as across central government and devolved administrations.

Functional needs

The standard should provide the name and organisation delivering each service. It should indicate how the service is accessed (for example online, drop-in, referral or home visit) and provide links and/or contact details to help people gain easy access to the service.

The standard should define the following data entities for rich service information:

The standard should permit use of any taxonomies of terms for types of service, organisation, eligibility, cost and other elements. Well-managed national and international taxonomies should also be encouraged.

The standard should define machine-readable means of:

The standard should be maintained in a way that gives confidence in its longevity, providing for incremental improvements that result from a consensus amongst its users.

Prerequisites

The standard must be interoperable with other relevant standards, meaning it has to:

follow personal and organisational identity standards (for example, when identifying citizens and service providers within the referral process)

edent commented 3 years ago

Blog published at https://dataingovernment.blog.gov.uk/2021/04/28/vulnerable-people-services-data-standard/

thill-odi commented 3 years ago

As part of the Open Data Institute's work on the OpenActive family of standards, we've investigated OpenActive's relevance to the domains of social prescribing and referral more generally - areas which have significant overlaps with the area you're aiming to address here. In particular, we commissioned some research (delivered by Digital Gaps and porism last month) into common data-related barriers to referral.

The outputs of this research are publicly available on a Coda site. Though focused in the main specifically on OpenActive, I suspect you'll find almost everything in the research of at least some value.

Of particular relevance, however, might be:

In addition OpenActive standards may be of interest in their own right, in particular the Accessibility standard, which, while needing further consultation, may prove useful beyond the original physical-activity-facility use-case it was originally developed for.

MikeThacker1 commented 3 years ago

The work referenced by @thill-odi includes a technical review of OpenActive's suitability for social prescribing. It identifies some areas where OpenActive could be extended from Open Referral UK (ORUK) learning and some areas where both standards would benefit from small incremental improvements to help social prescribing.

ORUK has a wider scope than OpenActive and ORUK makes provision for some attributes (like some service eligibility constraints) that tend not to apply to the sports and wellbeing activities for which OpenActive is designed.

The Open Referral API query tool implements an open-source transformation of OpenActive data to the Open Referral UK format so it can be combined with ORUK feeds such as those from Bristol, Blackburn, Elmbridge and Hull exposed by the tool.

So ORUK is the obvious/strong candidate for this challenge, building on years of implementation in the US since 2014. OpenActive sports data can be transformed into ORUK format.

Within a couple of weeks, the revised OpenReferralUK site will be launched with a bunch of case studies and adoption guidance.

stevenbrandwood commented 3 years ago

Standard address and location data is supported by the GDS Open Standards Board mandate to use Unique Property Reference Numbers (UPRNs) - https://www.gov.uk/government/publications/open-standards-for-government/identifying-property-and-street-information Bringing service data together should be underpinned by this standard - further information can be found at www.geoplace.co.uk

MikeThacker1 commented 3 years ago

@stevenbrandwood Open Referral UK extends the international Open Referral standard though it does not change the location and address parts which include fields for latitude, longitude and address with "postal_code". I'm not aware of an existing standard for services for which the UPRN is an integral part. Of course, not all services are associated with a physical location - for example they might be online or delivered at someone's home.

I see that UPRN has already been requested as an addition to the UK extension of Open Referral UK - see here. It will therefore be considered for the next version upgrade.

I understand that for use in open data the address associated with a UPRN needs to have been sourced separately from the licensed address data.

emilymacloud commented 3 years ago

Help-seekers find it challenging to access the right support at the right time. For advice services, the landscape is no simpler to navigate.

Current Projects (that may be relevant):

Lessons Learned:

stevenbrandwood commented 3 years ago

@stevenbrandwood Open Referral UK extends the international Open Referral standard though it does not change the location and address parts which include fields for latitude, longitude and address with "postal_code". I'm not aware of an existing standard for services for which the UPRN is an integral part. Of course, not all services are associated with a physical location - for example they might be online or delivered at someone's home.

I see that UPRN has already been requested as an addition to the UK extension of Open Referral UK - see here. It will therefore be considered for the next version upgrade.

I understand that for use in open data the address associated with a UPRN needs to have been sourced separately from the licensed address data.

Thanks for the clarification Mike - happy to discuss further if that helps

MikeThacker1 commented 3 years ago

@emilymacloud there's some really useful content in your post.

From the projects you listed I can't see any recommended data structures or data interchange mechanisms (such as Application Programming Interfaces). If you're aware of any that you consider more suitable than Open Referral UK do let us know. Regarding accessibility, I've not seen much beyond the recommendation of a basic taxonomy for uncontentious location accessibility points like "hearing loops" so it would be good to know if London Plus has a concrete data standard.

Open Referral UK (ORUK), extending Open Referral which was introduced in the USA in 2014, has a data structure that should accommodate the requirements of most local initiatives. Very little of the core standard is mandated. "Application profiles" can be used to define the elements expected for specific purposes, such as social prescribing.

ORUK is agnostic when it comes to taxonomies. There is some guidance on taxonomies here. I think there's separate work needed still to settle on the best taxonomies and mappings for specific purposes. I'd argue that any taxonomy used should be open and published according to the SKOS standard - but that's separate from this challenge for a standard.

Where service providers use similar systems, it is prudent that the relevant CRM providers are involved at the appropriate stage and take appropriate action to conform their systems to the Standard once reached.

Absolutely. The ORUK case studies page has contributions from local authorities, an Integrated Care System, service directory suppliers and tools providers that have implemented the standard. Three suppliers: FutureGov, Public Partnerships and Placecube have directory products with standard compliant APIs.

instantiator commented 3 years ago

Police Rewired have been approached by a couple of police services who are developing tools to allow them to make referral decisions as and when they encounter people with needs.

There are 2 main use cases that we looked at:

  1. Front-line staff encounter a person with need to be referred for any reason when going about their work. In addition to continuing with their current priorities, they wish to be able to make an on the spot referral to help that person connect with an appropriate support service. This use case generalises well to contexts outside of policing, too.

  2. Front-line staff encounter a person as they pass through custody. Arrestees are offered a referral, although the options are limited and there's still very little time for discovery of new services.

Anecdotally, services seem to operate using a short list of potential referral services, or specialised teams for a limited number of positive interventions - although pathways for referral to those policing teams were not always known to police officers or staff.

Common characteristics of both use cases:

Our community did some early, informal work on this and determined that the existence of directories would help to build tools that could quickly sift through services to find the most appropriate referral options (where appropriateness could be considered a combination of vicinity, opening hours, specialities and capacity).

We explored use of charitybase.uk, but found that although this provided the most complete set of organisations, it wasn't trivial to determine the referral paths or filter by specialisms that each could provide.

We looked at the OpenReferral HSDS and determined that it could meet many more of those requirements, but as yet no directories existed that we were aware of.

We believe that adoption of an open standard that can meet these needs is the first step towards the development of directories - either privately held by front-line services, or (more productively) openly operated and consumable by those services.

This, in turn, could enable those use cases presented above - allowing police services (and other front-line organisations) to build tools that can help them to make referral decisions quickly.

We also believe that adoption of a common standard will help to lower the cost of building operational solutions. There are 43 police services across the UK and a common standard should allow them to build a single tool, so avoiding duplication of effort.

CDivers commented 3 years ago

Hi,

Since 2019 and with assistance from over 200 volunteers across the UK, My Pickle has created the UK’s largest National Support Database. Access to this Support Database is available free to the general public at mypickle.org.

The website is designed to cut through the noise online and point anyone facing crisis in the right direction by:

Data Quality

This is incredibly important to us. Anyone from the public can suggest a national support resource for inclusion to the site. All content is pre-moderated.

As a volunteer-driven initiative our trained Researchers can help source and vet resources. Our pre-publish Quality Assurance (QA) processes involve two independent reviews over each resource.

Our data quality control framework has over 100 data quality controls spanning two areas:

There is additional information on the resources not currently shown on the front-end including accessibility.

API / Collaboration

Our Support Database will soon be available via API. Also happy to input / co-create a solution where local services /databases can be brought together. Please feel free to get in touch cat@mypickle.org

@emilymacloud @MikeThacker1 really nice to meet you over the past couple weeks.

MikeThacker1 commented 3 years ago

We looked at the OpenReferral HSDS and determined that it could meet many more of those requirements, but as yet no directories existed that we were aware of.

@instantiator there are directories that comply with the UK extension of Open Referral HSDS as described by Open Referral UK case studies and shown by API endpoints in the API Query Tool. We're developing a dashboard of API feeds so you can see more clearly where they can be accessed and how much of the standard they support.

There's a long way to go before we have the coverage that Police Rewired might need, but the point of an approved standard (hopefully Open Referral UK) is to the many directories interoperable, building in the lessons of Open referral HSDS.

Tim-Adams-LGA commented 2 years ago

I am a programme manager at the Local Government Association, leading on nationally coordinated projects to encourage and help local government make better use of the data they collect, hold and manage. This includes data standards, resources, analysis, sharing, governance, publishing, protecting. Over my twenty years at the LGA we have run many initiatives and developed substantial guidance, tools, knowhow and support to help to progress better understanding and use of local data. We make a big push to open data wherever we can.

I am excited to see the progression of the Open Referral UK data standard for consistent publishing of information about local available services to a consistent and comprehensive specification. We started work in this area a decade ago and started to the work towards this project around five years ago working with colleagues, partners and local authorities in the North West region.

At that time, it became clear that effective discovery and wide-range use about local services would only really take hold if we can develop and agree a single data standard/specification that is well documented and well supported so that all service providers and data publishers can make information available consistently. This makes it easier for suppliers of systems, platforms of services, websites, apps and related tools to be developed once and then reused nationally with confidence. The investments can be deployed widely and with little need for constant system changes.

At the LGA in partnership with Cabinet Office, DCMS, MHCLG and a wide number of councils and their systems suppliers, we were able to kick start the consultation and trial process for the new standard. It formed part of the Government’s commitment to supporting lonely people where we are able to publish, discover and trial presentation of helpful services that can work to offer solutions to loneliness. A full project report is available online. The work proved successful in holding diverse services data in a way that was adopted by two commercial suppliers across the three pilot authorities. COVID-19 has changed the scope of services available and so delayed wider rollout but ORUK provides a reliable detailed non-proprietary way of describing services.

The key to better understanding of local public services (be they from public bodies, voluntary groups or the private pioneering organisations and individuals) is to make data available to a consistent specification so that Apps, catalogues, directories, websites and planning to develop the search and matching capabilities once, knowing it will re-work anywhere in the country. We support this work, the new Open referral UK standard and its accreditation and rollout. We wish the project well and will be on hand to guide its next steps when they are decided.

kathryndingle commented 2 years ago

We working to adopt Open Referral UK's data standard within our app (Mybestlife.app). The data standard is an opportunity for the whole sector and one we should embrace!

We are also exploring how we can use schema.org and/or data tagging to improve the availability of charitable service data which will contribute to the Open Referral UK data standard. I am keen to connect with anyone working in this space/interested in this space.

stevenbrandwood commented 2 years ago

Hi @kathryndingle, you'll see from the conversation above that I'm no expert on the Open Referral standards, but know a thing or two about addresses and UPRNs if that helps in anyway. More than happy to talk you through that side of the data.

kathryndingle commented 2 years ago

Hi @stevenbrandwood - that sounds great. Let's chat. Do email me on kathryn.dingle@thinknpc.org and we can find a time to chat! Thanks

webmink commented 2 years ago

I'm researching this for the OSB discussion and drawing a blank finding the details of origins, governance, maintenance and licensing for this standards profile. I'd welcome pointers - thanks!

MikeThacker1 commented 2 years ago

@webmink http://openreferraluk.org/ and https://openreferral.org/ have a lot of info on the Open Referral standard.

I believe the documents "Open Referral Proposal_Final" and "Open Referral profile for GOV UK" have been submitted to the Board but I don't know if they're public yet. The first of these should answer all your questions.

webmink commented 2 years ago

Thanks Mike - I appreciate you taking the time to reply! I have read both of those documents but they don't help me in determining if this is an open standard per OSB's definition at https://www.gov.uk/government/publications/open-standards-principles/open-standards-principles#Defining-open-standards

Notably I am looking for evidence that historically and currently this profile has:

I apologise for not being a subject expert in your area - I suspect that's common for OSB members - as this means I need the sort of hand-holding to research and understand matters that are clear to you and other experts. My goal is to arrive at the OSB meeting ready to support the proposal to adopt!

MikeThacker1 commented 2 years ago

Question 20 in the assessment points to https://docs.google.com/document/d/17cJxF_1P6fafcsFJQERFQifKKc_kPbAKmAXwe2LWDcI/edit#heading=h.jpi5001xplp5 which partly answers the question.

The UK extension was developed by consultation by iStandUK and the LGA. The website has a mailing list to which people can subscribe. Open discussion is via https://forum.openreferraluk.org/ and GitHub issues.

We're working on converging the US and UK processes into one and formalising open version control processes to reflect this. The standard is driven by mainly public bodies (e.g. local authorities and health social prescribing organisations) not by suppliers, although supplier feedback is very useful for open consultation on enhancements.

greggish commented 2 years ago

In case it's helpful to offer historical context: Open Referral's governance processes to date (primarily though not exclusively focused in the US) are described in this document, which is linked from our website's About page and also from our github documentation. This describes our approach to representation and feedback solicitation of various stakeholder groups, and our process of setting priorities, reviewing proposals, and making decisions through multiple methods of consultation. We're not a formal SDO but I'm confident we meet the above criteria, and would be glad to answer any other questions you might have.

(Also I'll note that we're migrating these docs out of Google Docs, converting the text into Markdown and planning to publish it alongside the technical documentation of HSDS in our Github repo and docs site in the next update.)

webmink commented 2 years ago

Where there's no governance to fall back on, this sort of information is useful, thanks. It seems OSB needs a process to help proposals gather and present the evidence to support an informally-created standard being treated as open.

DidacFB-CDDO commented 6 months ago

As per housekeeping practices we are closing this with the status that Open Referral UK is a recommended standard.