Importing patients from old platform

AmaniKrayemRCPCH commented 1 year ago

Headers - Export_Final.csv Data format - Key_Final.csv 50 dummy patients - DummyPatients_Final.csv

A couple notes:

Each patient is assigned to Trust. The referring hospital column is free-text and not mandatory.
I've also kept the ethnicity other free-text column, but it may not actually be of use here.
There are some Trust mergers that aren't reflected in our old platform. The details of mergers are here - Trust Mergers for Import.xlsx This is not comprehensive as we only note the mergers that we have been informed of.

AmaniKrayemRCPCH commented 1 year ago

Another thing to note is that NHS numbers and postcodes aren't validated on the old platform. I've put valid data in the dummy patients CSV from online generators, but you will probably get errors when importing the actual data.

anchit-chandran commented 1 year ago

Hey @AmaniKrayemRCPCH , just to confirm - how does the S01DOBDateOnly col correspond to the defined S01DOB (datetime) header?

anchit-chandran commented 1 year ago

Also wanted to confirm, went through the different available options from your data for ethnicities and mapped to what made most sense on how we define them.

Pls could you let me know if this is fine / any changes required? The format is:

netsolveEthnicity ~> ourEthnicity (description)

WBritish ~> A (British, Mixed British)
WIrish ~> C (Any other White background)
WOther ~> C (Any other White background)
BCaribbean ~> M (Caribbean)
BAfrican ~> N (African)
BOther ~> P (Any other Black background)
AIndian ~> H (Indian or British Indian)
APakistani ~> J (Pakistani or British Pakistani)
ABangladeshi ~> K (Bangladeshi or British Bangladeshi)
AOther ~> L (Any other Asian background)
MWBC ~> D (Mixed (White and Black Caribbean))
MWBA ~> E (Mixed (White and Black African))
MWAs ~> F (Mixed (White and Asian))
MOther ~> G (Any other mixed background)
OChinese ~> R (Chinese)
OOther ~> S (Any other ethnic group)
No ~> Z (Not Stated)
NK ~> Z (Not Stated)

anchit-chandran commented 1 year ago

Query 3 sorry:

we don't have any organisations for these 3 Trusts. Because each Case must be registered to an Organisation, I'm unsure what to do with these records.

AmaniKrayemRCPCH commented 1 year ago

Hi Anchit,

City Hospitals Sunderland NHS Foundation Trust (RLN) and South Tyneside NHS Foundation Trust (RE9) have merged, and are now South Tyneside and Sunderland NHS Foundation Trust (R0B).

Organisations: R0B01 - Sunderland Royal Hospital, Kayll Road, Sunderland, SR4 7TP.

North Cumbria University Hospitals NHS Trust (RNL) merged with Cumbria Partnership NHS Foundation Trust to create North Cumbria Integrated Care NHS Foundation Trust (RNN).

Organisations: RNN62 – Cumberland Infirmary, Newtown Road, Carlisle, Cumbria, CA2 7HY RNNBX – West Cumberland Hospital, Homewood, Hensingham, Whitehaven, Cumbria, CA28 8JG

Amani Krayem (she/her) Epilepsy12 Project Coordinator Royal College of Paediatrics and Child Health 5-11 Theobalds Road, London, WC1X 8SH 020 7092 6157 www.rcpch.ac.uk/epilepsy12http://www.rcpch.ac.uk/epilepsy12 @.***@epilepsy_12

Leading the Way in Children's Health The Royal College of Paediatrics and Child Health (RCPCH) is a registered charity in England and Wales (1057744) and in Scotland (SC038299)

From: Anchit @.> Sent: Friday, October 20, 2023 12:12 PM To: rcpch/rcpch-audit-engine @.> Cc: Amani Krayem @.>; Mention @.> Subject: Re: [rcpch/rcpch-audit-engine] Importing patients from old platform (Issue #596)

Query 3 sorry:

we don't have any organisations for these 3 Trusts. Because everything requires an Organisation, I'm unsure what to do with these records.

[Image]https://user-images.githubusercontent.com/68898006/276912769-a3629e6b-e73e-4118-bfd4-aa02a3223dc2.png

— Reply to this email directly, view it on GitHubhttps://github.com/rcpch/rcpch-audit-engine/issues/596#issuecomment-1772546054, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A6E4ZV22GOBPRZSPVTEDWUDYAJL7XAVCNFSM6AAAAAA53VSRUWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZSGU2DMMBVGQ. You are receiving this because you were mentioned.Message ID: @.**@.>>

This email has been scanned for spam & viruses. If you believe this email should have been stopped by our filters, click herehttps://portal.mailanyone.net/index.html#/outer/reportspam?token=dXNlcj1hbWFuaS5rcmF5ZW1AcmNwY2guYWMudWs7dHM9MTY5NzgwMDMyMTt1dWlkPTY1MzI2MDgxRjc1MkZDNTlFOTYzNjZFODZGNkRENkJBO3Rva2VuPTEwMDk2MzM2MzBlOWQ4YTJkOWNmYTQ1YTU2Yjk0YWU2ZTNkNWI1M2I7 to report it.

AmaniKrayemRCPCH commented 1 year ago

Heya,

I think it should be

WIrish ~> B (Irish)

Otherwise, ethnicities are all correct

Amani Krayem (she/her) Epilepsy12 Project Coordinator Royal College of Paediatrics and Child Health 5-11 Theobalds Road, London, WC1X 8SH 020 7092 6157 www.rcpch.ac.uk/epilepsy12http://www.rcpch.ac.uk/epilepsy12 @.***@epilepsy_12

Leading the Way in Children's Health The Royal College of Paediatrics and Child Health (RCPCH) is a registered charity in England and Wales (1057744) and in Scotland (SC038299)

From: Anchit @.> Sent: Friday, October 20, 2023 10:46 AM To: rcpch/rcpch-audit-engine @.> Cc: Amani Krayem @.>; Mention @.> Subject: Re: [rcpch/rcpch-audit-engine] Importing patients from old platform (Issue #596)

Also wanted to confirm, went through the different available options from your data for ethnicities and mapped to what made most sense on how we define them.

Pls could you let me know if this is fine / any changes required? The format is:

netsolveEthnicity ~> ourEthnicity (description)

WBritish ~> A (British, Mixed British)

WIrish ~> C (Any other White background)

WOther ~> C (Any other White background)

BCaribbean ~> M (Caribbean)

BAfrican ~> N (African)

BOther ~> P (Any other Black background)

AIndian ~> H (Indian or British Indian)

APakistani ~> J (Pakistani or British Pakistani)

ABangladeshi ~> K (Bangladeshi or British Bangladeshi)

AOther ~> L (Any other Asian background)

MWBC ~> D (Mixed (White and Black Caribbean))

MWBA ~> E (Mixed (White and Black African))

MWAs ~> F (Mixed (White and Asian))

MOther ~> G (Any other mixed background)

OChinese ~> R (Chinese)

OOther ~> S (Any other ethnic group)

No ~> Z (Not Stated)

NK ~> Z (Not Stated)

— Reply to this email directly, view it on GitHubhttps://github.com/rcpch/rcpch-audit-engine/issues/596#issuecomment-1772416708, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A6E4ZV252W76KI33I7YU5SDYAJB4XAVCNFSM6AAAAAA53VSRUWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZSGQYTMNZQHA. You are receiving this because you were mentioned.Message ID: @.**@.>>

This email has been scanned for spam & viruses. If you believe this email should have been stopped by our filters, click herehttps://portal.mailanyone.net/index.html#/outer/reportspam?token=dXNlcj1hbWFuaS5rcmF5ZW1AcmNwY2guYWMudWs7dHM9MTY5Nzc5NTE1NTt1dWlkPTY1MzI0QzUyNjE3REI3NjQ4OEQyQzMyMTkxMTdFOEVDO3Rva2VuPTJhMjFlMGEzOWQxOWUyNzI3MjdmZjE4ZTU0NmM0ZjhjYTA0YWI5M2Y7 to report it.

AmaniKrayemRCPCH commented 1 year ago

In regards to the DOB column, that was an excel formatting issue. Here's the fixed dataset - DummyPatients_Final_20231020.csv

ollyrice commented 1 year ago

I'll be creating a SharePoint site "E12 data transfer" as a secure location to upload of exported NetSolving data. Olly

nikyraja commented 1 year ago

Thanks Olly for creating the SP site. The patient data has now been uploaded onto this site.

A note that the columns are in a slightly different order to the dummy patient version where DOB is now the final column. If this is an issue and we can redo.

This is ready for importing into the new platform - please let us know if you need anything!

nikyraja commented 1 year ago

A note from Hannah on the download:

'For sitecode RH5 the sitename should be Somerset NHS Foundation Trust not Yeovil District Hospital NHS Foundation Trust. Also, where it says NHS in the sitename and s01refferringhospital it will be written as Nhs rather than NHS.'

An updated version had been uploaded onto the site: 'Epilepsy12_Cohort6_APIexport_reformated_151123'

pacharanero commented 1 year ago

WIP on this is in the #635 pull request. Note that a previous Issue #552 suggesting the use of REST API for this has been superseded in favour of a simpler CSV importer.

pacharanero commented 12 months ago

@AmaniKrayemRCPCH @nikyraja the initial import of patient data is now done on Staging, where you can log in to review and spot-check some cases, just to ensure we've got it all right. If Staging is OK then we do the same on Live and you are ready to go. (After which I'll delete data on Staging and revert to some dummy data)

nikyraja commented 11 months ago

Thanks @pacharanero and all for this!

We have reviewed the data and performed random spot checks. I am satisfied that all the data that has been imported into the new platform is accurate against the data we supplied and the current NetSolving platform.

I am happy for you to move this to the live site and delete the data off staging.

A file has been uploaded to the SP site which describes our spot checking process/results. There were a few patients which didn't import, possible due to incorrect postcodes. As discussed over email, we are happy for you to provide the details of these patients (as this is a small number) and we can enter these manually or inform the clinical team for them to register directly.

We also could not find any patients on the new platform under COX3P (Manchester local care organisation), despite there being ~20 CYP within the data we supplied.

I am still happy to proceed despite the above as all the data on the new platform is accurate, and as long as we have a list of 'failed imports' we can communicate this to teams.

This was a big task, thank you for completing this so accurately & quickly!

pacharanero commented 11 months ago

This import of patient data into the live platform is now complete. Closing

rcpch / rcpch-audit-engine

Importing patients from old platform #596