Investigate extracts to identify areas of code which can be cut down for processing times

[Jennit07]

Ones which stand out to me as worthy of some investigation to potentially speed up:

• [ ] Social Care Demographics
• [ ] Social Care Client
• [ ] Social Care Care Home
• [ ] Social Care Home Care
• [ ] Social Care SDS
• [x] Social Care A&T
• [ ] District Nursing
• [ ] Prescribing

Originally posted by @Moohan in https://github.com/Public-Health-Scotland/source-linkage-files/issues/549#issuecomment-1495650764

[lizihao-anu]

targets with future in Posit running time for each item:

• sc_demog_lookup [2.972 minutes]
• sc_client_lookup_1920 [1.614 minutes]
• all_care_home [11.471 minutes]
• all_care_home_extract [1.225 minutes]
• source_sc_care_home_1920 [6.794 seconds]
• all_home_care_extract [2.754 minutes]
• all_home_care [6.132 minutes]
• source_sc_home_care_1920 [5.734 seconds]
• all_sds_extract [50.751 seconds]
• all_sds [33.984 minutes]
• source_sc_sds_1920 [3.235 seconds]
• all_at [34.543 minutes]
• source_dn_extract_1920 [3.112 minutes]
• prescribing_data_file_1920 [1.198 seconds]
• prescribing_data_1920 [2.01 minutes]
• source_prescribing_extract_1920 [1.014 minutes]

So, all_sds and all_at will need investigation most. I will check if we could improve the efficiency.

[github-actions[bot]]

This issue is stale because it has been open approximately 5 months with no activity.