Live waveform data in Emap

[jeremyestein]

I think it's time to create this PR now. I would be particularly interested to see @stefpiatek 's feedback.

I appreciate it's quite large, but @skeating has been reviewing it in chunks, going into the sk/waveform-dev branch from which we're now merging. So this is not the first time it's been seen by anyone except me!

waveform_hf_data.md, the main design document, is a good place to start reading.

Project board is at https://github.com/orgs/UCLH-DHCT/projects/3/views/1

[github-actions[bot]]

PR checklist

Default guide for a PR (if multiple PRs for the work, only keep one version of it and link to it on the other PRs)

• [ ] From the UCLH data science desktop, a validation run has been set off
• [ ] load times in UCL teams has been populated with the run information
• [ ] During the run, glowroot has been checked for any queries which are taking a substantial proportion of the total processing time. This can be useful to identify indexes that are required.
• [ ] After the run, look for any unexpected errors in the etl_per_message_logging table, the error_search.sql file on the shared drive can be used for this \\sharefs6\UCLH6\EMAP\Shared\EmapSqlScripts\devops\error_search.sql. Create an issue if you find an unexpected exception and is not related to the changes you've made, otherwise fix them!
• [ ] After the run, populate the end time in load times
• [ ] Let Aasiyah know about the completed validation and give her information on the changes and where to start with the validation
• [ ] Check validation report and give any feedback to Aasiyah if there are any changes needed on her side, iterate on getting the validation to match at least 99% (validation and emap code).