clingen-data-model / clinvar-streams

1 stars 0 forks source link

Validate that releases received matches the sequence of releases expected #81

Open theferrit32 opened 1 year ago

theferrit32 commented 1 year ago

Read the release sequence produced by the clinvar-ftp-watcher and use that sequence to validate releases on the broad-dsp-clinvar stream before producing the clinvar-raw stream.

Maybe do in the process drop function, or right before it. When the message is read off the stream the release date should be validated and then halt and don't do any further processing if it doesn't match what is expected.

https://github.com/clingen-data-model/clinvar-streams/blob/86896a6ceebc3ea30a2d0467f433efbedfd10c43/src/clinvar_raw/stream.clj#L288-L303

https://github.com/clingen-data-model/clinvar-streams/blob/86896a6ceebc3ea30a2d0467f433efbedfd10c43/src/clinvar_raw/stream.clj#L381-L383