Energinet-DataHub / ARCHIVED-geh-aggregations

This project aims to create an engine that is able to do calculations on billions of metering points and deliver the results within minutes
Apache License 2.0
2 stars 0 forks source link

616 enabler: Fix high frequency concurrent master data integration events #734

Closed kristianschneider closed 2 years ago

kristianschneider commented 2 years ago

The current master data integration event ingestion concept is not able to correctly handle events coming in at a high frequency (<400ms) This is due to the distributed nature of the ingestions.

-[] AC1 As a team evaluate different proposals and decide on an approach -[] AC2 Write integration tests that showcase the problem ie: Multiple concurrent events that change master data and its properties. An example could be: TestCase -[] A3 Ensure that we can handle events in the wrong order. for example, connected - created events. -[] AC4 Implement the decided concept that passes the integration test