cds-snc / scan-websites

On-demand scanning of websites for accessibility and security vulnerabilities/compliance / Analyse à la demande des sites Web pour les vulnérabilités/conformité en matière d'accessibilité et de sécurité
https://scan-websites.alpha.canada.ca
MIT License
12 stars 1 forks source link

Use an event message broker for routing and packet transformation? #55

Open dj2 opened 3 years ago

dj2 commented 3 years ago

Currently we send the API gateway and other ingress data directly to the Lambda handler. This means the hander has to determine what type of data it's handling.

We should investigate setting up an event message broker like Kinesis, Kafka or SQS to ingest the various data streams, transform them to be consistent and then send to the primary API handler. The handler should not have to determine where the data was coming from in order to process but be able to use the transformed data from the message broker directly.

CalvinRodo commented 3 years ago

Just edited this to be less product specific