RENCI / ASGS_Web

Codebase for the ASGS Monitor prototype
0 stars 0 forks source link

Update message handling to recover from interrupts in connections #10

Open lstillwe opened 2 years ago

lstillwe commented 2 years ago

The message handling software (from both normal and run.props messages needs to be refactored to handle interruptions in connections to the DB and the message queue. For DB connections, the software could check the connection before writing. If no connection exists, then re-try a few times before quitting (and perhaps notify an admin somehow. For Rabbit MQ connections. A timer could be set up to go off after a certain time setting (maybe 24hrs) and check the connection to make sure it is viable - if not retry connection. Either way and admin should be notified that no message have been received in 24hrs.

lstillwe commented 2 years ago

Phil delivered code to address DB connection. Lisa will have to update code for message queue connection