File sent as list of JSON's causes logging failure

[FreddieMatherSmartDCSIT]

If a list of events as JSON objects is sent to the Protocol Verifier Kafka AER Reception topic (using the correct payload structure) the PV will fail and the Reception log file will print a long series of never ending ] within the file. This causes the log file to breach the log rotation size and files of up to 8GB have been seen.

Steps to reproduce:

• Use a kafka producer to send a list of JSON (events) to the AEReception ingestion topic
• Check the size of the Reception log file
• tail the log file to see a large out put of ]

[cortlandstarrett]

Do I understand that you attempted to send an array of events to the topic rather then sending them one at a time?

[FreddieMatherSmartDCSIT]

Yeah sorry my python brain has me talking about lists! Yes we sent an array of events and observed that peculiar behaviour in the logs

[cortlandstarrett]

One more bit of clarification. Did you prepend the string length (our magic length number) to this array?

[FreddieMatherSmartDCSIT]

Yes we prepended the string length to the array.