search

RADAR-base / RADAR-Questionnaire

Questionnaire mobile application (Active App) for RADAR-base
https://radar-base.org/
Apache License 2.0
18 stars 14 forks source link

Improve sending of data to Kafka #1689

Closed mpgxvii closed 5 months ago

mpgxvii commented 1 year ago

When the app tries to send small amounts of data to kafka, there are no problems and the performance is good (few ms). However, when larger data gets sent it takes longer (1-2s for around 1k records). Improvements can be done in 2 ways:

  1. Encoding and sending as binary
  2. Compressing with gzip or lzfse

As suggested here: https://github.com/RADAR-base/RADAR-Questionnaire/pull/1682#issuecomment-1558907649

mpgxvii commented 5 months ago

Fixed in #1706