search

DataCater / datacater

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.
https://datacater.io
Other
82 stars 4 forks source link

fix(streams/inspect): Overwrite `max.poll.records` #108

Closed flippingbits closed 1 year ago

flippingbits commented 1 year ago

The /streams/:uuid/inspect endpoint allows to provide the parameter limit, which defines the number of to-be-retrieved records.

Internally, the endpoint is using Kafka's Consumer API for retrieving the records. Thus, the number of retrieved records is additionally limited by the consumer property max.poll.records.

Unless the stream spec overwrites this property, max.poll.records defaults to 500.

To enable users to provide any value for the limit parameter, we now overwrite max.poll.records when retrieving records and set it to value.

sonarcloud[bot] commented 1 year ago

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

50.0% 50.0% Coverage
0.0% 0.0% Duplication