search

flier / tokio-kafka

Asynchronous Rust client for Apache Kafka
Apache License 2.0
31 stars 1 forks source link

Prefetch #29

Open polachok opened 6 years ago

polachok commented 6 years ago

We should have some kind of prefetch, so that while the current batch is processed by stream consumer we could get the next batch ready.

flier commented 6 years ago

I have created a prototype to prefetch records, what's your suggestion?

polachok commented 6 years ago

I came to alternative solution https://github.com/polachok/tokio-kafka/commit/b138ff936f3ee93aaea678a3067208892ed4597c

flier commented 6 years ago

ok, move records to inner will be ok, but the record should be return after step the state machine