search

streamnative / pulsar-archived

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org
Apache License 2.0
72 stars 25 forks source link

ISSUE-7622: [Pulsar Functions] How do I change the "subscriptionposition" of Pulsar Functions and the batching parameters? #1264

Open sijie opened 4 years ago

sijie commented 4 years ago

Original Issue: apache/pulsar#7622

Hi,

I am making a comparison between Pulsar Functions and Kafka Streams. I have several questions when using Pulsar Functions.

1) Before creating the Pulsar Functions, I already have a producer. It generates 1000 messages to topic A. Then I start the Pulsar Functions to read data from topic A and do some handling.
I want the Pulsar Functions could read the 1000 messages which has been existed in topic A when Pulsar Functions starts. How to make the Pulsar Functions to read data from the beginning of a topic?

2) Does Pulsar Functions use batching when reading data from the input topics and sending data to output topic? How to change the batching parameters, like BacthingMaxSize, BatchingMaxPublishDelay?

I am looking forward to your response.

Thank you very much
wolfstudy commented 4 years ago

https://github.com/apache/pulsar/issues/6531

wolfstudy commented 4 years ago

The @315157973 is working for this, will unassign me.