search

wso2 / streaming-integrator

A stream processing runtime that allows connecting any streaming data source to any destination and act on it
Apache License 2.0
113 stars 50 forks source link

Same file gets read periodically when state persistence is enabled #168

Closed dilini-muthumala closed 3 years ago

dilini-muthumala commented 3 years ago

Description: Originally reported by @ramindu90

Reproducing steps:

@source(type='file', mode='line', dir.uri='directory/path', action.after.process='keep', tailing='false', @map(type='csv')) define stream SweetProductionStream (name string, amount long, value long);

Enable state persistence

You may see, the same file getting read at each interval of persisting.

Affected Product Version: SI 1.1.0

OS, DB, other environment details and versions:

Steps to reproduce: Given above.