search

Netflix / conductor

Conductor is a microservices orchestration engine.
Apache License 2.0
12.82k stars 2.34k forks source link

Conductor expire Workflow/Tasks input and output #286

Closed roberto-goncalves closed 7 years ago

roberto-goncalves commented 7 years ago

Hi, everyone!

Well, I'm using Conductor and testing Tasks input's and output's. My question is related to: There is a way of setting a expiration time on Conductor for data? A common workflow on a real-time process its like a 200k keys in a single day, this will get expensive through time. All that I want is to set a time for this data to persist, like one week, for example. This can be possible?

Thank you!

v1r3n commented 7 years ago

@roberto-goncalves Conductor does not maintain TTL for the data. However, there is a remove method for workflows, which you can use periodically to remove workflows - it removes them from Redis and keeps in elasticsearch for any future investigation/records.

https://github.com/Netflix/conductor/blob/master/redis-persistence/src/main/java/com/netflix/conductor/dao/dynomite/RedisExecutionDAO.java#L308

Hope this helps.

roberto-goncalves commented 7 years ago

@v1r3n I will read about it! Thank you!