runabol / tork

A distributed workflow engine
https://tork.run
MIT License
599 stars 40 forks source link

request: make get log max page size configurable #347

Open v36372 opened 8 months ago

v36372 commented 8 months ago

Currently it's hardcoded as 50. Would be great if we can configure this param ourselves.

v36372 commented 8 months ago

Also, ability to configure the max size of each log partition would be helpful. I'm currently having too many items, while each item is only 1 line of log. The datatype of tasks_log_parts.contents is TEXT so I don't see why we should't store as much as possible in 1 partition.

runabol commented 6 months ago

Also, ability to configure the max size of each log partition would be helpful. I'm currently having too many items, while each item is only 1 line of log. The datatype of tasks_log_parts.contents is TEXT so I don't see why we should't store as much as possible in 1 partition.

While not configurable yet, the log shipping on the latest (0.1.73) version will buffer log entries for upto a second. In my tests it significantly reduces my log entries.