search

gchq / stroom

Stroom is a highly scalable data storage, processing and analysis platform.
https://gchq.github.io/stroom-docs/
Apache License 2.0
430 stars 55 forks source link

Finer Grained Processing Control #2114

Open stroomdev66 opened 3 years ago

stroomdev66 commented 3 years ago

It should be possible to choose which nodes process which data by making processor filters target node groups (gh-1623).

p-kimberley commented 2 years ago

Consider using user-defined node attributes to be entered as a processor filter condition. A node to its attributes should be a one-to-many relationship.

p-kimberley commented 2 years ago

Another idea is to allow the user to define a weight for a processor filter. This would add nuance to the existing priority setting and allow users to further prioritise or restrict processor time to streams.

stroomdev66 commented 2 years ago

Also see gh-1622, gh-2330