search

keltia / fetiche-rs

Rust crates for managing Surveillance data — ingress/egress formats for ECTL
MIT License
1 stars 1 forks source link

In `fetiche-engine` tasks are not connected together in any way. #11

Closed keltia closed 1 year ago

keltia commented 1 year ago

The engine has a list of task inside a Job.

At somepoint we may have a convert task that we want to run after a fetch or even during a stream. We should find a way to connect two tasks through a pipe or something equivalent. Do we want these by default, like always run the input of the next task with the output of the previous?

keltia commented 1 year ago

Currently working on a POC here: https://play.rust-lang.org/?version=nightly&mode=debug&edition=2021&gist=364eb78bae028bf6201e0fbd7fd62e82

keltia commented 1 year ago

Implemented in b53d30a3b672cb4537571780deb0631c851ae3ad with a properly setup multithreaded pipeline.