dora-rs / dora

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.
https://dora-rs.ai
Apache License 2.0
1.5k stars 79 forks source link

Send runs artefacts into a dedicated `out` folder #429

Closed haixuanTao closed 7 months ago

haixuanTao commented 7 months ago

This PR will send runs artefacts into a out folder instead of the previously used OS temp_dir. This makes it easier to check log files as well as make it clearer to segment the logs per runs of a same dataflow.

Exemple of the tree structure of the out folder

image

Current Limitation

As the tree structure is based on the dataflow_id which is random, the dataflow folder order is not ordered from oldest to latest dataflow which can be confusing.

I can prefix the dataflow folder with a timestamp.