search

OpenFn / lightning

OpenFn/Lightning ⚡️ is the newest version of the OpenFn DPG and provides a web UI to visually manage complex workflow automation projects.
https://openfn.github.io/lightning/
GNU Lesser General Public License v3.0
129 stars 36 forks source link

Add WorkOrder/Run Diagnostics #2419

Open rorymckinley opened 2 months ago

rorymckinley commented 2 months ago

Create a code that can be run from IEx to dump run diagnostics for a given workflow's workorder/runs (over a specified time period) . The intent is to identify if the data provides any useful info relating to performance bottlenecks wrt the worker/Lightning interaction.

For now, maybe dump some high-level stats to the console - but, if the data has value this could perhaps be fed into existing telemetry or dumped as CSV etc etc.

rorymckinley commented 1 month ago

@taylordowns2000 I got started on this before I jumped on to the query optimisation. Just want to check if this is still required?