Observability of Node-RED instances

FlowFuse / flowfuse

Build bespoke, flexible, and resilient manufacturing low-code applications with FlowFuse and Node-RED

https://flowfuse.com

Other

263 stars 63 forks source link

Observability of Node-RED instances #223

Open sammachin opened 2 years ago

sammachin commented 2 years ago

Description

Display and record/chart the resources used by each project eg:

CPU
Memory
Storage (do flows have access to any persistent storage?)
Bandwidth (volume and throughput)

Users should be able to view this for any project they are in a relevent team for, admin should be able to view all projects.

### Tasks
- [ ] CPU
- [ ] Memory
- [ ] Persistent Storage
- [ ] (Bandwidth)
- [ ] https://github.com/flowforge/flowforge/issues/2755

hardillb commented 2 years ago

Limits for this (on platforms that support it) will be controlled by Project Stacks and covered by #285

Do we still need this epic now we have #285?

sammachin commented 2 years ago

yes this is about visualising what is being used rather than setting limits which is what a stack does, so you need to see what you are using to know how close a project is to needing to move to a larger stack

sammachin commented 2 years ago

as admins of ffcloud we also need this view to manage the platform

joepavitt commented 2 years ago

@sammachin @hardillb Just to clarify here... a given project will have limits on CPU & Memory that we want to be able to monitor. Defined by the Project Stack. Will we only know present CPU usage, or will we store historical data?

What is our current state with Storage? Do we have limits in place for this, and could you provide some examples pleas?

I don't recall us having any bandwidth-based metrics as things stand?

hardillb commented 2 years ago

@joepavitt CPU & Memory is to be worked out, it may vary based on environment, but assume we have some history

There is no Storage (and I will be very opposed to adding any as it will be a real pain to implement on docker/k8s) the file handling nodes should have all been disabled.

I don't think we can measure bandwidth on a per project basis, so again no data.

joepavitt commented 2 years ago

Thanks @hardillb - does beg the question though, what's the value of FF Cloud deployment to Devices if we can't use/test any of the nodes we'd want to use on devices?

hardillb commented 2 years ago

That is a separate question

knolleary commented 1 year ago

Noting we've had a few enquires on this topic recently - I would label it 'observability of Node-RED instances'