Observablility and metrics

filecoin-project / go-f3

Golang implementation of Fast Finality in Filecoin (F3)

Apache License 2.0

7 stars 6 forks source link

Observablility and metrics #160

Closed Kubuxu closed 1 week ago

Kubuxu commented 4 months ago

We should have metrics around round progression and the percentage of power voted (it might be tricky because we move on once a quorum is reached). OpenCensus is the standard for it in the ecosystem.

[x] signature validatiton time
[x] CPU & memory usage
[x] datastore size

jennijuju commented 1 month ago

add monitoring for metadata size growth

masih commented 1 month ago

@jennijuju Could you point me exactly to what we want to measure as "metadata size growth"?

My initial take is: size growth of every datastore namespace used by F3. Does that sound right?

Stebalien commented 1 month ago

@masih honestly, we can just monitor the "metadata" datastore itself. IIRC, that datastore is usually pretty much empty so it should be mostly F3 stuff.

masih commented 1 month ago

The only remaining item here is metadata size, for which I am not sure if Lotus metrics are exposed. I have posted something on fil-lotus-dev and pending response.

For the rest the dashboard is updated to include them in addition to in-depth validation breakdown time, divergence, cert exchange, cert polling, gossipsub metrics.

rjan90 commented 2 weeks ago

We can close this ticket once the metric for datastore size has been implemented.