filecoin-station / spark

💥 Storage Provider Retrieval Checker as a Filecoin Station Module 🛰️
https://filspark.com
Other
7 stars 2 forks source link

Report duration of failed retrievals #44

Open bajtos opened 9 months ago

bajtos commented 9 months ago

At the moment, most retrievals (>99.99%) fail. We are not measuring the duration of failed retrievals, and therefore we don't know how many tasks can an honest checker node complete every round.

Let's start collecting that data.

bajtos commented 9 months ago

Oh! We don’t have any catch block, that’s why we are not setting end_at. And I am guessing that PG or node-pg converts null to Date(0).

https://github.com/filecoin-station/spark/blob/a6098496c67d016794dd98af5b08d33bcf6e8157/lib/spark.js#L97-L99

See also https://github.com/filecoin-station/spark/issues/43#issuecomment-1832209200

bajtos commented 9 months ago

Figure out how to handle measurements with end_at set to Date(0) - they are clearly invalid, but why are we receiving them? Are they produced by fraudulent nodes?

This will be fixed by https://github.com/filecoin-station/spark-api/pull/160