Lotus Daemon F3 Log Spamming Following NV23 Calibration Upgrade

TippyFlitsUK commented 3 months ago

Checklist

[X] This is not a security-related bug/issue. If it is, please follow please follow the security policy.
[X] I have searched on the issue tracker and the lotus forum, and there is no existing related issue or discussion.
[X] I am running the Latest release, the most recent RC(release canadiate) for the upcoming release or the dev branch(master), or have an issue updating to any of these.
[X] I did not make any code changes to lotus.

Lotus component

[ ] lotus daemon - chain sync
[ ] lotus fvm/fevm - Lotus FVM and FEVM interactions
[ ] lotus miner/worker - sealing
[ ] lotus miner - proving(WindowPoSt/WinningPoSt)
[ ] lotus JSON-RPC API
[ ] lotus message management (mpool)
[ ] Other

Lotus Version

Daemon:  1.28.0-rc4+calibnet+git.ff0e889b5+api1.5.0
Local: lotus-miner version 1.28.0-rc4+calibnet+git.ff0e889b5

Repro Steps

Start Lotus daemon

Describe the Bug

Following the NV23 Calibration upgrade 07/11/2024, Lotus daemon logs are being spammed with the following entries:

2024-07-11T15:53:39.017Z    WARN    f3  lf3/f3.go:135   lost message bus subscription, retrying
2024-07-11T15:53:39.017Z    INFO    f3  lf3/f3.go:124   miner with id 1013 is sending message in F3
2024-07-11T15:53:39.018Z    INFO    f3  lf3/f3.go:124   miner with id 1013 is sending message in F3
2024-07-11T15:53:39.019Z    INFO    f3  lf3/f3.go:124   miner with id 1013 is sending message in F3
2024-07-11T15:53:39.019Z    INFO    f3  lf3/f3.go:124   miner with id 1013 is sending message in F3
2024-07-11T15:53:39.020Z    INFO    f3  lf3/f3.go:124   miner with id 1013 is sending message in F3

Logging Information

2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598417666 +0000 UTC
2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598437705 +0000 UTC
2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598462095 +0000 UTC
2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598480875 +0000 UTC
2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598503485 +0000 UTC
2024-07-11T15:13:17.453Z    DEBUG   f3  gpbft/gpbft.go:1078 {0}: try step PREPARE (round 0, step PREPARE, proposal [AFY2BZACEBWUQVEH@1778294], value [AFY2BZACEBWUQVEH@1778294])
2024-07-11T15:13:17.453Z    DEBUG   f3  go-f3@v0.0.3-0.20240702063402-d48771055cf4/host.go:307  set alarm for 1732-04-01 15:26:00.598522365 +0000 UTC

masih commented 3 months ago

https://github.com/filecoin-project/lotus/pull/12224 in conjunction with the F3 dependency upgrade (to a concrete version) should resolve this issue; but we should confirm the fix at runtime before marking it as fixed.

rjan90 commented 2 months ago

Closing as this has been fixed with the newer versions of go-f3, that is currently in the final stable Lotus release.

filecoin-project / lotus