Chia-Network / chia-blockchain

Chia blockchain python implementation (full node, farmer, harvester, timelord, and wallet)
Apache License 2.0
10.83k stars 2.02k forks source link

[BUG] Don't have rc hash [hash content]. caching signage point xx #6204

Closed justwjx closed 3 years ago

justwjx commented 3 years ago

Describe the bug Today it just happen on my Ubuntu Full Node farmer, platform is NUC11i5, so it may be a little different from https://github.com/Chia-Network/chia-blockchain/issues/1796, hardward performance should not be a root cause of this kind of issue. More detailed log as below:

2021-05-29T19:46:14.432 full_node chia.full_node.full_node_store: INFO Don't have rc hash 4aa5b7aed566cdd65b44c57ff268636d21cadc276dfb56791b52522e10c5112f. caching signage point 57. 2021-05-29T19:46:14.440 full_node chia.full_node.full_node_store: INFO Don't have rc hash 4aa5b7aed566cdd65b44c57ff268636d21cadc276dfb56791b52522e10c5112f. caching signage point 58. 2021-05-29T19:46:14.448 full_node chia.full_node.full_node_store: INFO Don't have rc hash 99cbf7650ed87fcac1bd4d8cbbd848631afe8e7d3be26e056048030fd92bd7b6. caching signage point 59. 2021-05-29T19:46:14.455 full_node chia.full_node.full_node_store: INFO Don't have rc hash 99cbf7650ed87fcac1bd4d8cbbd848631afe8e7d3be26e056048030fd92bd7b6. caching signage point 60. 2021-05-29T19:46:14.463 full_node chia.full_node.full_node_store: INFO Don't have rc hash 99cbf7650ed87fcac1bd4d8cbbd848631afe8e7d3be26e056048030fd92bd7b6. caching signage point 61. 2021-05-29T19:46:14.470 full_node chia.full_node.full_node_store: INFO Don't have rc hash 6be07cb8dec71f712ece058bbc54388eafd4df2e6c01b40e561205df8dacac1f. caching signage point 62. 2021-05-29T19:46:14.505 full_node chia.full_node.full_node_store: INFO Don't have rc hash 6be07cb8dec71f712ece058bbc54388eafd4df2e6c01b40e561205df8dacac1f. caching signage point 63.

And together with plenty of message (looks like hundreds of):

2021-05-29T19:46:24.663 full_node chia.full_node.full_node_store: INFO Don't have challenge hash ff17784c55a0a931fa61b2b1bac7c83f53bc5d7d1fb1445087e86f7d49c7ac6c, caching EOS 2021-05-29T19:46:24.664 full_node chia.full_node.full_node: INFO End of slot not added CC challenge 47fec706f64a432fd45c3c143694f7f5927b5bda2622a9427934031e8991e415 2021-05-29T19:46:24.795 full_node chia.full_node.full_node_store: INFO Don't have challenge hash ff17784c55a0a931fa61b2b1bac7c83f53bc5d7d1fb1445087e86f7d49c7ac6c, caching EOS 2021-05-29T19:46:24.795 full_node chia.full_node.full_node: INFO End of slot not added CC challenge 47fec706f64a432fd45c3c143694f7f5927b5bda2622a9427934031e8991e415 2021-05-29T19:46:24.876 full_node chia.full_node.full_node_store: INFO Don't have challenge hash ff17784c55a0a931fa61b2b1bac7c83f53bc5d7d1fb1445087e86f7d49c7ac6c, caching EOS 2021-05-29T19:46:24.876 full_node chia.full_node.full_node: INFO End of slot not added CC challenge 47fec706f64a432fd45c3c143694f7f5927b5bda2622a9427934031e8991e415 2021-05-29T19:46:24.927 full_node chia.full_node.full_node_store: INFO Don't have challenge hash ff17784c55a0a931fa61b2b1bac7c83f53bc5d7d1fb1445087e86f7d49c7ac6c, caching EOS 2021-05-29T19:46:24.927 full_node chia.full_node.full_node: INFO End of slot not added CC challenge 47fec706f64a432fd45c3c143694f7f5927b5bda2622a9427934031e8991e415 2021-05-29T19:46:24.931 full_node chia.full_node.full_node_store: INFO Don't have challenge hash ff17784c55a0a931fa61b2b1bac7c83f53bc5d7d1fb1445087e86f7d49c7ac6c, caching EOS 2021-05-29T19:46:24.931 full_node chia.full_node.full_node: INFO End of slot not added CC challenge 47fec706f64a432fd45c3c143694f7f5927b5bda2622a9427934031e8991e415

Also seems harvester does not participate in any challenage for 70+ seconds due to missing a sequence of Challenge, 64/64 to 4/64 total 5 challenges are permanently missed out

cat ~/.chia/mainnet/log/debug.log | grep /64

2021-05-29T19:44:48.532 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 54/64: CC: 94dc371fcfb1c263150d1726f0f64c68857259abe860dd930553e7f83f557394 RC: 8e27d78c364cb3d464a07206531eb6cfeaea047c4363ccf348547fbc6c1f427f 2021-05-29T19:44:59.813 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 55/64: CC: 91eecd4fe2f8b04f47517bb7e01cb945e67e088c83d6fb8f5d95f5be250e3c9d RC: f2a716cdb3c66c73c69c8008dc9e0ff442fc5ae32b8acd8b8b8b2b26b55f7d58 2021-05-29T19:45:08.616 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 56/64: CC: 76cdd017523f1539000a6eea67a5b5a9ee2984fb28d671f7dc3ae7ebd1a2b108 RC: 3209a79b2045003bae5b59f3239ddd776e0512c48df5363235f3d13fae359d53 2021-05-29T19:47:15.277 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 57/64: CC: 183d8c135f0e8b4458c7ac170b3bbfa31b536ade0069eb126a9bcb3232909fb2 RC: 7734a3601e5f43153e2eb6ec6fdae369dde973ec159b375946fa60966560192d 2021-05-29T19:47:15.278 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 58/64: CC: 26dab6cccc1fabfe5b46110db4d83982f7b5daba1150a6feed3285f185920392 RC: bb3c7a61237364d6a65e2f49f8d553799cd54c55e0e2370086575f424b736bb1 2021-05-29T19:47:15.844 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 59/64: CC: 67738feb22d03e3539d467382d1765500e67e63bea4a86a1e65366ed3fb5f123 RC: 6ea8b8c8275f21d17c23bffc0111e45c727901aaf9ff8cb7ed7fb51f1f5764ba 2021-05-29T19:47:15.845 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 60/64: CC: 7e72b53c4040d8d201410f63a2a520675a81e2ba110755424c7e81d18d309fc9 RC: d55cfffe8d879280119d2f7ca0f0eb4defc814dfba41bd268c2a15bfb713f800 2021-05-29T19:47:15.845 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 61/64: CC: 4640efba187c599b41dad2523df5dd88241c37467a3f1432487f11f8062f8cb9 RC: 7384586b5482539286edfe4f39985e1410209c9e55aecd8a6cdac12ec166ecf3 2021-05-29T19:47:16.282 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 62/64: CC: 82d69f611790cab2d09f26f36118d03b80e9f811e4738dd8ae81ec391ab391f1 RC: 141ba06ab6cba9fd9201878423a993a01740742c38affa409bf4d67bd11b7b13 2021-05-29T19:47:16.283 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 63/64: CC: fa7e013fa917e9f451fceae2fadfc2151096e9ee363dc28352ba39c530e21d1b RC: 8d2b53601680d8d004b685d7d683546ffdc6d1471d979b86d807317ff1e29409 2021-05-29T19:47:20.113 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 6/64: CC: 68ea7225d3f8b40d905348a2cd59b8c9d1d1b0ec11614860b2dfe9038e927348 RC: b14f951fcaa0be12aed16272e455652faecf94543e8d77cf66976e04ac1694d2 2021-05-29T19:47:29.306 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 7/64: CC: a1d1cd3ea192e0764974b68856531ba2d2a87bf5ae88f0563e18f64b2af953bb RC: 3bce4aa6e32a1433a88d0a64f7ff8a1b3022fabaab84107a117903c709c2a97e 2021-05-29T19:47:38.150 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 8/64: CC: bc8d92ce53e2306396542d53d7d1d014e99b876b60442a35de8b695b590c48f5 RC: f868220c0f37b34b75472cf29c01e6f1b5c1632c4b192deed347e0de3ddc27e1 2021-05-29T19:47:43.797 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 5/64: CC: 70805f9cb1c33243a225fbaf4e8f72f05a37542908a936b81223f3f9587cf671 RC: 73f027790c8f9a22c6ddd584fa099e99685052c9c800c97a5167094276c45e62 2021-05-29T19:47:47.902 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 9/64: CC: 53e7e9e2c50702455e97869954f758670b32fc1927e7c9e889136ab868d9f50d RC: cf3f42e70a9fd60a1663b95f45a29f1c40ff57f26160b383442356bb85c706d1 2021-05-29T19:47:59.780 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 10/64: CC: 13c8cb6dfcd7241ee9630d21fae5acf5ec46b0ae246ca50550c90daa9e424cd2 RC: 1f7625101a807ae6b021f2083e5ca762aa20d5b5ba6246bb7c1b700a156585e9 2021-05-29T19:48:14.788 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 11/64: CC: 23cde91d0da9948a0b3d5f53d57ac17533ef06754badf60de24dcc0a42880041 RC: 2567e0feea03eaa8241dcfd6f5d09da00e1c99790aa633bc94fdffd7bd1d88de 2021-05-29T19:48:25.699 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 12/64: CC: cfa24ff861bf18e86f59dcc9ddf77cf154b43259aed34fec872e315c688ce198 RC: 1bc28148179db1628b9a0278fbd7ddc90f97ce9df2a51dbfd25542312add0e67 2021-05-29T19:48:35.062 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 13/64: CC: d8b25d325c06c93ee60feb5e0c5ed639073883a84c45ab2adc0915bd8316570a RC: 918f52d3b19b8b7033871153f962dfdbc45106b203515aa70fda353e6fc03dc0 2021-05-29T19:48:43.518 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 14/64: CC: 6269abf86f261c607845ac6673f232bf31ecb3cc3a95f5578d03ab493e73b67f RC: f8373abf0af999a003101a9b0966158d9a59f2014eda0e413bcb4f439d336be9 2021-05-29T19:48:52.763 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 15/64: CC: 2eb9cad171cd028088beb3982050ed264dbafbe6d2e740284cbac2593c6bada6 RC: 63bf76c977af194c8976675f6958e27c9ad755ecba05f5682cdaaf935db2848f 2021-05-29T19:49:11.847 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 14/64: CC: 6269abf86f261c607845ac6673f232bf31ecb3cc3a95f5578d03ab493e73b67f RC: eb58c4e11c54b62878515cbec47102ac9a8ff974c384147b141ded41674affe2 2021-05-29T19:49:22.094 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 15/64: CC: 2eb9cad171cd028088beb3982050ed264dbafbe6d2e740284cbac2593c6bada6 RC: eba2fbe1aea2ccf5e5236f8510b0089112a213ee1018d490829aa19e8a1f4fcc 2021-05-29T19:49:27.255 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 16/64: CC: 18142b2be8e46437ae36167ca7e22c3a4da78ddbd0a432c5408c562a62f8e132 RC: 84a80c6a6315bac4263dcd11547ce1efcf577fb469362b8ae54c69f74b84c6c4 2021-05-29T19:49:37.432 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 17/64: CC: cc80d367715f781e21baa3f48d940a124eb4bbafe08a8fc5677293b0f6c943a2 RC: 2447f4c81c4c4c9c3004b89f7d092e76ec27f82e0f35f89dfd6367bc23354b83 2021-05-29T19:49:45.970 full_node chia.full_node.full_node: INFO ⏲️ Finished signage point 18/64: CC: 7a7060e90ba9c4159ca54d7c614f96cb2cae5d7c4edf98d5cca8012d3c4b3b52 RC: 4aeac6e07232a4bb84faedb20b29f08a8b8ce0028244f99bb0ffb06afe7905f6

github-actions[bot] commented 3 years ago

This issue has been flagged as stale as there has been no activity on it in 14 days. If this issue is still affecting you and in need of review, please update it to keep it open.

github-actions[bot] commented 3 years ago

This issue was automatically closed because it has been flagged as stale and subsequently passed 7 days with no further activity.

djdookie commented 3 years ago

Still a (quite newer) problem for my Ubuntu 20.04 on Raspi4, losing lots of partials this way now.