search

flashbots / mev-boost

MEV-Boost allows Ethereum validators to source high-MEV blocks from a competitive builder marketplace
https://boost.flashbots.net
MIT License
1.16k stars 205 forks source link

Frequent "no bid received" #262

Closed moshe-blox closed 1 year ago

moshe-blox commented 2 years ago

Environment

We're rocking 2500 validators with..

Lighthouse: v2.5.1
mev-boost: v0.7.10
Network: prater
Relay: https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net

Issue

About 60% of the proposals fallback to local EE (the other 40% are successfully built via mev-boost).

When it happens, we see these errors in Lighthouse:

Aug 21 14:02:25.958 INFO Requesting blinded header from connected builder, parent_hash: ..., pubkey: ..., slot: Slot(...), service: exec
Aug 21 14:02:26.258 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec

And these errors in mev-boost:

time="2022-08-21T14:02:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xdffccc7de563f586e027d563c7e5df860155d2c0aecc87f392aac8aece7e9fc4 pubkey=0x884fcee670d202053d48e64561d3f53f8478fa682f6f2a9676db082c8aa409e3b9fc6f132665d1f968758346a612c8cd slot=3715212
time="2022-08-21T14:02:26Z" level=info msg="http: GET /eth/v1/builder/header/3715212/0xdffccc7de563f586e027d563c7e5df860155d2c0aecc87f392aac8aece7e9fc4/0x884fcee670d202053d48e64561d3f53f8478fa682f6f2a9676db082c8aa409e3b9fc6f132665d1f968758346a612c8cd 204" duration=0.096443931 method=GET module=service path=/eth/v1/builder/header/3715212/0xdffccc7de563f586e027d563c7e5df860155d2c0aecc87f392aac8aece7e9fc4/0x884fcee670d202053d48e64561d3f53f8478fa682f6f2a9676db082c8aa409e3b9fc6f132665d1f968758346a612c8cd

Notes

Does anyone else have this issue as frequently or at all? Thanks 🙏

metachris commented 2 years ago

This is not an error, just that the relay doesn't have a block for these slots at the time you requested. I'm investigating the frequency

metachris commented 2 years ago

For the slot in your log we just had no bid/block available. Sometimes that's just the case. How often are you seeing no bids?

moshe-blox commented 2 years ago

How often are you seeing no bids?

Out of the last 19 proposals, 15 had no header available.

Here's the Lighthouse logs:

"Requesting blinded header" -> ("No payload" | "Received a payload")
Aug 22 21:41:01.940 INFO Requesting blinded header from connected builder, parent_hash: 0xd0224de3027fff2925e783b92a99e9bf0e561ec2a51824b34c7573406f4e7730, pubkey: 0xa264df785d13ac140e347dc0883f1190f1a330dc2e17084d1dbe887af99408e1c6c3dfd76a1149e0dc386e442384a783, slot: Slot(3724705), service: exec
Aug 22 21:41:02.281 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 22 22:07:38.416 INFO Requesting blinded header from connected builder, parent_hash: 0x8f46f552badbe8898ff14995d3133de45b3969b8c2e73bc44b4657376d52b7b5, pubkey: 0xa3ddc5d006bb61673cc1b6433a960c57053c0c5de9469faeec8c76a15242523b3e662e53b51a3ee7fb1e0f37aa13bdcd, slot: Slot(3724838), service: exec
Aug 22 22:07:38.610 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 01:37:50.017 INFO Requesting blinded header from connected builder, parent_hash: 0xfb76cf840f0b93b177514419c3b71360748247b22123c821161691072666641e, pubkey: 0x89aa21d548a751239b188618884230208e563e7b9a2ce2e244079b806fa51e0e970bd399b3d1a395aa10d0a000a95f08, slot: Slot(3725889), service: exec
Aug 23 01:37:50.237 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 01:39:14.052 INFO Requesting blinded header from connected builder, parent_hash: 0x341e324c976da88328a0ae7ac6f49eb7843d6ea6199383c65ef776c30ba37284, pubkey: 0xacafdb50145fb5c54c313bb129a364b0b2a870ad0af0b48208aa61097ae0d0a16b9c882e59e3f9ef4757687b0ab965d8, slot: Slot(3725896), service: exec
Aug 23 01:39:14.158 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 01:39:50.041 INFO Requesting blinded header from connected builder, parent_hash: 0x08010246733584af06482a7c3800382f45cbce8a90213d8acc8d57cbc38a4403, pubkey: 0xb2d9d0147b2700569078b6add3c97b2274389f931417050051b876a39988a8769f53b6acd775974c0efa3bc711f7acb2, slot: Slot(3725899), service: exec
Aug 23 01:39:50.137 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 02:49:49.754 INFO Requesting blinded header from connected builder, parent_hash: 0xa109d5ec3995c574299ecd137fd67edc30d09a2784202e771fddda4b4bf73932, pubkey: 0x99fe38b0ad9b13b91b52bc7388ba4a14f8ad50418265ea722513faa92c087b3692688aea8fcd87b7c1f75a2ac58f287f, slot: Slot(3726249), service: exec
Aug 23 02:49:49.882 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:09:02.726 INFO Requesting blinded header from connected builder, parent_hash: 0x8a5cc12ac11b35e3135266bd1d325f07449caefadc7f9c22479b09e41f9300c4, pubkey: 0xae08a6eb74cfb81de0c4b54a4e3fdc047788dd3f4ef3d113001ea9c7658e8959760b5ca8e505545f55d1501d10f94322, slot: Slot(3726345), service: exec
Aug 23 03:09:02.827 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:01.911 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:02.003 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:02.354 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:02.442 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:15.956 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:16.089 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:18.029 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:18.158 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:33.499 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:33.597 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 03:57:34.201 INFO Requesting blinded header from connected builder, parent_hash: 0x1e1edd08254c913f698e41b99f39826ec58ac690056b114f52aa37680c364550, pubkey: 0xa2e1f422aecb78e8c6a95bb92e38d936706547e32b4190b2d8efb2590fcb4b0aebf56f56c3ca8006e9a75ab3c06287b1, slot: Slot(3726585), service: exec
Aug 23 03:57:34.293 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 04:49:13.485 INFO Requesting blinded header from connected builder, parent_hash: 0xfb2f234f8af4dc2675dc2e4295e909931382ed4bd9dd0c9e7952fa14f2c5e7d8, pubkey: 0x855a3553a91a7445547fbc146bf5dbeb979df68dd80d2c16a9d0168bf4d4fbc9e26c3d133522efb79a280419c7b58c3c, slot: Slot(3726846), service: exec
Aug 23 04:49:13.605 INFO Received a payload header from the connected builder, block_hash: 0xcd0b64bb12692051e6acd547b1b3098c325a9356333dabcc27f0d80553d3a84d, service: exec
Aug 23 05:46:50.441 INFO Requesting blinded header from connected builder, parent_hash: 0xc8571f4a0cd30d4ded3d21d89a441b6e306afa47d8cef12c4e68bcfc392bc6c3, pubkey: 0xaac7021466f3c24a916b81a4a382cd39dd1a3d3491f0b040ea4a99a004df98dd554c5397cc7d68ad70d8753b42641f39, slot: Slot(3727134), service: exec
Aug 23 05:46:50.550 INFO Received a payload header from the connected builder, block_hash: 0x8fb3f29d79f0d48218501ec68dcce5caa10a37351ba8bea0d902afff8452a434, service: exec
Aug 23 07:14:49.952 INFO Requesting blinded header from connected builder, parent_hash: 0x105ce0fab993095b66f7050805ac2f81603d7ee4bb984f8005b7aa652511cb22, pubkey: 0xa364d7e248be0cba9df35f55d7ad0e1275ea0d60e0d10191666234ad3f5e9b7dd4d98df78158125dcc0108ddc5fad0ca, slot: Slot(3727574), service: exec
Aug 23 07:14:50.062 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 08:11:26.044 INFO Requesting blinded header from connected builder, parent_hash: 0xf3123bb99983c39e618cdcb8714bcbaac786ddc28a782fe6d1d957bf382b4844, pubkey: 0xa8569dd74169b9482349fa2a39637c335a8322bfdb39cd2b5f67d88b45cbd84a46c6a5c071cb5d12e7657add22923409, slot: Slot(3727857), service: exec
Aug 23 08:11:26.171 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 08:37:37.723 INFO Requesting blinded header from connected builder, parent_hash: 0x044481d7b931ee0c3ad7362dde0cb5232a1bd83a3cf7693b812f5707ea294ae0, pubkey: 0xaf1024c0a04b17e7356d641b8269dba5345515c705e160fbe0b674e6a6b95921ede4c5cf03580c595318e97341d2576a, slot: Slot(3727988), service: exec
Aug 23 08:37:37.835 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 09:31:38.182 INFO Requesting blinded header from connected builder, parent_hash: 0x943ffbb0fd2c3e4a38cc8d106af3d246177b4851654131569bb2b7593afae54e, pubkey: 0x8bec03f8e257f73cd24846ad5619a5e662600d610f6d733908e2aa7c7dc90c8f467a076c978a540111df332a81d194dd, slot: Slot(3728258), service: exec
Aug 23 09:31:38.375 INFO Received a payload header from the connected builder, block_hash: 0xf9e2a9f92dfacf27ff68681602832abc714f9b58b5e564124b42496d553b0c86, service: exec
Aug 23 09:48:49.956 INFO Requesting blinded header from connected builder, parent_hash: 0x5f71494beb5c1554d8086456e7384f085c4dd73a487c4bb61438477adab1d601, pubkey: 0xa2f34dd4fae141575d52aa4a05dfff239b145bc220381e4e5eca8a469b1243feb65841d57e1be4fbc8e00a0c4caa7065, slot: Slot(3728344), service: exec
Aug 23 09:48:50.050 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 09:54:49.962 INFO Requesting blinded header from connected builder, parent_hash: 0xdc05ada7f23dc0b725c1f2a3f78ab1bdcdfed2b2a938e4ef2371af7ec1105d2a, pubkey: 0xb2ecbf460951e6391ce03ece46c90443e7eed8e6da08be18e12ff0074a355467c906e5c0c492e327c32f8eabeced8aa2, slot: Slot(3728374), service: exec
Aug 23 09:54:50.061 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 10:09:49.621 INFO Requesting blinded header from connected builder, parent_hash: 0xb4ab69f3c4c0498ae8e4e4bcdcb063dce619f4c0f76440445aaedbacea7ccb82, pubkey: 0x8de854ff8945f1f2069f5d38569e23fab7a1a24440ade9fdff1db66f8bec096aa11af33688157a5965f2f42efffbf7f0, slot: Slot(3728449), service: exec
Aug 23 10:09:49.990 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Aug 23 10:28:37.794 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:28:37.897 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 10:28:38.250 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:28:38.345 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 10:28:54.489 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:28:54.638 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 10:28:55.336 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:28:55.419 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 10:29:11.081 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:29:11.082 INFO Requesting blinded header from connected builder, parent_hash: 0xbb6c7175b5c12c60bc2333567dc96a5e7b1bffd15079870af97504ec7477653e, pubkey: 0x81a91a53c31dbec2464f0f649e9930520f7d2fbd73a2abef98642b9eee943c89b48db02b06420ba6723743280e989a99, slot: Slot(3728543), service: exec
Aug 23 10:29:11.196 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 10:29:11.258 INFO Received a payload header from the connected builder, block_hash: 0x18d78abceb5123b5f3eba77851058471fcc2afaf2d87c7e204148eb1904b3816, service: exec
Aug 23 12:46:38.001 INFO Requesting blinded header from connected builder, parent_hash: 0xc15dd742db639ed18eacef7c86f170283c7b87cc1a3d1bab58e18b3920afced6, pubkey: 0x991b8468cdea96fdc2b04b72a6fb1d80b19768c14a9a8484847dd612adb613c2db6372a3ad7ca60b3f69ec8ba9b26991, slot: Slot(3729233), service: exec
Aug 23 12:46:38.103 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec

Note: There are multiple attempts for slots 3726585 and 3728543 with the same results, but I avoided double-counting them.

moshe-blox commented 2 years ago

@metachris Do you think this issue might be caused by improper validator registrations?

We post registrations to Beacon nodes a bit differently — each registration is sent every 12 seconds with the timestamp set to the time of the current epoch's first slot.

metachris commented 2 years ago

If the validator registration has been accepted by the relay at least once in the past, then this wouldn't be the issue.

I wonder though why do you do this way of validator registration? The standard way is to keep resending the last registration once per epoch, and only create a new registration once one of the preferences changes 🤔

moshe-blox commented 2 years ago

If the validator registration has been accepted by the relay at least once in the past, then this wouldn't be the issue.

I wonder though why do you do this way of validator registration? The standard way is to keep resending the last registration once per epoch, and only create a new registration once one of the preferences changes thinking

We blindly re-send prepare_beacon_proposer and register_validator every slot because Beacon nodes forget preparations after restarts (which we do often), but since registrations are kept in relays/builders, I realize now that this isn't necessary for register_validator 😅

Thanks for the tip 🙏

moshe-blox commented 2 years ago

Update: We've reduced the frequency of register_validator (so we don't spam our Beacon nodes anymore) and the problem seems to have gone away since. Now we see this error very rarely.

Unfortunately, we didn't test this on Prater yet, but Sepolia is doing much better, so I'm closing this issue for now.

If anyone sees this error, just comment and I'll re-open.

moshe-blox commented 2 years ago

Update: this started happening again on both Sepolia & Prater.

I've gathered & organized proposals with their mev-boost/Lighthouse logs, in case you want to investigate this. @metachris

Last 24 hours on Prater we had 30 proposals, of which..

Relevant mev-boost logs (only register_validator logs omitted):

time="2022-09-10T17:55:03Z" level=info msg="best bid" blockHash=0x1574a79194496871accf2e766caca0914a270f7a0855b6f6a86b828ecab195dd blockNumber=7567053 method=getHeader module=service parentHash=0xb335d6f873655cc73a85e94e1e4faae58d5512ce49ffd23f455a822b1e76c6f0 pubkey=0x91cefe4d5fed257b79603888c303638b37f98926537d8b3f4f0c952680b16644112b44eec0b926ac191c66c68327b0d3 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3860375 txRoot=0xe700c8089a6a384d71e75fc6bee559f2e2cde2e79e259f4472847ff9f5ea1794 value=17431080080521238
time="2022-09-10T17:55:03Z" level=info msg="http: GET /eth/v1/builder/header/3860375/0xb335d6f873655cc73a85e94e1e4faae58d5512ce49ffd23f455a822b1e76c6f0/0x91cefe4d5fed257b79603888c303638b37f98926537d8b3f4f0c952680b16644112b44eec0b926ac191c66c68327b0d3 200" duration=0.091917158 method=GET module=service path=/eth/v1/builder/header/3860375/0xb335d6f873655cc73a85e94e1e4faae58d5512ce49ffd23f455a822b1e76c6f0/0x91cefe4d5fed257b79603888c303638b37f98926537d8b3f4f0c952680b16644112b44eec0b926ac191c66c68327b0d3 status=200
time="2022-09-10T17:55:05Z" level=info msg="received payload from relay" blockHash=0x1574a79194496871accf2e766caca0914a270f7a0855b6f6a86b828ecab195dd method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-10T17:55:05Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.670200787 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-10T18:09:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xc96f76050ea4d56524920409aea0413057bf00400e88d3e9f72f6455b3662ce7 pubkey=0xb9f4aa14cffdfed272e8a34136ddadef21b80fd10649d4a7517c7d165223105d3df0906553b36f8decc83337c0b97db8 slot=3860445
time="2022-09-10T18:09:02Z" level=info msg="http: GET /eth/v1/builder/header/3860445/0xc96f76050ea4d56524920409aea0413057bf00400e88d3e9f72f6455b3662ce7/0xb9f4aa14cffdfed272e8a34136ddadef21b80fd10649d4a7517c7d165223105d3df0906553b36f8decc83337c0b97db8 204" duration=0.100354412 method=GET module=service path=/eth/v1/builder/header/3860445/0xc96f76050ea4d56524920409aea0413057bf00400e88d3e9f72f6455b3662ce7/0xb9f4aa14cffdfed272e8a34136ddadef21b80fd10649d4a7517c7d165223105d3df0906553b36f8decc83337c0b97db8 status=204
time="2022-09-10T18:22:14Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x922c628401380a71edde1b3104d76b87c911e27d2d12257ecf0f93e1f3d30371 pubkey=0xb951a35b577ce7652d14fc9e5ec662f59cb67a9bdc0784d3b2d0a403a67d50e82bf857a17eb95d6e5dba8a47e0681539 slot=3860511
time="2022-09-10T18:22:14Z" level=info msg="http: GET /eth/v1/builder/header/3860511/0x922c628401380a71edde1b3104d76b87c911e27d2d12257ecf0f93e1f3d30371/0xb951a35b577ce7652d14fc9e5ec662f59cb67a9bdc0784d3b2d0a403a67d50e82bf857a17eb95d6e5dba8a47e0681539 204" duration=0.093969882 method=GET module=service path=/eth/v1/builder/header/3860511/0x922c628401380a71edde1b3104d76b87c911e27d2d12257ecf0f93e1f3d30371/0xb951a35b577ce7652d14fc9e5ec662f59cb67a9bdc0784d3b2d0a403a67d50e82bf857a17eb95d6e5dba8a47e0681539 status=204
time="2022-09-10T19:38:38Z" level=info msg="best bid" blockHash=0xb8cb326dbe54e2312d3b44dcab0ae55b33f020786d6ab84b603c0e93e24f877e blockNumber=7567512 method=getHeader module=service parentHash=0xda58958eba050f8a12014b67dddec04f79d2b5b41241f62c54fc3ac69e3bfe9c pubkey=0xb1e55908764d786f08838fc883d523e8bf9e9cd5f70c386840186797fded4b0fd039fcfee4cf9c6b54e40077a81cfb16 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3860893 txRoot=0xc7b32aec87975350a3353d172884321ed52e1ed6e502fce5f190451a09abc7e5 value=8780977842026679
time="2022-09-10T19:38:38Z" level=info msg="http: GET /eth/v1/builder/header/3860893/0xda58958eba050f8a12014b67dddec04f79d2b5b41241f62c54fc3ac69e3bfe9c/0xb1e55908764d786f08838fc883d523e8bf9e9cd5f70c386840186797fded4b0fd039fcfee4cf9c6b54e40077a81cfb16 200" duration=0.090331397 method=GET module=service path=/eth/v1/builder/header/3860893/0xda58958eba050f8a12014b67dddec04f79d2b5b41241f62c54fc3ac69e3bfe9c/0xb1e55908764d786f08838fc883d523e8bf9e9cd5f70c386840186797fded4b0fd039fcfee4cf9c6b54e40077a81cfb16 status=200
time="2022-09-10T19:38:40Z" level=info msg="received payload from relay" blockHash=0xb8cb326dbe54e2312d3b44dcab0ae55b33f020786d6ab84b603c0e93e24f877e method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-10T19:38:40Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.382638789 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-10T20:25:38Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x6a3f41f868ea187c79d47d7475a6bd948c5ea843b477da30aefa386a0c5ad708 pubkey=0xb7c9ed135f6f68bc8fa5be6cfac34b052f2fc52a08e4a738f6a8c8ae4edf7714b33cff90a34e0d393681283d24a6fb30 slot=3861128
time="2022-09-10T20:25:38Z" level=info msg="http: GET /eth/v1/builder/header/3861128/0x6a3f41f868ea187c79d47d7475a6bd948c5ea843b477da30aefa386a0c5ad708/0xb7c9ed135f6f68bc8fa5be6cfac34b052f2fc52a08e4a738f6a8c8ae4edf7714b33cff90a34e0d393681283d24a6fb30 204" duration=0.087761623 method=GET module=service path=/eth/v1/builder/header/3861128/0x6a3f41f868ea187c79d47d7475a6bd948c5ea843b477da30aefa386a0c5ad708/0xb7c9ed135f6f68bc8fa5be6cfac34b052f2fc52a08e4a738f6a8c8ae4edf7714b33cff90a34e0d393681283d24a6fb30 status=204
time="2022-09-10T20:56:38Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x66e06e8d1775e1ec00a734b8415f72d8ae2f72098ef4404e24bd0c30c6647ceb pubkey=0x9100b9db655a3df0ec6ca7c56fd750e6411e510bbfb96189f74cd4139d82773220ea2f4183aaa64980789dea0895f3f8 slot=3861283
time="2022-09-10T20:56:38Z" level=info msg="http: GET /eth/v1/builder/header/3861283/0x66e06e8d1775e1ec00a734b8415f72d8ae2f72098ef4404e24bd0c30c6647ceb/0x9100b9db655a3df0ec6ca7c56fd750e6411e510bbfb96189f74cd4139d82773220ea2f4183aaa64980789dea0895f3f8 204" duration=0.095781123 method=GET module=service path=/eth/v1/builder/header/3861283/0x66e06e8d1775e1ec00a734b8415f72d8ae2f72098ef4404e24bd0c30c6647ceb/0x9100b9db655a3df0ec6ca7c56fd750e6411e510bbfb96189f74cd4139d82773220ea2f4183aaa64980789dea0895f3f8 status=204
time="2022-09-10T21:12:38Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xa2246f68f3be439451d9b23cb322ffaf45698269c229a4ab2e6aea7b0235f342 pubkey=0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 slot=3861363
time="2022-09-10T21:12:38Z" level=info msg="http: GET /eth/v1/builder/header/3861363/0xa2246f68f3be439451d9b23cb322ffaf45698269c229a4ab2e6aea7b0235f342/0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 204" duration=0.104273965 method=GET module=service path=/eth/v1/builder/header/3861363/0xa2246f68f3be439451d9b23cb322ffaf45698269c229a4ab2e6aea7b0235f342/0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 status=204
time="2022-09-10T21:20:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x1e752a6296585e2bb59c723507dbeeb541509a67c3fe1a2923c3b4607e6bf48d pubkey=0xb6fded224f3a4dfaaddce23ced8dc1aa5de187668529945acb9292bd4462b6a22aef6f452d3ae62365543a0b994e1ad9 slot=3861400
time="2022-09-10T21:20:02Z" level=info msg="http: GET /eth/v1/builder/header/3861400/0x1e752a6296585e2bb59c723507dbeeb541509a67c3fe1a2923c3b4607e6bf48d/0xb6fded224f3a4dfaaddce23ced8dc1aa5de187668529945acb9292bd4462b6a22aef6f452d3ae62365543a0b994e1ad9 204" duration=0.099846101 method=GET module=service path=/eth/v1/builder/header/3861400/0x1e752a6296585e2bb59c723507dbeeb541509a67c3fe1a2923c3b4607e6bf48d/0xb6fded224f3a4dfaaddce23ced8dc1aa5de187668529945acb9292bd4462b6a22aef6f452d3ae62365543a0b994e1ad9 status=204
time="2022-09-10T21:41:26Z" level=info msg="best bid" blockHash=0xac7b0c8db28304abcec1b2787e129eb41584fd16c4c853701a04dec3e060b27b blockNumber=7568057 method=getHeader module=service parentHash=0xfe228b04d8900cf1f5f8f04772f5e2df01f6d90d57269c208cd32e4e1b569cb6 pubkey=0x87df4801d47e929d0972f3dedcdf55b03b53fadb2213e63268d03a77e1e2b57602a0c2d3df0c437f4b4930697c7b19e4 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3861507 txRoot=0x773557ad984df8e366d78c503947d441ee7c68b32e9dbefba8f1c871db410737 value=17938575467464201
time="2022-09-10T21:41:26Z" level=info msg="http: GET /eth/v1/builder/header/3861507/0xfe228b04d8900cf1f5f8f04772f5e2df01f6d90d57269c208cd32e4e1b569cb6/0x87df4801d47e929d0972f3dedcdf55b03b53fadb2213e63268d03a77e1e2b57602a0c2d3df0c437f4b4930697c7b19e4 200" duration=0.092258688 method=GET module=service path=/eth/v1/builder/header/3861507/0xfe228b04d8900cf1f5f8f04772f5e2df01f6d90d57269c208cd32e4e1b569cb6/0x87df4801d47e929d0972f3dedcdf55b03b53fadb2213e63268d03a77e1e2b57602a0c2d3df0c437f4b4930697c7b19e4 status=200
time="2022-09-10T21:41:28Z" level=info msg="received payload from relay" blockHash=0xac7b0c8db28304abcec1b2787e129eb41584fd16c4c853701a04dec3e060b27b method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-10T21:41:28Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.482915943 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-10T21:45:14Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x7a1fad42d50d1d2506e9425ae9df2b37a470c228088bc1a7b0c56c1229e24da8 pubkey=0xb28b9c7641edf14e37d9ef3fb13a4e338228591ba371d0faa55e27603492a7d2a2f73d625ab43fbaa070f075f8c36e79 slot=3861526
time="2022-09-10T21:45:14Z" level=info msg="http: GET /eth/v1/builder/header/3861526/0x7a1fad42d50d1d2506e9425ae9df2b37a470c228088bc1a7b0c56c1229e24da8/0xb28b9c7641edf14e37d9ef3fb13a4e338228591ba371d0faa55e27603492a7d2a2f73d625ab43fbaa070f075f8c36e79 204" duration=0.096167415 method=GET module=service path=/eth/v1/builder/header/3861526/0x7a1fad42d50d1d2506e9425ae9df2b37a470c228088bc1a7b0c56c1229e24da8/0xb28b9c7641edf14e37d9ef3fb13a4e338228591ba371d0faa55e27603492a7d2a2f73d625ab43fbaa070f075f8c36e79 status=204
time="2022-09-10T22:16:25Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07 pubkey=0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a slot=3861682
time="2022-09-10T22:16:25Z" level=info msg="http: GET /eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a 204" duration=0.097742989 method=GET module=service path=/eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a status=204
time="2022-09-10T22:16:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07 pubkey=0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a slot=3861682
time="2022-09-10T22:16:26Z" level=info msg="http: GET /eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a 204" duration=0.095997859 method=GET module=service path=/eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a status=204
time="2022-09-10T22:16:41Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07 pubkey=0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a slot=3861682
time="2022-09-10T22:16:41Z" level=info msg="http: GET /eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a 204" duration=0.101816999 method=GET module=service path=/eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a status=204
time="2022-09-10T22:16:52Z" level=warning msg="error making request to relay" error="HTTP error response: 400 / {\"code\":400,\"message\":\"slot is too old\"}\n" method=getHeader module=service parentHash=0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07 pubkey=0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a slot=3861682 url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a?id=bloxstaking"
time="2022-09-10T22:16:52Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07 pubkey=0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a slot=3861682
time="2022-09-10T22:16:52Z" level=info msg="http: GET /eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a 204" duration=0.091485002 method=GET module=service path=/eth/v1/builder/header/3861682/0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07/0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a status=204
time="2022-09-10T23:14:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x5b64159a0ab2647844ee1682ff51ffea9ec9157351820bbf4cb95bcd4cee307c pubkey=0x98875938877386c371d204b330254701d4334e147f1b522eeaa8667e1d31c7458dcc557fea07b0124630c2a308a60a6e slot=3861972
time="2022-09-10T23:14:26Z" level=info msg="http: GET /eth/v1/builder/header/3861972/0x5b64159a0ab2647844ee1682ff51ffea9ec9157351820bbf4cb95bcd4cee307c/0x98875938877386c371d204b330254701d4334e147f1b522eeaa8667e1d31c7458dcc557fea07b0124630c2a308a60a6e 204" duration=0.146256714 method=GET module=service path=/eth/v1/builder/header/3861972/0x5b64159a0ab2647844ee1682ff51ffea9ec9157351820bbf4cb95bcd4cee307c/0x98875938877386c371d204b330254701d4334e147f1b522eeaa8667e1d31c7458dcc557fea07b0124630c2a308a60a6e status=204
time="2022-09-10T23:55:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x2d8553dcb4ffa446ce1aec5f39e7b280a7c79560006de690518ed5e926e4ba26 pubkey=0xa0eb0346cb692f3c70ad3aa2f7dece1ba870a28615690d11ac4147f4af38c39eacda31d4de42e18f7c31a61850903f3a slot=3862177
time="2022-09-10T23:55:26Z" level=info msg="http: GET /eth/v1/builder/header/3862177/0x2d8553dcb4ffa446ce1aec5f39e7b280a7c79560006de690518ed5e926e4ba26/0xa0eb0346cb692f3c70ad3aa2f7dece1ba870a28615690d11ac4147f4af38c39eacda31d4de42e18f7c31a61850903f3a 204" duration=0.102835198 method=GET module=service path=/eth/v1/builder/header/3862177/0x2d8553dcb4ffa446ce1aec5f39e7b280a7c79560006de690518ed5e926e4ba26/0xa0eb0346cb692f3c70ad3aa2f7dece1ba870a28615690d11ac4147f4af38c39eacda31d4de42e18f7c31a61850903f3a status=204
time="2022-09-11T01:07:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x60f532b7ee5787b1dcce550e1876e04f1ad4c24504245f490e69cd0ba05437cb pubkey=0x97213a1eb7e927aa78d70305d2a54764efdf1324aa1d274aae2e5b9e406426e7dc95103c6fbd8b7068e81bb0ca58dcaf slot=3862539
time="2022-09-11T01:07:50Z" level=info msg="http: GET /eth/v1/builder/header/3862539/0x60f532b7ee5787b1dcce550e1876e04f1ad4c24504245f490e69cd0ba05437cb/0x97213a1eb7e927aa78d70305d2a54764efdf1324aa1d274aae2e5b9e406426e7dc95103c6fbd8b7068e81bb0ca58dcaf 204" duration=0.105770568 method=GET module=service path=/eth/v1/builder/header/3862539/0x60f532b7ee5787b1dcce550e1876e04f1ad4c24504245f490e69cd0ba05437cb/0x97213a1eb7e927aa78d70305d2a54764efdf1324aa1d274aae2e5b9e406426e7dc95103c6fbd8b7068e81bb0ca58dcaf status=204
time="2022-09-11T02:20:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x57d593f466aca2da57268c804d54df2e47c8897988bc993d9c7fa2d46267641a pubkey=0xaed086796f942fcac1cf68d69e7b50f0cd624b8c188cd81095ca20c93618e7d0c9fea5de1a578c0e0162c875fc629479 slot=3862900
time="2022-09-11T02:20:02Z" level=info msg="http: GET /eth/v1/builder/header/3862900/0x57d593f466aca2da57268c804d54df2e47c8897988bc993d9c7fa2d46267641a/0xaed086796f942fcac1cf68d69e7b50f0cd624b8c188cd81095ca20c93618e7d0c9fea5de1a578c0e0162c875fc629479 204" duration=0.100192175 method=GET module=service path=/eth/v1/builder/header/3862900/0x57d593f466aca2da57268c804d54df2e47c8897988bc993d9c7fa2d46267641a/0xaed086796f942fcac1cf68d69e7b50f0cd624b8c188cd81095ca20c93618e7d0c9fea5de1a578c0e0162c875fc629479 status=204
time="2022-09-11T02:32:26Z" level=info msg="best bid" blockHash=0x63a502075502496aa5124b01288a68ab4716e588e7e6baf4678bf0ada99a9c3c blockNumber=7569330 method=getHeader module=service parentHash=0xed6b9860f51abbd81f343ec5989f6c79ab224a045ea5f1a933d005f8353d6d4d pubkey=0xa872847c7baefb15902601305ba2295426fd32c9dddcc1b796c8d6723afaac9a48ff9139469369c276d47392f4b9ee59 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3862962 txRoot=0x62362ede4158c9235e03cc91ded4bad861c4d1fd42cfefcc35e32d1301135e65 value=19225093096857882
time="2022-09-11T02:32:26Z" level=info msg="http: GET /eth/v1/builder/header/3862962/0xed6b9860f51abbd81f343ec5989f6c79ab224a045ea5f1a933d005f8353d6d4d/0xa872847c7baefb15902601305ba2295426fd32c9dddcc1b796c8d6723afaac9a48ff9139469369c276d47392f4b9ee59 200" duration=0.091008689 method=GET module=service path=/eth/v1/builder/header/3862962/0xed6b9860f51abbd81f343ec5989f6c79ab224a045ea5f1a933d005f8353d6d4d/0xa872847c7baefb15902601305ba2295426fd32c9dddcc1b796c8d6723afaac9a48ff9139469369c276d47392f4b9ee59 status=200
time="2022-09-11T02:32:28Z" level=info msg="received payload from relay" blockHash=0x63a502075502496aa5124b01288a68ab4716e588e7e6baf4678bf0ada99a9c3c method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-11T02:32:28Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.483194018 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-11T03:54:38Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x099869678569706655de5394427ccb00d129d5255cdcebe9ee2d523f3116c403 pubkey=0x97eb2847edd0be44d0d2864377839190eccf41451fc5162413c5cecf1be5902b045420a1fce062e56f83e23031fee416 slot=3863373
time="2022-09-11T03:54:38Z" level=info msg="http: GET /eth/v1/builder/header/3863373/0x099869678569706655de5394427ccb00d129d5255cdcebe9ee2d523f3116c403/0x97eb2847edd0be44d0d2864377839190eccf41451fc5162413c5cecf1be5902b045420a1fce062e56f83e23031fee416 204" duration=0.098766691 method=GET module=service path=/eth/v1/builder/header/3863373/0x099869678569706655de5394427ccb00d129d5255cdcebe9ee2d523f3116c403/0x97eb2847edd0be44d0d2864377839190eccf41451fc5162413c5cecf1be5902b045420a1fce062e56f83e23031fee416 status=204
time="2022-09-11T04:11:50Z" level=info msg="best bid" blockHash=0x5b181bf865d9d3a96a5a3dd266abfb8fec9f95fd46d4e4ed56b296bc001900a5 blockNumber=7569755 method=getHeader module=service parentHash=0x50e33263a867ca03d7de547c164107d2e9519ca7644e71523a3dc68ced913017 pubkey=0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3863459 txRoot=0xd61b7bc9cc943e05ff8b27cc37a5416fb30ca12b414c236d14afbf4443621bfd value=37252133566021584
time="2022-09-11T04:11:50Z" level=info msg="http: GET /eth/v1/builder/header/3863459/0x50e33263a867ca03d7de547c164107d2e9519ca7644e71523a3dc68ced913017/0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 200" duration=0.09782402 method=GET module=service path=/eth/v1/builder/header/3863459/0x50e33263a867ca03d7de547c164107d2e9519ca7644e71523a3dc68ced913017/0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06 status=200
time="2022-09-11T04:11:52Z" level=info msg="received payload from relay" blockHash=0x5b181bf865d9d3a96a5a3dd266abfb8fec9f95fd46d4e4ed56b296bc001900a5 method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-11T04:11:52Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.562828969 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-11T04:19:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x4900ecaae61d0b966ae3dad2fcc75ce9f9d3f540822d34edc23d4fda43558355 pubkey=0xad634ddef2db1de2f420ff9d57fc4c4093be12e0de4a5c97b3b5b344c969fde172fc1912270612e934b135bddca2cf63 slot=3863499
time="2022-09-11T04:19:50Z" level=info msg="http: GET /eth/v1/builder/header/3863499/0x4900ecaae61d0b966ae3dad2fcc75ce9f9d3f540822d34edc23d4fda43558355/0xad634ddef2db1de2f420ff9d57fc4c4093be12e0de4a5c97b3b5b344c969fde172fc1912270612e934b135bddca2cf63 204" duration=0.098571454 method=GET module=service path=/eth/v1/builder/header/3863499/0x4900ecaae61d0b966ae3dad2fcc75ce9f9d3f540822d34edc23d4fda43558355/0xad634ddef2db1de2f420ff9d57fc4c4093be12e0de4a5c97b3b5b344c969fde172fc1912270612e934b135bddca2cf63 status=204
time="2022-09-11T05:23:50Z" level=info msg="best bid" blockHash=0x167272e830aae34c16fe334678393f4216e31d33d7adabb9be99590299f717f5 blockNumber=7570067 method=getHeader module=service parentHash=0x6f86ef1e91fe13cecf2b967ae40d34e413d190b3e8a24bbf9ff761b373077fb6 pubkey=0xace55e8285b3e568cfbd5106a62956d9cc0c322d456be26e229c39dd4bb1e9e8ae9a2edfd5f3ddf51c027c332a229e65 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3863819 txRoot=0xe5f88ca56a9c5464ac4b2264bf7b98a21f64e7cd5d75721d9a6957529dc2c263 value=183455102306254161
time="2022-09-11T05:23:50Z" level=info msg="http: GET /eth/v1/builder/header/3863819/0x6f86ef1e91fe13cecf2b967ae40d34e413d190b3e8a24bbf9ff761b373077fb6/0xace55e8285b3e568cfbd5106a62956d9cc0c322d456be26e229c39dd4bb1e9e8ae9a2edfd5f3ddf51c027c332a229e65 200" duration=0.103343668 method=GET module=service path=/eth/v1/builder/header/3863819/0x6f86ef1e91fe13cecf2b967ae40d34e413d190b3e8a24bbf9ff761b373077fb6/0xace55e8285b3e568cfbd5106a62956d9cc0c322d456be26e229c39dd4bb1e9e8ae9a2edfd5f3ddf51c027c332a229e65 status=200
time="2022-09-11T05:23:52Z" level=info msg="received payload from relay" blockHash=0x167272e830aae34c16fe334678393f4216e31d33d7adabb9be99590299f717f5 method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-11T05:23:52Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.395944478 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-11T06:16:49Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xeffbe57cbcdbf8d0ee9befd35e27c57093677eb0010fce2f77a18345dc7a70e5 pubkey=0xb245e14d5b81336d6a83defdaeca582c8ab84b08a26c32952c98efbf186515fb03b269a9773bcda02ce4265d0448d594 slot=3864084
time="2022-09-11T06:16:49Z" level=info msg="http: GET /eth/v1/builder/header/3864084/0xeffbe57cbcdbf8d0ee9befd35e27c57093677eb0010fce2f77a18345dc7a70e5/0xb245e14d5b81336d6a83defdaeca582c8ab84b08a26c32952c98efbf186515fb03b269a9773bcda02ce4265d0448d594 204" duration=0.09386477 method=GET module=service path=/eth/v1/builder/header/3864084/0xeffbe57cbcdbf8d0ee9befd35e27c57093677eb0010fce2f77a18345dc7a70e5/0xb245e14d5b81336d6a83defdaeca582c8ab84b08a26c32952c98efbf186515fb03b269a9773bcda02ce4265d0448d594 status=204
time="2022-09-11T07:53:01Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xb6d7a7768e79fa4bfdaa7475a7b706f7ac37e195123906017b2928166799f550 pubkey=0x99a8d9dc059466b456cc2bbabecfaf48bc787f2d1d12473286c1e439e1bbb31b52922364c92cde0c2d00a0e00f5960d3 slot=3864565
time="2022-09-11T07:53:01Z" level=info msg="http: GET /eth/v1/builder/header/3864565/0xb6d7a7768e79fa4bfdaa7475a7b706f7ac37e195123906017b2928166799f550/0x99a8d9dc059466b456cc2bbabecfaf48bc787f2d1d12473286c1e439e1bbb31b52922364c92cde0c2d00a0e00f5960d3 204" duration=0.08366945 method=GET module=service path=/eth/v1/builder/header/3864565/0xb6d7a7768e79fa4bfdaa7475a7b706f7ac37e195123906017b2928166799f550/0x99a8d9dc059466b456cc2bbabecfaf48bc787f2d1d12473286c1e439e1bbb31b52922364c92cde0c2d00a0e00f5960d3 status=204
time="2022-09-11T09:03:38Z" level=info msg="best bid" blockHash=0x691a0c613116f53678480d15302bce516ce0197df85d8da8db4eda1070969d5f blockNumber=7571035 method=getHeader module=service parentHash=0xc10b26863fb2c733d71219bcc5f1fe41e8ab08240a7e4a08e3173e294b327511 pubkey=0xa5431b0ec3d2b2bf84f06aefd4f574cfc69375d3c1e04a4eacd42ef18e57602ff8f1db4442235272411f8ab5186ed4cf relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3864918 txRoot=0x17c818ee966470482f43e9b5d64780c39d7b9dfd46ed65040a36e58a137ed59b value=24975366745626516
time="2022-09-11T09:03:38Z" level=info msg="http: GET /eth/v1/builder/header/3864918/0xc10b26863fb2c733d71219bcc5f1fe41e8ab08240a7e4a08e3173e294b327511/0xa5431b0ec3d2b2bf84f06aefd4f574cfc69375d3c1e04a4eacd42ef18e57602ff8f1db4442235272411f8ab5186ed4cf 200" duration=0.093325134 method=GET module=service path=/eth/v1/builder/header/3864918/0xc10b26863fb2c733d71219bcc5f1fe41e8ab08240a7e4a08e3173e294b327511/0xa5431b0ec3d2b2bf84f06aefd4f574cfc69375d3c1e04a4eacd42ef18e57602ff8f1db4442235272411f8ab5186ed4cf status=200
time="2022-09-11T09:03:40Z" level=info msg="received payload from relay" blockHash=0x691a0c613116f53678480d15302bce516ce0197df85d8da8db4eda1070969d5f method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-11T09:03:40Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.584424649 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-11T09:43:38Z" level=info msg="best bid" blockHash=0x487f2fad73f86b0a1fd02cc33286759e540d0349a78a8ea3f266836df2f9600c blockNumber=7571208 method=getHeader module=service parentHash=0xb00c8f51f5517613905f9fab4d7b18f4b2c5711b0aaa2452fbe23466562211ce pubkey=0x8678cbf260ba9acdb1b32ad4340dd3f75bd59d98d5fd98d9a44767e883d2e1bbd1dd178b9e7975410c72f1afd2e2bc48 relays="https://0xafa4c6985aa049fb79dd37010438cfebeb0f2bd42b115b89dd678dab0670c1de38da0c4e9138c9290a398ecd9a0b3110@builder-relay-goerli.flashbots.net?id=bloxstaking" slot=3865118 txRoot=0xf1db9049e96c3c8fa8f11b55ae4ab193ace6b96b35ae7390b49cf0f9fbba4c4d value=55952445622924839
time="2022-09-11T09:43:38Z" level=info msg="http: GET /eth/v1/builder/header/3865118/0xb00c8f51f5517613905f9fab4d7b18f4b2c5711b0aaa2452fbe23466562211ce/0x8678cbf260ba9acdb1b32ad4340dd3f75bd59d98d5fd98d9a44767e883d2e1bbd1dd178b9e7975410c72f1afd2e2bc48 200" duration=0.091391555 method=GET module=service path=/eth/v1/builder/header/3865118/0xb00c8f51f5517613905f9fab4d7b18f4b2c5711b0aaa2452fbe23466562211ce/0x8678cbf260ba9acdb1b32ad4340dd3f75bd59d98d5fd98d9a44767e883d2e1bbd1dd178b9e7975410c72f1afd2e2bc48 status=200
time="2022-09-11T09:43:40Z" level=info msg="received payload from relay" blockHash=0x487f2fad73f86b0a1fd02cc33286759e540d0349a78a8ea3f266836df2f9600c method=getPayload module=service url="https://builder-relay-goerli.flashbots.net/eth/v1/builder/blinded_blocks?id=bloxstaking"
time="2022-09-11T09:43:40Z" level=info msg="http: POST /eth/v1/builder/blinded_blocks 200" duration=0.56011339 method=POST module=service path=/eth/v1/builder/blinded_blocks status=200
time="2022-09-11T09:45:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xef03688ef50f91589029c9bd578ed8c17dd9eaef4ab590bb7910d98c8fafc0d2 pubkey=0xa28d22048b2535baf30d0ef3f5da864e40657574819496023bc1e7ca2e01b176c59b9f16209ee1a6ea67925da4267b1e slot=3865127
time="2022-09-11T09:45:26Z" level=info msg="http: GET /eth/v1/builder/header/3865127/0xef03688ef50f91589029c9bd578ed8c17dd9eaef4ab590bb7910d98c8fafc0d2/0xa28d22048b2535baf30d0ef3f5da864e40657574819496023bc1e7ca2e01b176c59b9f16209ee1a6ea67925da4267b1e 204" duration=0.089280221 method=GET module=service path=/eth/v1/builder/header/3865127/0xef03688ef50f91589029c9bd578ed8c17dd9eaef4ab590bb7910d98c8fafc0d2/0xa28d22048b2535baf30d0ef3f5da864e40657574819496023bc1e7ca2e01b176c59b9f16209ee1a6ea67925da4267b1e status=204
time="2022-09-11T10:05:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a pubkey=0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 slot=3865227
time="2022-09-11T10:05:26Z" level=info msg="http: GET /eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 204" duration=0.084545781 method=GET module=service path=/eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 status=204
time="2022-09-11T10:05:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a pubkey=0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 slot=3865227
time="2022-09-11T10:05:26Z" level=info msg="http: GET /eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 204" duration=0.080097029 method=GET module=service path=/eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 status=204
time="2022-09-11T10:05:26Z" level=info msg="no bid received" method=getHeader module=service parentHash=0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a pubkey=0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 slot=3865227
time="2022-09-11T10:05:26Z" level=info msg="http: GET /eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 204" duration=0.079238945 method=GET module=service path=/eth/v1/builder/header/3865227/0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a/0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278 status=204
time="2022-09-11T11:37:49Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b pubkey=0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 slot=3865689
time="2022-09-11T11:37:49Z" level=info msg="http: GET /eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 204" duration=0.147123637 method=GET module=service path=/eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 status=204
time="2022-09-11T11:37:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b pubkey=0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 slot=3865689
time="2022-09-11T11:37:50Z" level=info msg="http: GET /eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 204" duration=0.088163055 method=GET module=service path=/eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 status=204
time="2022-09-11T11:37:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b pubkey=0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 slot=3865689
time="2022-09-11T11:37:50Z" level=info msg="http: GET /eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 204" duration=0.089802321 method=GET module=service path=/eth/v1/builder/header/3865689/0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b/0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987 status=204
time="2022-09-11T13:18:13Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338 pubkey=0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c slot=3866191
time="2022-09-11T13:18:13Z" level=info msg="http: GET /eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c 204" duration=0.092230125 method=GET module=service path=/eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c status=204
time="2022-09-11T13:18:14Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338 pubkey=0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c slot=3866191
time="2022-09-11T13:18:14Z" level=info msg="http: GET /eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c 204" duration=0.109958149 method=GET module=service path=/eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c status=204
time="2022-09-11T13:18:14Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338 pubkey=0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c slot=3866191
time="2022-09-11T13:18:14Z" level=info msg="http: GET /eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c 204" duration=0.100309254 method=GET module=service path=/eth/v1/builder/header/3866191/0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338/0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c status=204
time="2022-09-11T14:05:49Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779 pubkey=0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 slot=3866429
time="2022-09-11T14:05:49Z" level=info msg="http: GET /eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 204" duration=0.089290769 method=GET module=service path=/eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 status=204
time="2022-09-11T14:05:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779 pubkey=0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 slot=3866429
time="2022-09-11T14:05:50Z" level=info msg="http: GET /eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 204" duration=0.1062053 method=GET module=service path=/eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 status=204
time="2022-09-11T14:05:50Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779 pubkey=0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 slot=3866429
time="2022-09-11T14:05:50Z" level=info msg="http: GET /eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 204" duration=0.168110147 method=GET module=service path=/eth/v1/builder/header/3866429/0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779/0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0 status=204
time="2022-09-11T14:54:01Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a pubkey=0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 slot=3866670
time="2022-09-11T14:54:01Z" level=info msg="http: GET /eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 204" duration=0.090857549 method=GET module=service path=/eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 status=204
time="2022-09-11T14:54:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a pubkey=0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 slot=3866670
time="2022-09-11T14:54:02Z" level=info msg="http: GET /eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 204" duration=0.099822862 method=GET module=service path=/eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 status=204
time="2022-09-11T14:54:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a pubkey=0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 slot=3866670
time="2022-09-11T14:54:02Z" level=info msg="http: GET /eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 204" duration=0.083995168 method=GET module=service path=/eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 status=204
time="2022-09-11T14:54:02Z" level=info msg="no bid received" method=getHeader module=service parentHash=0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a pubkey=0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 slot=3866670
time="2022-09-11T14:54:02Z" level=info msg="http: GET /eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691 204" duration=0.098609123 method=GET module=service path=/eth/v1/builder/header/3866670/0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a/0xa477d7862977976

Relevant Lighthouse logs (only payload requested/received/missing logs):

Sep 10 17:55:02.901 INFO Requesting blinded header from connected builder, parent_hash: 0xb335d6f873655cc73a85e94e1e4faae58d5512ce49ffd23f455a822b1e76c6f0, pubkey: 0x91cefe4d5fed257b79603888c303638b37f98926537d8b3f4f0c952680b16644112b44eec0b926ac191c66c68327b0d3, slot: Slot(3860375), service: exec
Sep 10 17:55:03.001 INFO Received a payload header from the connected builder, block_hash: 0x1574a79194496871accf2e766caca0914a270f7a0855b6f6a86b828ecab195dd, service: exec
Sep 10 18:09:02.244 INFO Requesting blinded header from connected builder, parent_hash: 0xc96f76050ea4d56524920409aea0413057bf00400e88d3e9f72f6455b3662ce7, pubkey: 0xb9f4aa14cffdfed272e8a34136ddadef21b80fd10649d4a7517c7d165223105d3df0906553b36f8decc83337c0b97db8, slot: Slot(3860445), service: exec
Sep 10 18:09:02.363 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 18:22:14.127 INFO Requesting blinded header from connected builder, parent_hash: 0x922c628401380a71edde1b3104d76b87c911e27d2d12257ecf0f93e1f3d30371, pubkey: 0xb951a35b577ce7652d14fc9e5ec662f59cb67a9bdc0784d3b2d0a403a67d50e82bf857a17eb95d6e5dba8a47e0681539, slot: Slot(3860511), service: exec
Sep 10 18:22:14.228 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 19:38:38.621 INFO Requesting blinded header from connected builder, parent_hash: 0xda58958eba050f8a12014b67dddec04f79d2b5b41241f62c54fc3ac69e3bfe9c, pubkey: 0xb1e55908764d786f08838fc883d523e8bf9e9cd5f70c386840186797fded4b0fd039fcfee4cf9c6b54e40077a81cfb16, slot: Slot(3860893), service: exec
Sep 10 19:38:38.723 INFO Received a payload header from the connected builder, block_hash: 0xb8cb326dbe54e2312d3b44dcab0ae55b33f020786d6ab84b603c0e93e24f877e, service: exec
Sep 10 20:25:38.145 INFO Requesting blinded header from connected builder, parent_hash: 0x6a3f41f868ea187c79d47d7475a6bd948c5ea843b477da30aefa386a0c5ad708, pubkey: 0xb7c9ed135f6f68bc8fa5be6cfac34b052f2fc52a08e4a738f6a8c8ae4edf7714b33cff90a34e0d393681283d24a6fb30, slot: Slot(3861128), service: exec
Sep 10 20:25:38.239 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 20:56:38.407 INFO Requesting blinded header from connected builder, parent_hash: 0x66e06e8d1775e1ec00a734b8415f72d8ae2f72098ef4404e24bd0c30c6647ceb, pubkey: 0x9100b9db655a3df0ec6ca7c56fd750e6411e510bbfb96189f74cd4139d82773220ea2f4183aaa64980789dea0895f3f8, slot: Slot(3861283), service: exec
Sep 10 20:56:38.508 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 21:12:38.344 INFO Requesting blinded header from connected builder, parent_hash: 0xa2246f68f3be439451d9b23cb322ffaf45698269c229a4ab2e6aea7b0235f342, pubkey: 0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06, slot: Slot(3861363), service: exec
Sep 10 21:12:38.457 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 21:20:02.513 INFO Requesting blinded header from connected builder, parent_hash: 0x1e752a6296585e2bb59c723507dbeeb541509a67c3fe1a2923c3b4607e6bf48d, pubkey: 0xb6fded224f3a4dfaaddce23ced8dc1aa5de187668529945acb9292bd4462b6a22aef6f452d3ae62365543a0b994e1ad9, slot: Slot(3861400), service: exec
Sep 10 21:20:02.625 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 21:41:26.028 INFO Requesting blinded header from connected builder, parent_hash: 0xfe228b04d8900cf1f5f8f04772f5e2df01f6d90d57269c208cd32e4e1b569cb6, pubkey: 0x87df4801d47e929d0972f3dedcdf55b03b53fadb2213e63268d03a77e1e2b57602a0c2d3df0c437f4b4930697c7b19e4, slot: Slot(3861507), service: exec
Sep 10 21:41:26.134 INFO Received a payload header from the connected builder, block_hash: 0xac7b0c8db28304abcec1b2787e129eb41584fd16c4c853701a04dec3e060b27b, service: exec
Sep 10 21:45:14.167 INFO Requesting blinded header from connected builder, parent_hash: 0x7a1fad42d50d1d2506e9425ae9df2b37a470c228088bc1a7b0c56c1229e24da8, pubkey: 0xb28b9c7641edf14e37d9ef3fb13a4e338228591ba371d0faa55e27603492a7d2a2f73d625ab43fbaa070f075f8c36e79, slot: Slot(3861526), service: exec
Sep 10 21:45:14.270 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 22:16:25.776 INFO Requesting blinded header from connected builder, parent_hash: 0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07, pubkey: 0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a, slot: Slot(3861682), service: exec
Sep 10 22:16:25.881 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 22:16:26.192 INFO Requesting blinded header from connected builder, parent_hash: 0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07, pubkey: 0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a, slot: Slot(3861682), service: exec
Sep 10 22:16:26.289 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 22:16:41.082 INFO Requesting blinded header from connected builder, parent_hash: 0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07, pubkey: 0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a, slot: Slot(3861682), service: exec
Sep 10 22:16:41.200 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 22:16:52.610 INFO Requesting blinded header from connected builder, parent_hash: 0x017d27c2bd85f2bcc1eb0ab12b80aa691b29fb1c6ac0685eec10f99bdba8db07, pubkey: 0x89edc23a2c8c5f5998bfd93fee3a8916de7c174e256e6c7a169430bf97b040fba094b7132ac7aadb066f79d1174b503a, slot: Slot(3861682), service: exec
Sep 10 22:16:52.734 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 23:14:26.615 INFO Requesting blinded header from connected builder, parent_hash: 0x5b64159a0ab2647844ee1682ff51ffea9ec9157351820bbf4cb95bcd4cee307c, pubkey: 0x98875938877386c371d204b330254701d4334e147f1b522eeaa8667e1d31c7458dcc557fea07b0124630c2a308a60a6e, slot: Slot(3861972), service: exec
Sep 10 23:14:26.768 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 10 23:55:26.236 INFO Requesting blinded header from connected builder, parent_hash: 0x2d8553dcb4ffa446ce1aec5f39e7b280a7c79560006de690518ed5e926e4ba26, pubkey: 0xa0eb0346cb692f3c70ad3aa2f7dece1ba870a28615690d11ac4147f4af38c39eacda31d4de42e18f7c31a61850903f3a, slot: Slot(3862177), service: exec
Sep 10 23:55:26.354 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 01:07:50.070 INFO Requesting blinded header from connected builder, parent_hash: 0x60f532b7ee5787b1dcce550e1876e04f1ad4c24504245f490e69cd0ba05437cb, pubkey: 0x97213a1eb7e927aa78d70305d2a54764efdf1324aa1d274aae2e5b9e406426e7dc95103c6fbd8b7068e81bb0ca58dcaf, slot: Slot(3862539), service: exec
Sep 11 01:07:50.190 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 02:20:02.862 INFO Requesting blinded header from connected builder, parent_hash: 0x57d593f466aca2da57268c804d54df2e47c8897988bc993d9c7fa2d46267641a, pubkey: 0xaed086796f942fcac1cf68d69e7b50f0cd624b8c188cd81095ca20c93618e7d0c9fea5de1a578c0e0162c875fc629479, slot: Slot(3862900), service: exec
Sep 11 02:20:02.969 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 02:32:26.524 INFO Requesting blinded header from connected builder, parent_hash: 0xed6b9860f51abbd81f343ec5989f6c79ab224a045ea5f1a933d005f8353d6d4d, pubkey: 0xa872847c7baefb15902601305ba2295426fd32c9dddcc1b796c8d6723afaac9a48ff9139469369c276d47392f4b9ee59, slot: Slot(3862962), service: exec
Sep 11 02:32:26.624 INFO Received a payload header from the connected builder, block_hash: 0x63a502075502496aa5124b01288a68ab4716e588e7e6baf4678bf0ada99a9c3c, service: exec
Sep 11 03:54:38.255 INFO Requesting blinded header from connected builder, parent_hash: 0x099869678569706655de5394427ccb00d129d5255cdcebe9ee2d523f3116c403, pubkey: 0x97eb2847edd0be44d0d2864377839190eccf41451fc5162413c5cecf1be5902b045420a1fce062e56f83e23031fee416, slot: Slot(3863373), service: exec
Sep 11 03:54:38.386 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 04:11:50.351 INFO Requesting blinded header from connected builder, parent_hash: 0x50e33263a867ca03d7de547c164107d2e9519ca7644e71523a3dc68ced913017, pubkey: 0xa5a5ca99b4165f098d938148d35bae0911c335a1b7adff5660941d1e0113c3bae6ad6d6f7ad73d78c41ea6eadf85ce06, slot: Slot(3863459), service: exec
Sep 11 04:11:50.458 INFO Received a payload header from the connected builder, block_hash: 0x5b181bf865d9d3a96a5a3dd266abfb8fec9f95fd46d4e4ed56b296bc001900a5, service: exec
Sep 11 04:19:50.155 INFO Requesting blinded header from connected builder, parent_hash: 0x4900ecaae61d0b966ae3dad2fcc75ce9f9d3f540822d34edc23d4fda43558355, pubkey: 0xad634ddef2db1de2f420ff9d57fc4c4093be12e0de4a5c97b3b5b344c969fde172fc1912270612e934b135bddca2cf63, slot: Slot(3863499), service: exec
Sep 11 04:19:50.260 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 05:23:50.357 INFO Requesting blinded header from connected builder, parent_hash: 0x6f86ef1e91fe13cecf2b967ae40d34e413d190b3e8a24bbf9ff761b373077fb6, pubkey: 0xace55e8285b3e568cfbd5106a62956d9cc0c322d456be26e229c39dd4bb1e9e8ae9a2edfd5f3ddf51c027c332a229e65, slot: Slot(3863819), service: exec
Sep 11 05:23:50.469 INFO Received a payload header from the connected builder, block_hash: 0x167272e830aae34c16fe334678393f4216e31d33d7adabb9be99590299f717f5, service: exec
Sep 11 06:16:49.835 INFO Requesting blinded header from connected builder, parent_hash: 0xeffbe57cbcdbf8d0ee9befd35e27c57093677eb0010fce2f77a18345dc7a70e5, pubkey: 0xb245e14d5b81336d6a83defdaeca582c8ab84b08a26c32952c98efbf186515fb03b269a9773bcda02ce4265d0448d594, slot: Slot(3864084), service: exec
Sep 11 06:16:49.937 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 07:53:01.758 INFO Requesting blinded header from connected builder, parent_hash: 0xb6d7a7768e79fa4bfdaa7475a7b706f7ac37e195123906017b2928166799f550, pubkey: 0x99a8d9dc059466b456cc2bbabecfaf48bc787f2d1d12473286c1e439e1bbb31b52922364c92cde0c2d00a0e00f5960d3, slot: Slot(3864565), service: exec
Sep 11 07:53:01.849 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 09:03:38.665 INFO Requesting blinded header from connected builder, parent_hash: 0xc10b26863fb2c733d71219bcc5f1fe41e8ab08240a7e4a08e3173e294b327511, pubkey: 0xa5431b0ec3d2b2bf84f06aefd4f574cfc69375d3c1e04a4eacd42ef18e57602ff8f1db4442235272411f8ab5186ed4cf, slot: Slot(3864918), service: exec
Sep 11 09:03:38.768 INFO Received a payload header from the connected builder, block_hash: 0x691a0c613116f53678480d15302bce516ce0197df85d8da8db4eda1070969d5f, service: exec
Sep 11 09:43:38.184 INFO Requesting blinded header from connected builder, parent_hash: 0xb00c8f51f5517613905f9fab4d7b18f4b2c5711b0aaa2452fbe23466562211ce, pubkey: 0x8678cbf260ba9acdb1b32ad4340dd3f75bd59d98d5fd98d9a44767e883d2e1bbd1dd178b9e7975410c72f1afd2e2bc48, slot: Slot(3865118), service: exec
Sep 11 09:43:38.286 INFO Received a payload header from the connected builder, block_hash: 0x487f2fad73f86b0a1fd02cc33286759e540d0349a78a8ea3f266836df2f9600c, service: exec
Sep 11 09:45:26.117 INFO Requesting blinded header from connected builder, parent_hash: 0xef03688ef50f91589029c9bd578ed8c17dd9eaef4ab590bb7910d98c8fafc0d2, pubkey: 0xa28d22048b2535baf30d0ef3f5da864e40657574819496023bc1e7ca2e01b176c59b9f16209ee1a6ea67925da4267b1e, slot: Slot(3865127), service: exec
Sep 11 09:45:26.217 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 10:05:26.299 INFO Requesting blinded header from connected builder, parent_hash: 0xb06844c5011ed68fc69ecd9b8af722586d69a555598f6d0feeab7ccdbc84759a, pubkey: 0xa8bb35fd9852c37db8a69b8bb4679d0246d0374a5ae9e01dbc2a24ed8b7ddabcf96f97b1f76836ce5aab8b4a73ace278, slot: Slot(3865227), service: exec
Sep 11 10:05:26.384 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 11:37:50.024 INFO Requesting blinded header from connected builder, parent_hash: 0x21efbd3667d99623d32619e53fb08dc05e59e28be8d0c18a3fd9751f4474078b, pubkey: 0xa2293b197cc10ebf2a7457711c5d074590c5e03200e29893b987db6919d129e16912513096dfa9e5f143262d2bc84987, slot: Slot(3865689), service: exec
Sep 11 11:37:50.127 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 13:18:14.118 INFO Requesting blinded header from connected builder, parent_hash: 0x50d83ba449f064a344176edc45266be2de8a5cf96221928ef7c9441c1e6b4338, pubkey: 0xa81c731f4ed3c2e7b78a3b77196250da589a78eaa4e22af8f0ad279da896ba3ff36b5fb471726a20883162e108dc974c, slot: Slot(3866191), service: exec
Sep 11 13:18:14.233 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 14:05:50.088 INFO Requesting blinded header from connected builder, parent_hash: 0x5bb641e4c4a500c57aecb833c831e0f89de88b5feb61ad9fe94a9d1fb057c779, pubkey: 0x934ea36e345efe78f08480b8c025a7a9072384478567d2fa1c90387030ad65c13d64a1971ccddec8b9aa05eaa6249ee0, slot: Slot(3866429), service: exec
Sep 11 14:05:50.215 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
Sep 11 14:54:02.016 INFO Requesting blinded header from connected builder, parent_hash: 0x82cf0f77b3167e9dde77cb43e1961b16043a42b01343391b4650e2880417ae8a, pubkey: 0xa477d7862977976b5891000d3bd1ef61ce8c296681c017c9cbeb52e7aab71d84fb751e4de7129a227c481f2556a5b691, slot: Slot(3866670), service: exec
Sep 11 14:54:02.106 INFO No payload provided by connected builder. Attempting to propose through local execution engine, service: exec
PixelNoob commented 2 years ago

I am getting same issue on mainnet and goerli, also running lighthouse, I do wonder if there just isn't any bid/block available or if it something else, will follow the issue just in case!

metachris commented 2 years ago

How often and under which circumstances are you calling getHeader? Our builders are only building for slots that have a registered validator.

PixelNoob commented 2 years ago

How often and under which circumstances are you calling getHeader? Our builders are only building for slots that have a registered validator.

I am using standard lighthouse architecture connected to mev-boost, the header is called when I am about to produce a block I believe and registration is done every 5 minutes ... my validators are ready as I can see on flashbots api, for example this one: https://boost-relay.flashbots.net/relay/v1/data/validator_registration?pubkey=0x872d7cb9b61e4002a9f56cc8db4434924120ca7f1a58ee5661e745ed03d19c60a6d00c0f76f3e04b140f3b60f2b1a6ce

moshe-blox commented 2 years ago

We use Lighthouse BN, so same as behavior as @PixelNoob.

However, we had a very big delay of 1-3 seconds between the slot time and until we requested the BN to produce a blinded block (which should call getHeader).

After we reduced the delay down to between 0.08s to 0.3s, this problem completely went away.

On the other hand, around the same time we've added 2 relays in addition to Flashbots (bloXroute and Blocknative), so this could've helped, but I doubt it.

@PixelNoob Can you check in mev-boost's logs -- when exactly did it first receive the getHeader call (path is /eth/v1/builder/header/) for that proposal where it said "no bid"? Can you share the log here with the timestamp & slot?

PixelNoob commented 2 years ago

On the other hand, around the same time we've added 2 relays in addition to Flashbots (bloXroute and Blocknative), so this could've helped, but I doubt it.

This did it for me, added bloXroute and Blocknative and we have then produced MEV blocks with other relays but not yet with flashbot, so now I am thinking is a flashbot relay issue and not MEV-BOOST software.

I will check logs and get back to you.

moshe-blox commented 2 years ago

@PixelNoob Sidenote regarding bloXroute: we had missed 2 proposals and at least one other user missed one as well. See https://discord.com/channels/638409433860407300/1012038992881012736/1022066616172822578

You may want to disable bloXroute for now, at least until they reply.

Update: bloXroute seem to have fixed this issue and refunded missed proposers :-)

metachris commented 1 year ago

Is this still an active issue?

moshe-blox commented 1 year ago

Is this still an active issue?

Not for us, and seeing as nobody else commented by now, I think we can close.

zheli commented 1 year ago

We use Lighthouse BN, so same as behavior as @PixelNoob.

However, we had a very big delay of 1-3 seconds between the slot time and until we requested the BN to produce a blinded block (which should call getHeader).

After we reduced the delay down to between 0.08s to 0.3s, this problem completely went away.

@moshe-blox Sorry for commenting on an old issue, but how did you reduce the delay from 1-3 seconds to 0.3s? Do you mean you optimized the lighthouse server to produce blinded block faster?