search

enviodev / hyperindex

📖 Blazing-fast multi-chain indexer
https://envio.dev
76 stars 5 forks source link

Missing event in Fuel indexer #278

Open DZakh opened 2 weeks ago

DZakh commented 2 weeks ago

Describe the bug

The project has two deployments, this one contains a missing event: https://envio.dev/app/mira-amm/mira-indexer-mainnet/825a80f/runtime-logs

I can see a single error in logs: 

2024-10-18T17:49:40.106Z | error | get data Caused by: 0: get arrow data 1: http response status code 504 Gateway Timeout, err body: <html> <head><title>504 Gateway Time-out</title></head> <body> <center><h1>504 Gateway Time-out</h1></center> <hr><center>nginx</center> </body> </html> | 9889 | 4201724 - 4201733 | fetchStateRegister: "root"addresses: ["0x2e40f2b244b98ed6b8204b3de0156c6961f98525c8162f80162fcf53eebd90e7"]error: {"type":"Error","message":"get data\n\nCaused by:\n 0: get arrow data\n 1: http response status code 504 Gateway Timeout, err body: <html>\r\n <head><title>504 Gateway Time-out</title></head>\r\n <body>\r\n <center><h1>504 Gateway Time-out</h1></center>\r\n <hr><center>nginx</center>\r\n </body>\r\n </html>\r\n ","stack_trace":"Error: get data\n\nCaused by:\n 0: get arrow data\n 1: http response status code 504 Gateway Timeout, err body: <html>\r\n <head><title>504 Gateway Time-out</title></head>\r\n <body>\r\n <center><h1>504 Gateway Time-out</h1></center>\r\n <hr><center>nginx</center>\r\n </body>\r\n </html>\r\n "}blockNumber: 4201733logType: "hypersync get blockhash query"workerType: "HyperFuel"msg: "Failure. Retrying 1/5 in 1000ms"
-- | -- | -- | -- | -- | --
chain: 9889
blocks: 4201724 - 4201733
fetchStateRegister: "root"
addresses: ["0x2e40f2b244b98ed6b8204b3de0156c6961f98525c8162f80162fcf53eebd90e7"]
error: {"type":"Error","message":"get data\n\nCaused by:\n 0: get arrow data\n 1: http response status code 504 Gateway Timeout, err body: <html>\r\n <head><title>504 Gateway Time-out</title></head>\r\n <body>\r\n <center><h1>504 Gateway Time-out</h1></center>\r\n <hr><center>nginx</center>\r\n </body>\r\n </html>\r\n ","stack_trace":"Error: get data\n\nCaused by:\n 0: get arrow data\n 1: http response status code 504 Gateway Timeout, err body: <html>\r\n <head><title>504 Gateway Time-out</title></head>\r\n <body>\r\n <center><h1>504 Gateway Time-out</h1></center>\r\n <hr><center>nginx</center>\r\n </body>\r\n </html>\r\n "}
blockNumber: 4201733
logType: "hypersync get blockhash query"
workerType: "HyperFuel"
msg: "Failure. Retrying 1/5 in 1000ms"

Version: 2.5.2

DZakh commented 2 weeks ago

@JasoonS Do you have some context, whether the event might be lost on HyperFuel side? NOTE: I didn't investigate the HyperIndex side yet

JasoonS commented 2 weeks ago

@DZakh - it is possible, but I think unlikely. We can query for discrepancies between the two nodes tomorrow.

DZakh commented 2 weeks ago

@JasoonS Found one missing block, although looks like it's not related to the error in the logs.

nextBlock 4259956 archiveHeight 4609041
nextBlock 4259956 archiveHeight 4609042
total blocks in endpoint 1: 4367
total blocks in endpoint 2: 4366
Missing blocks in endpoint 1: []
Missing blocks in endpoint 2: [
  4240183
]
total receipts in endpoint 1: 6042
total receipts in endpoint 2: 6041
Missing receipts in endpoint 1 (blockHeight, txId, receiptIndex): []
Missing receipts in endpoint 2 (blockHeight, txId, receiptIndex): [
  "4240183-0x2a86bb6bf514a834c842dfec7316e231f49793f2d0c9269202b1a4bed3ec0a98-8"
]
total receipts blocks in endpoint 1: 4367
total receipts blocks in endpoint 2: 4366
Do all receipt block heights match block selection in endpoint 1? true
Do all receipt block heights match block selection in endpoint 2? true