search

sudoblockio / icon-etl

MIT License
0 stars 0 forks source link

ETL stops syncing after a while due to full queue #13

Closed pranav925 closed 3 years ago

pranav925 commented 3 years ago

The ETL stops syncing after a thousand blocks due to a "BufferError"

icon-etl_1                    | 2021-02-19 19:34:54,381 - root [INFO] - Current block 30800067, target block 10015344, last synced block 10015343, blocks to sync 1
icon-etl_1                    | 2021-02-19 19:34:54,381 - ProgressLogger [INFO] - Started work. Items to process: 1.
icon-etl_1                    | 2021-02-19 19:34:54,413 - ProgressLogger [INFO] - 1 items processed. Progress is 100%.
icon-etl_1                    | 2021-02-19 19:34:54,425 - ProgressLogger [INFO] - Finished work. Total items processed: 1. Took 0:00:00.043784.
icon-etl_1                    | 2021-02-19 19:34:54,426 - ProgressLogger [INFO] - Started work.
icon-etl_1                    | 2021-02-19 19:34:54,443 - ProgressLogger [INFO] - Finished work. Total items processed: 2. Took 0:00:00.017335.
icon-etl_1                    | 2021-02-19 19:34:54,444 - root [INFO] - Exporting with KafkaItemExporter
icon-etl_1                    | 2021-02-19 19:34:54,445 - root [ERROR] - An exception occurred while syncing block data.
icon-etl_1                    | Traceback (most recent call last):
icon-etl_1                    |   File "/root/.local/lib/python3.6/site-packages/blockchainetl_common/streaming/streamer.py", line 77, in _do_stream
icon-etl_1                    |     synced_blocks = self._sync_cycle()
icon-etl_1                    |   File "/root/.local/lib/python3.6/site-packages/blockchainetl_common/streaming/streamer.py", line 98, in _sync_cycle
icon-etl_1                    |     self.blockchain_streamer_adapter.export_all(self.last_synced_block + 1, target_block)
icon-etl_1                    |   File "/icon-etl/iconetl/streaming/icx_streamer_adapter.py", line 102, in export_all
icon-etl_1                    |     self.item_exporter.export_items(all_items)
icon-etl_1                    |   File "/icon-etl/iconetl/jobs/exporters/kafka_item_exporter.py", line 104, in export_items
icon-etl_1                    |     headers=headers,
icon-etl_1                    | BufferError: Local: Queue full
icon-etl_1                    | 2021-02-19 19:34:54,465 - root [INFO] - Nothing to sync. Sleeping for 10 seconds...

Screen Shot 2021-02-19 at 11 28 55 AM

shinyfoil commented 3 years ago

Potentially fixed in commit 7988a676d19dafebfb5a4c7804a17671a4f729ac. New container pushed to dev tag. Let me know if this resolves the issue.

shinyfoil commented 3 years ago

Potential fix merged in geometry-labs/icon-etl#4, so I'll close this for now.