Open 0xroll opened 3 weeks ago
@0xroll there's some changes since I last worked on this here. I'm running the code and not seeing the issue but I don't have all the details like what the hourly_blocks.csv
is in the error case. There's definitely a suspect in the while loop to get user balances but I can't pin it down without some more details.
you can find the block numbers passed from the error message above
[2024-06-05, 15:16:44 UTC] {{task_log_fetcher.py:63}} INFO - [2024-06-05 15:16:19,426] 0 5154879 1717513197
[2024-06-05, 15:16:44 UTC] {{task_log_fetcher.py:63}} INFO - [2024-06-05 15:16:19,426] 1 5156079 1717516797
[2024-06-05, 15:16:44 UTC] {{task_log_fetcher.py:63}} INFO - [2024-06-05 15:16:19,426] 2 5157279 1717520397
[2024-06-05, 15:16:44 UTC] {{task_log_fetcher.py:63}} INFO - [2024-06-05 15:16:19,426] 3 5158479 1717523997
this might be the rootcause?
[2024-06-18, 07:25:14 UTC] {{task_log_fetcher.py:63}} INFO - [2024-06-18 07:25:03,429] 2024-06-18 07:25:03,429 WARNING root An error occurred for block [object Object]: RangeError: Maximum call stack size exceeded
@0xroll I took a look and found that some blocks have too many rows for the current implementation. I have an alternative here - https://github.com/delta-hq/l2-lxp-liquidity-reward/pull/245, let me know what you think.
@kyle-layerzero just reran and got this
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,734] chunks = self._reader.read_low_memory(nrows)
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,734] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,734] File "parsers.pyx", line 838, in pandas._libs.parsers.TextReader.read_low_memory
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,735] File "parsers.pyx", line 905, in pandas._libs.parsers.TextReader._read_rows
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,735] File "parsers.pyx", line 874, in pandas._libs.parsers.TextReader._tokenize_rows
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,735] File "parsers.pyx", line 891, in pandas._libs.parsers.TextReader._check_tokenize_status
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,735] File "parsers.pyx", line 2061, in pandas._libs.parsers.raise_parser_error
[2024-07-03, 11:13:38 UTC] {{task_log_fetcher.py:63}} INFO - [2024-07-03 11:13:26,735] pandas.errors.ParserError: Error tokenizing data. C error: Expected 7 fields in line 1001, saw 13
hey @kyle-layerzero
the adapter is having issue, please fix!