streamingfast / substreams

Powerful Blockchain streaming data engine, based on StreamingFast Firehose technology.
Apache License 2.0
159 stars 45 forks source link

Different Module Initial Block on different spkgs #265

Closed Eduard-Voiculescu closed 1 year ago

Eduard-Voiculescu commented 1 year ago

Currently there is an issue with the latest of develop when trying to run a substreams which pulls in an spkg and that the start block of the spkg is before the start block of the current substreams. (I do not know if this also happens if the start block is AFTER the current substreams).

How to reproduce:

substreams run hivemapper-v0.1.4.spkg map_outputs -e mainnet.sol.streamingfast.io:443 --production-mod

Expected error:

Error: rpc error: code = Unknown desc = rpc error: code = Internal desc = error during init_stores_and_backprocess: failed run_parallel_process: parallel processing run: scheduler run: process job result for module "map_outputs": job ended in error: receiving stream resp: rpc error: code = Internal desc = error building pipeline: failed to setup subrequest stores: load full store address_lookup_tables:store_address_lookup_tables_stage_2 (d27a4554b2125b91d3daf2847e09915ef09d751c): load full store address_lookup_tables:store_address_lookup_tables_stage_2 at 0158558168-0154656000.kv: opening file gs://dfuseio-global-substreams-uscentral/sol-mainnet/substreams-states/v4/d27a4554b2125b91d3daf2847e09915ef09d751c/states?project=dfuseio-global: not found

hivemapper-v0.1.4.spkg.gz

abourget commented 1 year ago

Tracked in: https://github.com/streamingfast/substreams/issues/262