How to know which Arweave blocks to target when running the program?

DiamondDAO / Mirror.XYZ-Scraper

Collect posts from the mirror.xyz decentralized publishing platform

0 stars 0 forks source link

How to know which Arweave blocks to target when running the program? #1

Closed clemp closed 2 years ago

clemp commented 2 years ago

In the README for this project there's the instruction:

To gather all Mirror.XYZ publications between two Arweave blocks and output to a JSON, run node runPipeline <startBlock> <endBlock> '<desiredPath>.json'.

Which makes perfect sense. What's the best way to figure out which values of <startBlock> and <endBlock> to input?

nathankoerschner commented 2 years ago

See here: https://github.com/DiamondDAO/Mirror.XYZ-Scraper/blob/1468ce1a9e30740abcfebf1de8455305d0fc426f/pipeline_parts/arweave.js#L78

For the end block, can reference slightly beyond the current areweave block