search

algorand / conduit

Algorand's data pipeline framework.
MIT License
37 stars 26 forks source link

Prompt user before going backwards to catchpoint #96

Open joe-p opened 1 year ago

joe-p commented 1 year ago

Problem

If a user runs conduit with the -r flag to specify a specific start round, then exits the process, then reruns the same command, conduit will immediately set the follower node back to the most recent catchpoint and restart the entire catchup process, which is very time consuming.

Solution

Have conduit prompt the user if they want to revert to the given round. Probably good to have a flag to automatically answer yes for non-interactive environments.

Dependencies

None, should be minimal effort. I can take a crack at it this week but don't have a ton of Go experience.

Urgency

Medium? Definitely would cause for less head-to-desk moments when developing/deploying conduit.

winder commented 1 year ago

How about an allow-backwards-catchup option in the algod importer? The command line flags are intentionally kept very minimal.

A PR for this feature would be appreciated.

joe-p commented 1 year ago

Seems reasonable to me. Will work on it this week.