Archive toggle to turn off archiving processed records

[dazza-codes]

Fix #32 (as discussed in standup today), including:

• placing config params into reasonable groups
  • gather the path definitions with the path creation
• add a config param to toggle archiving processed records
  • a new requirement is to switch off archiving processed records
• add config params to toggle replacing existing records
  • this was an experimental option that is working OK now and should be explicit
  • these will be turned on when archiving processed records is turned off
• generalize the reset_and_run*.sh scripts
  • these were experimental options, but they are working and can be used generally
  • these restore data to be processed from private repo and archives (non-destructive updates only)