make the process "fully incremental" i.e. ensure only updating portion with new data if re-run #34

Open ashlinrichardson opened 2 weeks ago