So for the current webscrapers (SEC, EnnexOS, PacificPower), instead of having to use block comments (that you need to edit every time) to control upload, we can switch to something like this (wrap it around the code block where the uploading is happening)
if (!process.argv.includes("--no-upload")) {
// insert upload code here;
}
I was thinking to set a flag only to disable uploading, since the default behavior on production is to allow uploading (if more arguments are needed on production, we will need to update the dockerfile).
And then you call the script with node <scriptname>.js --no-upload
Example from check-acq:
So for the current webscrapers (SEC, EnnexOS, PacificPower), instead of having to use block comments (that you need to edit every time) to control upload, we can switch to something like this (wrap it around the code block where the uploading is happening)
I was thinking to set a flag only to disable uploading, since the default behavior on production is to allow uploading (if more arguments are needed on production, we will need to update the dockerfile).
And then you call the script with
node <scriptname>.js --no-upload