When we run the pipeline and save the response and requests to a local output folder, the file names are of the form {date}_{id}.json. This is an issue when running multiple times in the same day, adding time would be useful and truncating the uid for brevity.
When we run the pipeline and save the response and requests to a local output folder, the file names are of the form
{date}_{id}.json
. This is an issue when running multiple times in the same day, adding time would be useful and truncating the uid for brevity.