Open samjett247 opened 5 years ago
Timestamping the scraping by a global timestamp would make development easier and ensure proper versioning of scraped results/files/etc. This could include piping the output of each scrape to a timestamped file.
I agree this is a good idea. Where are you thinking of "stamping" (mongo/backups/etc?)
Timestamping the scraping by a global timestamp would make development easier and ensure proper versioning of scraped results/files/etc. This could include piping the output of each scrape to a timestamped file.