If you run the same query twice in a row, the program will report no articles found, no captions found, and an error for each of the figures previously found. After this runs, the exsclaim.json is emptied.
This might be fixed by storing information in a more sophisticated database (MongoDB or a SQL database).
A further enhancement for repeated running of the same query with a maximum_scraped amount that has been reached would be to scrap maximum_scraped additional articles for each running, without removing data from previous runs of course.
If you run the same query twice in a row, the program will report no articles found, no captions found, and an error for each of the figures previously found. After this runs, the exsclaim.json is emptied.
This might be fixed by storing information in a more sophisticated database (MongoDB or a SQL database).
A further enhancement for repeated running of the same query with a maximum_scraped amount that has been reached would be to scrap maximum_scraped additional articles for each running, without removing data from previous runs of course.