Convert all print statements to logging. This is important, as logging is a powerful tool which allows you not only to print on screen your statements as is done now, but you can save these prints to a logging file. These logging files are very important as once you have these scrapers running automatically on a server, they save the print statements. If the program ever crashes (which unfortunately all code eventually does :p) the logging file is one of the first places that coders look for clues as to where the error occurred.
Convert all print statements to logging. This is important, as logging is a powerful tool which allows you not only to print on screen your statements as is done now, but you can save these prints to a logging file. These logging files are very important as once you have these scrapers running automatically on a server, they save the print statements. If the program ever crashes (which unfortunately all code eventually does :p) the logging file is one of the first places that coders look for clues as to where the error occurred.