search

CormacCollins / product_crawler

1 stars 0 forks source link

Error_Logs #6

Open Ryan-Ashton opened 4 years ago

Ryan-Ashton commented 4 years ago

An Error Log Folder has been added - Some features missing OR in the wrong columns that I (Ryan) need to create exceptions for.

@CormacCollins it may be worth looking at to see if the scrape is working for the following products (we don't need to be perfect - just review).

These products are also in the error-log file:

CormacCollins commented 4 years ago

There will be missing columns in a few which we are fine with: e.g. FreeStyle Lancets will have much less than a nutrient base product.

Can you give an example of a wrong column one though, that shouldn't be happening. And should be fixed at the scrapper level. There is a logging output when running the program. It's hard to know though what is an 'Error', because not having a flavor for e.g. is a trait of most of the products.