abu-rayyan / crawper

A python based crawler and scraper
0 stars 0 forks source link

Re scrap whose data contains null values #3

Closed ghost closed 6 years ago

ghost commented 6 years ago

Sometimes the database got entries which contains some null values, for now we are discarding them via null value constraint but in the future we need to re scrap them to get the actual values and insert them to the database properly.

ghost commented 6 years ago

addressed in: https://github.com/ExpertsVision/crawper/commit/88ec4d3a848be2f31487d6b1753680b7b60ed218