search

hasadna / OpenPress

Open Press Archive Repo
MIT License
2 stars 8 forks source link

DB index validator #49

Open yanivpas opened 9 years ago

yanivpas commented 9 years ago

We should write a script that check that all the newspapers are indexed in the DB.

acarmel commented 9 years ago

If you insert them to the DB and the insertion succeeded, why do we need double check?

On Wed, Aug 27, 2014 at 8:00 PM, yanivpas notifications@github.com wrote:

We should write a script that check that all the newspapers are indexed in the DB.

— Reply to this email directly or view it on GitHub https://github.com/hasadna/OpenPress/issues/49.

Regards, Avishai Carmel

yanivpas commented 9 years ago

In an ideal world you are right we wouldn't, but there are a lot of newspapers and a lot of scrpits that handle them from the archive to the DB and we don't check that those scripts are proccessing all the newspapers so we might lose some newspapers on the way. that's why we need a script to check and to tell us which one was lost.