Not storable on error - Githubissues

taganaka / polipus

Polipus: distributed and scalable web-crawler framework

MIT License

92 stars 32 forks source link

Not storable on error #27

Closed tmaier closed 10 years ago

tmaier commented 10 years ago

Related to #15

coveralls commented 10 years ago

Coverage remained the same when pulling f42f788db328e75c8762ac6951d77943528e1d7c on tmaier:storable into 0c8eb165b91f8eb5e1bb9cff3a97c55b0daac980 on taganaka:master.

coveralls commented 10 years ago

Coverage remained the same when pulling d478084b8fa3f53fc9778ba47073fd9cad2b1e38 on tmaier:storable into 637c70c3ccc80e73282a59ca702067d29d18234e on taganaka:master.

taganaka commented 10 years ago

Take a look at my last comment to https://github.com/taganaka/polipus/issues/15

I would prefer to let the user decide whether a page should be stored or not.

Adding the ability to store the error into the DB sounds better to me

tmaier commented 10 years ago

:+1: