Reduce size of export when getting 5xx errors, or just skip

trappedinspacetime / wikiteam

Automatically exported from code.google.com/p/wikiteam

0 stars 0 forks source link

Reduce size of export when getting 5xx errors, or just skip #79

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago

On the English wikihow, dumpgenerator fails consistently when hitting a few 
pages, which are just too big and return a "varnish guru meditation" error when 
exported manually.
The script should recognise such errors and reduce the size of its request; 
and/or skip such pages entirely, adding them to a list of titles to be dealt 
with by a human after the script run.

Original issue reported on code.google.com by nemow...@gmail.com on 19 Nov 2013 at 6:04

GoogleCodeExporter commented 8 years ago

Sorry, forgot the example titles:

User_kudos:Benrubes/Archive/1
User_kudos:Dreamgal2/Archive/1
User_kudos:Dreamgal2/Archive/6

Original comment by nemow...@gmail.com on 19 Nov 2013 at 6:04