Mattschillinger / wikiteam

Automatically exported from code.google.com/p/wikiteam
0 stars 0 forks source link

exampleproblems.com download is very slow and resource-intensive #53

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
In a few days, the download of http://www.exampleproblems.com/wiki/api.php has 
managed to download only a single page:

Checking api.php... http://www.exampleproblems.com/wiki/api.php
api.php is OK
Checking index.php... http://www.exampleproblems.com/wiki/index.php
index.php is OK
Analysing http://www.exampleproblems.com/wiki/api.php
Loading config file...
Resuming previous dump process...
Title list was completed in the previous session
Resuming XML dump from "Alan Baker"
Retrieving the XML for every page from "Alan Baker"
ATTENTION: This wiki does not allow some parameters in Special:Export, 
therefore pages with large histories may be truncated
ATTENTION: This wiki does not allow some parameters in Special:Export, 
therefore pages with large histories may be truncated
    Alan Baker, 158 edits

I killed the previous attempt because it was getting near to 2 GB memory usage 
(it just slowly increases indefinitely) and alternatively idling or taking all 
CPU for a few seconds; it's still the same although with different pages.

Original issue reported on code.google.com by nemow...@gmail.com on 12 Jun 2012 at 7:04

GoogleCodeExporter commented 8 years ago

Original comment by ad...@alphacorp.tk on 23 Jun 2012 at 1:13

GoogleCodeExporter commented 8 years ago
I didn't check memory usage nor if they changed something on the wiki but it 
seems fixed now, the wiki was successfully downloaded in less than a day.

Original comment by nemow...@gmail.com on 6 Nov 2013 at 7:39