search

openzim / mwoffliner

Mediawiki scraper: all your wiki articles in one highly compressed ZIM file
https://www.npmjs.com/package/mwoffliner
GNU General Public License v3.0
281 stars 72 forks source link

Unable to scrape wikibooks it with 1.9.3 #816

Closed kelson42 closed 5 years ago

kelson42 commented 5 years ago 
mwoffliner --mwUrl="https://it.wikibooks.org" --adminEmail="contact@kiwix.org" --format="nopic" --format="novid" --useCache --addNamespaces="4" --redis="redis://redis" --outputDirectory="/output"

gives

{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Forze_armate_mondiali_dal_secondo_dopoguerra_al_XXI_secolo/USA:_aerei_d'attacco","oldId":361926,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 15909.318496704102ms","longMsg":"completed wt2html in 15909.318496704102ms","levelPath":"info","time":"2019-06-13T15:27:31.296Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Orientamento/Trucchi_e_consigli","oldId":250839,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 3365.4062118530273ms","longMsg":"completed wt2html in 3365.4062118530273ms","levelPath":"info","time":"2019-06-13T15:27:31.395Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Wikibooks:Pagine_da_cancellare/Linguaggio_C/Il_linguaggio/Varianti","oldId":89259,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 847.2566719055176ms","longMsg":"completed wt2html in 847.2566719055176ms","levelPath":"info","time":"2019-06-13T15:27:31.449Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Guida_alle_costellazioni/Panoramica","oldId":355590,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 3822.8186893463135ms","longMsg":"completed wt2html in 3822.8186893463135ms","levelPath":"info","time":"2019-06-13T15:27:31.529Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Biologia_per_il_liceo/Il_sistema_immunitario","oldId":348779,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 4373.480182647705ms","longMsg":"completed wt2html in 4373.480182647705ms","levelPath":"info","time":"2019-06-13T15:27:31.709Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Pneumologia","oldId":305814,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2816.645486831665ms","longMsg":"completed wt2html in 2816.645486831665ms","levelPath":"info","time":"2019-06-13T15:27:31.963Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"HTML/Multimedia","oldId":172042,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 172042 for html","longMsg":"redirecting to revision\n172042\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:32.036Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Libro_di_cucina/Nutrizione/Vitamine","oldId":49992,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 5753.304956436157ms","longMsg":"completed wt2html in 5753.304956436157ms","levelPath":"info","time":"2019-06-13T15:27:32.122Z","v":0}
[log] [2019-06-13T15:27:32.146Z] Worker [3] Processing batch of article ids [["Latino/Subordinata_finale","Biografie_cristologiche/Disposizioni_e_differenze","+8 more"]]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"HTML/Multimedia","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:32.186Z","v":0}
[log] [2019-06-13T15:27:32.502Z] Progress downloading articles [4310/11754] [36.6%]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Chimica_organica/Eterociclici","oldId":351789,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 351789 for html","longMsg":"redirecting to revision\n351789\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:32.617Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Chimica_organica/Eterociclici","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:32.698Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Latino/Subordinata_finale","oldId":359449,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 359449 for html","longMsg":"redirecting to revision\n359449\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:32.780Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Fisica_tecnica","oldId":231885,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 3196.639238357544ms","longMsg":"completed wt2html in 3196.639238357544ms","levelPath":"info","time":"2019-06-13T15:27:32.859Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Elettronica_pratica/Condensatori","oldId":347808,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 347808 for html","longMsg":"redirecting to revision\n347808\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:32.890Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Latino/Subordinata_finale","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:32.929Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Elettronica_pratica/Condensatori","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:32.975Z","v":0}
[log] [2019-06-13T15:27:33.033Z] Worker [11] Processing batch of article ids [["Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Sardegna/Provincia_di_Cagliari/Cagliari/Chiesa_di_San_Sepolcro","Wikibooks:Check_user","+8 more"]]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Osservare_il_cielo/Carte_celesti:_15_novembre_ore_22:00","oldId":153947,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 153947 for html","longMsg":"redirecting to revision\n153947\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:33.163Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Wikijunior_Versi_degli_animali/Pecora","oldId":247288,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 247288 for html","longMsg":"redirecting to revision\n247288\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:33.164Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Spedizioni/Preventivo","oldId":116138,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 116138 for html","longMsg":"redirecting to revision\n116138\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:33.164Z","v":0}
[log] [2019-06-13T15:27:33.369Z] Worker [13] Processing batch of article ids [["Libro_di_cucina/Ricette/Filetti_di_sogliole_allo_zafferano","La_religione_greca/Le_religioni_dei_misteri/Il_Dionisismo","+8 more"]]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"L'uomo_di_casa/Impianto_elettrico/Cavi","oldId":347453,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 347453 for html","longMsg":"redirecting to revision\n347453\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:33.403Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Osservare_il_cielo/Carte_celesti:_15_novembre_ore_22:00","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:33.427Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Wikijunior_Versi_degli_animali/Pecora","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:33.432Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Spedizioni/Preventivo","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:33.437Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Ebraico/Alfabeto","oldId":344730,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 5826.866367340088ms","longMsg":"completed wt2html in 5826.866367340088ms","levelPath":"info","time":"2019-06-13T15:27:33.529Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"L'uomo_di_casa/Impianto_elettrico/Cavi","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:33.541Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Apicoltura/Propoli","oldId":349959,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 6388.109436035156ms","longMsg":"completed wt2html in 6388.109436035156ms","levelPath":"info","time":"2019-06-13T15:27:33.771Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"I_promessi_sposi/Analisi_del_capitolo_4","oldId":222752,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 4114.357776641846ms","longMsg":"completed wt2html in 4114.357776641846ms","levelPath":"info","time":"2019-06-13T15:27:33.771Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Pascal/Gestione_avanzata_dei_dati","oldId":219444,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 5155.408828735352ms","longMsg":"completed wt2html in 5155.408828735352ms","levelPath":"info","time":"2019-06-13T15:27:34.281Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Carmina_(Catullo)/101","oldId":226265,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 226265 for html","longMsg":"redirecting to revision\n226265\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:34.293Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Sardegna/Provincia_di_Cagliari/Cagliari/Chiesa_di_San_Sepolcro","oldId":305966,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 305966 for html","longMsg":"redirecting to revision\n305966\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:34.293Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Confessione_di_fede_di_Ginevra_(1536)","oldId":348540,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 348540 for html","longMsg":"redirecting to revision\n348540\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:34.293Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Libro_di_cucina/Ricette/Filetti_di_sogliole_allo_zafferano","oldId":142565,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 142565 for html","longMsg":"redirecting to revision\n142565\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:34.293Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Puglia/Provincia_di_Lecce/Lecce/Lecce_-_Basilica_di_Santa_Croce","oldId":282232,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 14836.006242752075ms","longMsg":"completed wt2html in 14836.006242752075ms","levelPath":"info","time":"2019-06-13T15:27:34.554Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Carmina_(Catullo)/101","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:34.654Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Sardegna/Provincia_di_Cagliari/Cagliari/Chiesa_di_San_Sepolcro","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:34.659Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Confessione_di_fede_di_Ginevra_(1536)","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:34.664Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Libro_di_cucina/Ricette/Filetti_di_sogliole_allo_zafferano","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:34.668Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Usare_Wikibooks/Contribuire","oldId":270739,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 270739 for html","longMsg":"redirecting to revision\n270739\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:35.086Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Usare_Wikibooks/Contribuire","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:35.198Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"HTML/Multimedia","oldId":172042,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 3146.314573287964ms","longMsg":"completed wt2html in 3146.314573287964ms","levelPath":"info","time":"2019-06-13T15:27:35.331Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Wikijunior_Versi_degli_animali/Pecora","oldId":247288,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2081.6821479797363ms","longMsg":"completed wt2html in 2081.6821479797363ms","levelPath":"info","time":"2019-06-13T15:27:35.511Z","v":0}
[log] [2019-06-13T15:27:35.573Z] Progress downloading articles [4320/11754] [36.7%]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Cinese/Fondamenti","oldId":198539,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 198539 for html","longMsg":"redirecting to revision\n198539\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:35.735Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Libro_di_cucina/Ricette/Filetti_di_sogliole_allo_zafferano","oldId":142565,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1132.9654483795166ms","longMsg":"completed wt2html in 1132.9654483795166ms","levelPath":"info","time":"2019-06-13T15:27:35.799Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Cinese/Fondamenti","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:35.817Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Lazio/Città_metropolitana_di_Roma/Roma/Roma_-_Tempio_Maggiore","oldId":293513,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 293513 for html","longMsg":"redirecting to revision\n293513\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:35.931Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Lazio/Città_metropolitana_di_Roma/Roma/Roma_-_Tempio_Maggiore","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:35.986Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Osservare_il_cielo/Carte_celesti:_15_novembre_ore_22:00","oldId":153947,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2601.868101119995ms","longMsg":"completed wt2html in 2601.868101119995ms","levelPath":"info","time":"2019-06-13T15:27:36.026Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Veneto/Provincia_di_Padova/Teolo","oldId":332032,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 332032 for html","longMsg":"redirecting to revision\n332032\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:36.284Z","v":0}
[log] [2019-06-13T15:27:36.379Z] Worker [14] Processing batch of article ids [["Costigiola/Bagolaro","Forze_armate_mondiali_dal_secondo_dopoguerra_al_XXI_secolo/USA-portaerei","+9 more"]]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Veneto/Provincia_di_Padova/Teolo","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:36.449Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":40,"logType":"warn/dsr/inconsistent","wiki":"wiki$0","title":"Carmina_(Catullo)/101","oldId":226265,"reqId":null,"userAgent":"service-mobileapp-node","msg":"DSR inconsistency: cs/s mismatch for node: BR s: 1588 ; cs: 1540","longMsg":"DSR inconsistency: cs/s mismatch for node:\nBR\ns:\n1588\n; cs:\n1540","levelPath":"warn/dsr/inconsistent","time":"2019-06-13T15:27:36.467Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Sardegna/Provincia_di_Sassari","oldId":340276,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 14509.088027954102ms","longMsg":"completed wt2html in 14509.088027954102ms","levelPath":"info","time":"2019-06-13T15:27:36.742Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Carmina_(Catullo)/101","oldId":226265,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2236.9325561523438ms","longMsg":"completed wt2html in 2236.9325561523438ms","levelPath":"info","time":"2019-06-13T15:27:36.889Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Forze_armate_mondiali_dal_secondo_dopoguerra_al_XXI_secolo/Giappone","oldId":349742,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 349742 for html","longMsg":"redirecting to revision\n349742\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.027Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Toscana/Provincia_di_Massa_e_Carrara/Pontremoli/Montelungo_-_Chiesa_di_San_Benedetto","oldId":339505,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 339505 for html","longMsg":"redirecting to revision\n339505\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.065Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Forze_armate_mondiali_dal_secondo_dopoguerra_al_XXI_secolo/Giappone","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.181Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Costigiola/Bagolaro","oldId":262518,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 262518 for html","longMsg":"redirecting to revision\n262518\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.214Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Toscana/Provincia_di_Massa_e_Carrara/Pontremoli/Montelungo_-_Chiesa_di_San_Benedetto","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.226Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"La_religione_greca/Le_religioni_dei_misteri/Il_Dionisismo","oldId":362064,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 362064 for html","longMsg":"redirecting to revision\n362064\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.302Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Confessione_di_fede_di_Ginevra_(1536)","oldId":348540,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2642.9239444732666ms","longMsg":"completed wt2html in 2642.9239444732666ms","levelPath":"info","time":"2019-06-13T15:27:37.305Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Costigiola/Bagolaro","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.349Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"La_religione_greca/Le_religioni_dei_misteri/Il_Dionisismo","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.452Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Filosofia_dell'informazione","oldId":338701,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 338701 for html","longMsg":"redirecting to revision\n338701\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.657Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Filosofia_dell'informazione","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.713Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Napoletano/Pronomi","oldId":360290,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 360290 for html","longMsg":"redirecting to revision\n360290\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:37.722Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"L'uomo_di_casa/Impianto_elettrico/Cavi","oldId":347453,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 4301.588291168213ms","longMsg":"completed wt2html in 4301.588291168213ms","levelPath":"info","time":"2019-06-13T15:27:37.840Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Napoletano/Pronomi","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:37.858Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Elettronica_pratica/Condensatori","oldId":347808,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 4976.530857086182ms","longMsg":"completed wt2html in 4976.530857086182ms","levelPath":"info","time":"2019-06-13T15:27:37.950Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Greco_moderno/Aoristo","oldId":348688,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 7368.322528839111ms","longMsg":"completed wt2html in 7368.322528839111ms","levelPath":"info","time":"2019-06-13T15:27:38.036Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Latino/Subordinata_finale","oldId":359449,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 5228.27264213562ms","longMsg":"completed wt2html in 5228.27264213562ms","levelPath":"info","time":"2019-06-13T15:27:38.155Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Grammatica_contestuale/Introduzione","oldId":131292,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 131292 for html","longMsg":"redirecting to revision\n131292\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:38.770Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Grammatica_contestuale/Introduzione","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:38.865Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"La_religione_greca/Le_religioni_dei_misteri/Il_Dionisismo","oldId":362064,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 1473.083999633789ms","longMsg":"completed wt2html in 1473.083999633789ms","levelPath":"info","time":"2019-06-13T15:27:38.923Z","v":0}
[log] [2019-06-13T15:27:39.026Z] Progress downloading articles [4330/11754] [36.8%]
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Chimica_organica/Cose_da_fare","oldId":346311,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 13608.804914474487ms","longMsg":"completed wt2html in 13608.804914474487ms","levelPath":"info","time":"2019-06-13T15:27:39.230Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Il_buddhismo_mahāyāna/Le_dottrine_\"mahāyāna\"","oldId":286383,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 286383 for html","longMsg":"redirecting to revision\n286383\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:39.230Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Il_buddhismo_mahāyāna/Le_dottrine_\"mahāyāna\"","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:39.297Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Emilia-Romagna/Provincia_di_Faenza/Faenza/Granarolo_Faentino_-_Chiesa_di_San_Giovanni_Evangelista","oldId":310626,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 310626 for html","longMsg":"redirecting to revision\n310626\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:39.527Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Roccia/Materiali/Corda","oldId":230515,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 230515 for html","longMsg":"redirecting to revision\n230515\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:39.552Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Usare_Wikibooks/Contribuire","oldId":270739,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 4454.234052658081ms","longMsg":"completed wt2html in 4454.234052658081ms","levelPath":"info","time":"2019-06-13T15:27:39.650Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Italia/Emilia-Romagna/Provincia_di_Faenza/Faenza/Granarolo_Faentino_-_Chiesa_di_San_Giovanni_Evangelista","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:39.677Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Francia/Hauts-de-France/Oise/Beauvais/Bauvais_-_Église_Notre-Dame-de-la-Basse-Œuvre","oldId":360532,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 360532 for html","longMsg":"redirecting to revision\n360532\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:39.696Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Roccia/Materiali/Corda","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:39.768Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Costigiola/Bagolaro","oldId":262518,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 2480.5366077423096ms","longMsg":"completed wt2html in 2480.5366077423096ms","levelPath":"info","time":"2019-06-13T15:27:39.827Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Disposizioni_foniche_di_organi_a_canne/Europa/Francia/Hauts-de-France/Oise/Beauvais/Bauvais_-_Église_Notre-Dame-de-la-Basse-Œuvre","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:39.878Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Biografie_cristologiche/Disposizioni_e_differenze","oldId":360479,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 360479 for html","longMsg":"redirecting to revision\n360479\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:39.888Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Spedizioni/Preventivo","oldId":116138,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 6532.650192260742ms","longMsg":"completed wt2html in 6532.650192260742ms","levelPath":"info","time":"2019-06-13T15:27:39.967Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Biografie_cristologiche/Disposizioni_e_differenze","oldId":null,"reqId":null,"userAgent":"service-mobileapp-node","msg":"started wt2html","longMsg":"started wt2html","levelPath":"info","time":"2019-06-13T15:27:39.998Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Il_buddhismo_mahāyāna/Le_dottrine_\"mahāyāna\"","oldId":286383,"reqId":null,"userAgent":"service-mobileapp-node","msg":"completed wt2html in 792.6169567108154ms","longMsg":"completed wt2html in 792.6169567108154ms","levelPath":"info","time":"2019-06-13T15:27:40.087Z","v":0}
{"name":"parsoid","hostname":"2a3c3c858027","pid":1,"level":60,"levelPath":"fatal","msg":"Timed out processing: wiki$0/Rumeno/Verbi?oldid=346657","time":"2019-06-13T15:27:40.134Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Piemontese/Varietà_locali","oldId":280094,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 280094 for html","longMsg":"redirecting to revision\n280094\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:40.195Z","v":0}
{"name":"mwoffliner","hostname":"2a3c3c858027","pid":1,"level":30,"logType":"info","wiki":"wiki$0","title":"Libro_di_cucina/Ricette/Torta_di_ciliegie_della_Foresta_Nera","oldId":334297,"reqId":null,"userAgent":"service-mobileapp-node","msg":"redirecting to revision 334297 for html","longMsg":"redirecting to revision\n334297\nfor\nhtml","levelPath":"info","time":"2019-06-13T15:27:40.195Z","v":0}
[log] [2019-06-13T15:27:40.266Z] Exiting with code [1]
[log] [2019-06-13T15:27:40.266Z] Deleting tmp dump dir [/tmp/mwo-dump-1560437893232]
[log] [2019-06-13T15:27:40.268Z] Clearing Cache Directory
kelson42 commented 5 years ago

@ISNIT0 It seems parsoid/mcs is running here. I wonder why!?

ISNIT0 commented 5 years ago

@kelson42 The URL used to check if MCS is available is (as always) the main page: https://it.wikibooks.org/api/rest_v1/page/mobile-sections/Pagina_principale

This gives an error, and so MWO is forced to start a local version 😄

There is no MCS on it.wikibooks.org:

In the mobile section, you should see an endpoint like /page/mobile-sections/{title} if MCS is enabled

ISNIT0 commented 5 years ago

Parsoid is timing out processing this article: https://it.wikibooks.org/wiki/Rumeno/Verbi

kelson42 commented 5 years ago

@ISNIT0 So this ticket is a duplicate of #767? @ISNIT0 Why WMF is able to generate online version with Parsoid/MCS here https://it.m.wikibooks.org/wiki/Rumeno/Verbi and we are not?

kelson42 commented 5 years ago

Duplicate of #767