spencermountain dumpster-dive issues

spencermountain / dumpster-dive

roll a wikipedia dump into mongo

Other

240 stars 46 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

allow upserting mongo docs on re-runs

#116 einSelbst closed 3 months ago
3
Add info about lbzip2 to README.md

#115 einSelbst closed 3 months ago
1
Bump mongodb from 5.6.0 to 5.8.0

#113 dependabot[bot] closed 2 months ago
1
Bump semver from 7.3.5 to 7.5.4

#112 dependabot[bot] closed 1 year ago
1
Error messages when loading wikipedia pages into mongodb

#111 e501 opened 1 year ago
3
Bump semver from 7.3.5 to 7.5.3

#110 dependabot[bot] closed 1 year ago
1
fixed wget examples so they have horizontal scrolling and a copy button

#109 rg3h closed 1 year ago
0
Update wikipedia data path example

#108 rg3h closed 1 year ago
1
Update/dependencies

#107 andremacola closed 1 year ago
1
Expose the instance of WTF to the options so that it's possible to use .extend()

#106 andremacola opened 1 year ago
7
Bump minimatch from 3.0.4 to 3.1.2

#105 dependabot[bot] closed 1 year ago
1
ERR_REQUIRE_ESM

#104 zinuznet closed 2 years ago
3
Bump node-fetch from 2.6.2 to 2.6.7

#103 dependabot[bot] closed 2 years ago
1
Bump minimist from 1.2.5 to 1.2.6

#102 dependabot[bot] closed 2 years ago
1
adding db_url, db, and collection options to cli mode

#101 jwnz closed 2 years ago
2
Bump shelljs from 0.8.4 to 0.8.5

#100 dependabot[bot] closed 2 years ago
1
Adding page view counts?

#99 praine closed 2 years ago
2
wtf_wikipedia doc.wikidata() is always null

#98 andremacola opened 2 years ago
1
Update wtf_wikipedia and allow wtf.extend()

#97 andremacola closed 3 years ago
2
Bump path-parse from 1.0.6 to 1.0.7

#96 dependabot[bot] closed 3 years ago
1
Default options when not using `bin/dumpster.js`

#95 shreyasminocha opened 3 years ago
1
Bump lodash from 4.17.15 to 4.17.21

#94 dependabot[bot] closed 3 years ago
1
fix db_url option issue for #92

#93 Vid201 closed 3 years ago
3
db_url is always taken from config.js

#92 Vid201 closed 3 years ago
3
Bump lodash from 4.17.15 to 4.17.20

#91 dependabot[bot] closed 3 years ago
1
Bump bl from 2.2.0 to 2.2.1

#90 dependabot[bot] closed 3 years ago
1
Not all pages are loaded into the afwiki database

#89 vyank closed 3 years ago
7
Secured Database URL is not accepted

#88 vyank closed 3 years ago
4
MongoServerSelectionError: connection <monitor> to 127.0.0.1:27017 timed out

#87 shreyasminocha closed 4 years ago
3
Bump lodash from 4.17.15 to 4.17.19

#86 dependabot[bot] closed 3 years ago
1
Process stopped dumping after a while

#85 khan990 closed 4 years ago
3
Other feeds

#84 SimonBurfield opened 4 years ago
1
--plaintext not working

#83 SimonBurfield closed 4 years ago
2
Pages not imported

#82 andreasbergqvist closed 4 years ago
6
The process does not end on Windows

#81 vyank closed 4 years ago
2
Any suggestions on running in this in the cloud?

#80 rockyhuber closed 4 years ago
2
MongoError: BSONObj Size

#78 sackio closed 4 years ago
4
Missing ids on windows

#77 jeremythille closed 4 years ago
37
await on done function for promise resolution

#76 itaiperi closed 5 years ago
1
Take custom title and pageID

#75 itaiperi closed 5 years ago
1
Parsing bug with multiple workers

#74 itaiperi opened 5 years ago
6
Title parsing error in custom function

#73 itaiperi closed 5 years ago
3
Couldn't find some tags after importing the dump

#71 etcho closed 5 years ago
6
Markdown mode collapses paragraphs

#70 mlmarenchino closed 5 years ago
1
Error on keys with periods

#69 itaiperi closed 5 years ago
1
Dev

#68 spencermountain closed 5 years ago
0
Support wikia dumps

#72 jimb-cc closed 5 years ago
3
Dev

#67 spencermountain closed 5 years ago
0
missing important pages in parsed results

#66 xgeric closed 5 years ago
9
missing pages, silent

#65 aymansalama closed 5 years ago
12