support for other wiki sites (wikipedia, wikisource, wikibooks ...)

athalhammer / danker

Compute PageRank on >3 billion Wikipedia links on off-the-shelf hardware.

GNU General Public License v3.0

54 stars 4 forks source link

Closed chezsick closed 4 years ago

chezsick commented 4 years ago

hi/hello, is possible to add to access other wiki sites than wikipedia? like wikisource wikibooks wiktionary etc...

thanks to add, sick.

athalhammer commented 4 years ago

Hi @chezsick, could you explain the use case you have in mind? I think it should be possible but some modifications would be required.

chezsick commented 4 years ago

just to modify the argument language current :: ./danker.sh LANG [BIGMEM] request :: ./danker.sh LANG[SITE] [BIGMEM]

for example if i want wikinews ::: ./danker.sh ennews BIGMEM and for all edition of wikinews ::: ./danker ALLnews

athalhammer commented 4 years ago

okay, working on it in branch feature/include-other-wiki-projects

athalhammer commented 4 years ago

Added experimental support for wikibooks, wikisource, wikiversity, and wikinews. To add further projects is straight-forward. You can do now:

./danker.sh ALL -p books
./danker.sh en --project source

chezsick commented 4 years ago

Thank you very much!!!

cheznewa commented 4 years ago

and it possible add wiktionary project?

athalhammer commented 4 years ago

Let me look into this (it may take a while). I would also be curious about your concrete use case, if you want to share.

athalhammer commented 4 years ago

This is supported now, e.g. ./danker.sh ast --project wiktionary