Redirects handling - Githubissues

idio / wiki2vec

Generating Vectors for DBpedia Entities via Word2Vec and Wikipedia Dumps. Questions? https://gitter.im/idio-opensource/Lobby

601 stars 137 forks source link

Redirects handling #15

Open tmkhalil opened 8 years ago

tmkhalil commented 8 years ago

Hi, Well it's a question rather than an issue. I'm not a scala programmer but I want to know how do you handle the redirects...I mean, what do you mean by 'Handling redirects'...Do you replace the redicrect by the entity to which it redirects? What kind of handling? The second question is how do u deal with the non-entity pages (navigation, maintainance, and discussion pages) ? Thanks!

dav009 commented 8 years ago

At the moment redirects are not being resolved., So for example Barack Obama can be annotated in wiki as Obama and as Barack O, ideally their annotations should be replaced for a canonical identifier (this is not done at the moment)
They are currently taken into account(no namespace is being filtered)

tmkhalil commented 8 years ago

Thanks!