New indexing - Githubissues

dbpedia / lookup

Outputs a list of ranked DBpedia resources for a search string.

Apache License 2.0

185 stars 39 forks source link

New indexing #4

Closed maxjakob closed 11 years ago

maxjakob commented 11 years ago

While updating the index to DBpedia 3.8, I made many changes along the way.

index data coming from pignlproc nerd-stats.pig that provides surface forms and scores
Indexer does not assume sorted input any more, but it speeds up the process
default_index_path is not used any more (was a weird idea to begin with) give the index dir directly to the Server
DEF dependency because we need WikiUtil and don't want to duplicate any more

IMPORTANT: added Apache License 2.0 file.

matth commented 11 years ago

This looks great! pignlproc looks very interesting too, didn't know about that one!

maxjakob commented 11 years ago

Thanks @matth, I was hoping you would take a quick look at it and give this a go.

matth commented 11 years ago

@maxjakob Thanks, not had a chance to test thoroughly yet but will hopefully deploy this week. We use lookup fairly heavily in a few of our prototypes so will put it though its paces!