search

antonyscerri / test

0 stars 0 forks source link

Knowledge Graph Generation #1

Open MikeDoes opened 2 years ago

MikeDoes commented 2 years ago

Hello fellow developer, Much alike you I have been struggling with this task of knowledge graph generation and evaluating their performance using OIE 2016. Perhaps, I think it would be wise to have a quick zoom chat regarding this matter. Kindly let me know what time you are available this week. Perhaps, Tuesday morning or this evening after 7? Best Regards. Michael

antonyscerri commented 2 years ago

Hi

At this stage i have been looking at DeepEx and not trying to run the other tools to generate their outputs. We have used/tried a number of the tools in the past, but this very much depends on exact kind of output you expect, the type of content you are processing and the domains they cover.

Each of the tools produced a different output and the evaluation script handles that when scoring their outputs via multiple flags. However the scripts all needed minor modifications from their current states.

If you havent found it there is another repository for the OIE 2016 benchmark from the same authors, https://github.com/gabrielStanovsky/oie-benchmark

however I couldnt tell whether this or the supervised_oie repository were meant to be the latest as they are different. There is an alternative benchmark if you havent come across it you might want to look at https://github.com/gkiril/benchie I havent tried that one yet.

For the time being my work has taken me away from this topic.

Tony