search

percyliang / sempre

Semantic Parser with Execution
Other
828 stars 299 forks source link

freebase download failure #180

Open guihaomin opened 6 years ago

guihaomin commented 6 years ago

I tried to do the ./pull-dependencies fullfreebase-vdb in the tutorial. However the script segmentation fault at the last %1....

ppasupat commented 6 years ago
guihaomin commented 6 years ago

I figure out the problem is a wget bug in version 1.19.1. I downloaded and compiled/install wget 1.91.4 and that solved the issue.

Vimos commented 6 years ago

May I ask if this freebase for WebQuestions or SimpleQuestions? Or it's just a subset for fun?

Here are the stats for the freebase vdb

minghuan@heatwave-PowerEdge-R710 ➜  virtuoso ./bin/isql 1111 dba dba exec="SPARQL SELECT ?g COUNT(*) { GRAPH ?g {?s ?p ?o.} } GROUP BY ?g ORDER BY DESC 2;"
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 07.20.3217 as of May 17 2018
Type HELP; for help and EXIT; to exit.
Connected to OpenLink Virtuoso
Driver: 07.20.3217 OpenLink Virtuoso ODBC Driver

g                                                                                 callret-1
LONG VARCHAR                                                                      LONG VARCHAR
_______________________________________________________________________________

http://rdf.freebase.com                                                           595449808
http://localhost:8890/DAV/                                                        2959
http://www.openlinksw.com/schemas/virtrdf#                                        2520
http://www.w3.org/2002/07/owl#                                                    160
http://localuriqaserver/sparql                                                    14
http://www.w3.org/ns/ldp#                                                         3

6 Rows. -- 1156705 msec.
ppasupat commented 6 years ago

It should be the complete KB needed for WebQuestions.

We didn't have involvement with SimpleQuestions. You can download the subset of Freebased needed for SimpleQuestions on the Facebook Research webpage

Vimos commented 6 years ago

Thank you for the reply! I noticed that different researchers may use different freebase subset for research. Recently I tried to use this freebase to evaluate another work, but failed to get satisfying result. The main reason is that, candidate entity mids offered by him cannot be found in this freebase. He may used a different subset. This might be a painful point for many KBQA researchers.

Thank you again! Really learning a lot from this repo!