search

albertus-andito / fake-news-detection

Code repository for my undergraduate Final Year Project
MIT License
1 stars 2 forks source link

Mirror DBpedia Live #2

Closed albertus-andito closed 3 years ago

albertus-andito commented 3 years ago

See http://dev.dbpedia.org/DBpedia_Live_Mirroring

albertus-andito commented 3 years ago

From FAQ: Q: If I want to maintain a DBpedia-Live mirror, why do I need to download the latest DBpedia-Live dump from http://live.dbpedia.org/dumps/? A: The DBpedia-Live dumps are not currently available. They may be restored in future. You may start from any DBpedia-Live dump, but the more recent the dump, the fewer changeset files will need to be downloaded and applied to the triple store at initial launch. Thus, the fastest strategy is to start from the latest dump.

albertus-andito commented 3 years ago

On 19-11-2020, I've loaded a small subset of DBpedia data to Virtuoso. It took 6 hours just to load 600 MB data, which resulted in 5 GB data in Virtuoso.

albertus-andito commented 3 years ago

I'm not sure if it is possible to mirror either the full DBpedia, or DBpedia Live for now. Probably it's not needed at the moment.

albertus-andito commented 3 years ago

Based on discussion with supervisor, I'll probably end up only loading a subset of DBpedia that contains the relationships that I want, based on the news dataset that I'll use to test the system. Closing this issue for now. Will open a separate one.

albertus-andito commented 3 years ago

Raised issue #16