search

SmartDataAnalytics / OpenResearch

Public issue system for OPENRESEARCH/ConfIDent
8 stars 3 forks source link

WikiCFP provenance #166

Closed MusaabKh closed 2 years ago

MusaabKh commented 3 years ago

Some pages in openresearch are imported from WikiCFP and marked with a text, "This CfP was obtained from ...". The pages are to be identified and the WikiCFP-ID is to be placed into the page with the source identifier. Example of such event: https://www.openresearch.org/mediawiki/index.php?title=AISB_2009

WolfgangFahl commented 3 years ago

See Task3 and

WolfgangFahl commented 3 years ago

Identify data imported from WikiCFP and mark it with the WikiCFP-ID

WolfgangFahl commented 3 years ago

use bots like wikipush, wikiedit, wikinuke, wikiupload, wikuser to do mass changes of pages e.g. adding the source "WikiCfP" information to pages imported from WikiCfp

This CfP was obtained from [http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=3864&copyownerid=2 WikiCFP]

=>

[[Source::wikicfp]][[eventId::3864]]

=>

{{Event|...|Source=wikicfp|eventId=3864| ...}}

WolfgangFahl commented 3 years ago

This is going to be a nice OpenRefine example for the upcoming weeks. Right now we just want to import the WikiCFP entries to orintegrate to show that the principle works.

WolfgangFahl commented 3 years ago

see 

root@confident:/home/wf/.ptp# ls -l
total 170496
-rw-r--r-- 1 wf www-data 174587904 Feb 10 08:06 Event_all.db
MusaabKh commented 3 years ago

Sample Extraction of WikiCFP-ID using a python snippet and wikirestore: https://confident.dbis.rwth-aachen.de/ormk/index.php?title=AISB_2009&type=revision&diff=19307&oldid=17526

WolfgangFahl commented 3 years ago

see Template:EventSeriesOverview

WolfgangFahl commented 2 years ago

The API for "modify property x of page y using topic t to value v" should be used for this.

tholzheim commented 2 years ago

Applied fixer to orclone resulting in 2459 wikicfpIds being added to the events. See https://confident.dbis.rwth-aachen.de/or/index.php?title=Property:WikiCFP-ID

WolfgangFahl commented 2 years ago

Great - can we close this ticket now and continue with #256?

tholzheim commented 2 years ago

Yes, for all events that have the wikicfp id in the freetext the wikicfpId property has been set