csensemakers / desci-sense

2 stars 2 forks source link

Use metadata extraction to get URL details for context before running LLM #15

Open ronentk opened 9 months ago

ronentk commented 9 months ago

Can use similar method to Save To Zotero plugin if open source

ronentk commented 9 months ago

Evidence that this would help prediction accuracy - https://wandb.ai/common-sense-makers/st_demo-v0.2/artifacts/prediction/pred_7atyqb59_dfiJPpPp/v0/files/predictions.table.json

ronentk commented 9 months ago

Looks like in Zotero it works through Translators https://www.zotero.org/support/translators

ronentk commented 7 months ago

https://forums.zotero.org/discussion/110150/using-zotero-translator-framework-in-an-external-web-crawling-app#latest

pointed me at Citoid which seems to do the job https://www.mediawiki.org/wiki/Citoid/API https://en.wikipedia.org/api/rest_v1/#/Citation/getCitation