cjlee112 / spnet

selected papers network web engine
http://thinking.bioinformatics.ucla.edu/2011/07/02/open-peer-review-by-a-selected-papers-network/
GNU General Public License v2.0
40 stars 11 forks source link

Include existing and future arXiv trackbacks #73

Open ketch opened 11 years ago

ketch commented 11 years ago

It seems to me that it would be great to automatically grab, say, Mathoverflow questions and answers that mention a particular paper and include them as comments on that paper.

There's an underlying question here, that I don't know the answer to. I'm thinking that the SPN page for a paper would be the single federated place to find everything that's been said about that paper on the public web. But one might instead wish that only things that are actively submitted/tagged for SPN appear there. Opinions?

cjlee112 commented 11 years ago

@ketch might the mechanisms discussed in issue #27 accomplish what you had in mind?

ketch commented 11 years ago

I've renamed the issue based on the discussion in #27 (since #27 itself is about going the other direction). It seems like the best way to accomplish this (and more) is to hook into the arXiv trackbacks.

kim-em commented 11 years ago

(After a conversation with Chris) I've written to the arXiv administrators asking for permission to collect trackbacks from http://arxiv.org/tb/recent and for a list of older trackbacks.

kim-em commented 11 years ago

All the MathOverflow trackbacks are available at https://bitbucket.org/scottmorrison/mathoverflow/raw/tip/trackbacks/trackbacks.

(While we scrape for new links to the arXiv every hour, this file is only updated when someone runs hg commit on the relevant machine by hand.)