snarfed / bridgy

📣 Connects your web site to social media. Likes, retweets, mentions, cross-posting, and more...
https://brid.gy
Creative Commons Zero v1.0 Universal
719 stars 52 forks source link

if a source's web site doesn't pass verify(), try one of its post permalinks #294

Open snarfed opened 10 years ago

snarfed commented 10 years ago

some tumblr blogs only turn on disqus on the individual post pages, not on the front page. example: require.aorcsik.com front page vs individual post. we currently only check the front page, so we complain and say they haven't added disqus when they actually have.

we could expand our discovery to look at the first post link on the front page too.

same thing happens for webmention endpoints on some indie domains.

snarfed commented 10 years ago

another example: https://www.brid.gy/tumblr/paulo-pinto.com , http://paulo-pinto.com/post/98836498579/1 .

snarfed commented 10 years ago

current idea: when superfeedr sends us a new blog post for an unverified source, we attempt to verify it (e.g. discover the disqus shortname) using that post's markup.

snarfed commented 10 years ago

...sadly, verifying against the markup superfeedr sends us won't actually work, since they only send an HTML snippet with the content, which usually omits the disqus script or other site metadata we usually need for verifying.

for example, this is what we get for http://andthenitcametotheend.tumblr.com/post/82533820686:

<img src="http://31.media.tumblr.com/36900762a5d45f1680d35ee62b51754e/tumblr_n2fah9QB971rmp97po1_500.jpg"/><br/><br/><p><a href="http://vintagelibraries.tumblr.com/post/79546008180/public-library-of-cincinnati-hamilton" class="tumblr_blog">vintagelibraries</a>:</p>

<blockquote><p>Public Library of Cincinnati & Hamilton County,\xa0Card Catalog, year unknow.</p></blockquote>