search

scraperwiki / magic-summary-tool

ScraperWiki tool to summarise stuff about any table of data
8 stars 3 forks source link

Image collage shows broken page links for wikipedia #61

Closed IanHopkinson closed 10 years ago

IanHopkinson commented 11 years ago

I noticed this when summarising a twitter search tool, when links to images on wikipedia are used they don't return images but rather the profile page describing that wikimedia.

Solutions are to either exclude wikipedia images, or to drill down to the actual image on wikipedia.

frabcus commented 10 years ago

Fixed. I had to go for the first solution, because there didn't seem to be an algorithmic way to do the drill down.

It uses this heuristic:

if (val.match(/wikipedia.org\/wiki\//)) {

Which isn't great. I wanted to include File: too, but that gets translated in other language Wikipedias.