[scholar] minor changes

boogheta commented 2 days ago

[ ] Add date to scraper: there's often a year at best in the green meta bar of each results, it should be easy to catch it with some regexp matching 4 digits starting with 19 or 20
[ ] cleanup line breaks in descriptions
[ ] remove from title the [CITATION] [PDF] [HTML] extra info and store it as an external column type
[ ] The author detection should not stop directly after a - but at least a - or even a -
[ ] maybe we can try and extract the last piece of the green section as a journal field
[ ] Sometimes the authors detected are not really authors, but that's quite hard to find a heuristic to distinguish them from the authors so...

Yomguithereal commented 2 days ago

Won't we leave out search results from the XIXth century then? Asking for a friend.

boogheta commented 2 days ago

@Yomguithereal: we can also include 18 just for your friend

Yomguithereal commented 2 days ago

Okay but what about l'an mille and negative dates then?

boogheta commented 2 days ago

I didn't know Platon was peer reviewed, but I'll be interested in reading its 2nd reviewer's comments

Yomguithereal commented 2 days ago

Reviewer 2: « the whole article felt too cavernous for my taste »

medialab / SearchEnginesBookmarklet