search

cbanack / comic-vine-scraper

An add-on script for ComicRack that lets you copy details from Comic Vine into your comic books.
258 stars 48 forks source link

Scrape Last Modified Date #441

Open Xelloss-nakama opened 8 years ago

Xelloss-nakama commented 8 years ago

It would be useful to add a date in the "scraped" note field saying when was the comic scraped (as new comic info is usually added weeks after the time we scraped some comics)

For example: Scraped metadata from ComicVine [CVDB459159] on 12/12/15 -> when we scrapped it

Also, if possible, it would be useful and option to add when was the comicvine page from where we are scraping the info last modified... (which I think is a field in the api), so we know which comic info was modified from our last scrap

For example: Scraped metadata from ComicVine [CVDB459159] on 12/12/15 (web last modified 12/1/15) -> when the info was last updated in the site

Xelloss-nakama commented 8 years ago

ok, I see now that the first option was already a feature with an advance option... sorry XD

boshuda commented 8 years ago

I actually modified my personal copy of the scraper to add a custom field to save the last scraped time. I'm so lazy, and find github to be confusing enough, that I haven't created a patch (pull?) request. Maybe I'll get off my lazy ass and do it, but probably not.

image

To your second point: I believe comicvine doesn't indicate when the entry was last updated in the API. They might put it on the web page, but that would require web-scraping, which got the app temporarily banned a while ago. However, I'm not sure about that.

Xelloss-nakama commented 8 years ago

I look at the api documentation yesterday and it does now