search

bhnascar / Viral-Art

CS231A final project
0 stars 0 forks source link

need wrapper for scraper #45

Closed mindyh closed 8 years ago

mindyh commented 8 years ago

Params you can alter in the URL:

offset=24 specifies the offset

http://www.deviantart.com/browse/all/digitalart/paintings/people/portraits/?order=15&offset=24 http://www.deviantart.com/browse/all/traditional/drawings/portraits/?offset=74

mindyh commented 8 years ago

It'd be nice if you could specify other params as well, ex.

http://www.deviantart.com/browse/all/digitalart/paintings/people/portraits/?order=15&offset=24

?order=15 specifies that the images are sorted in order of most popular in the last month.

BTW, http://www.deviantart.com/browse/all/digitalart/paintings/people/portraits/?&offset=24

is a valid url..., so just making sure the prefix ends in '?' and appending &offset=x should work

mindyh commented 8 years ago

fyi need to escape ampersands in bash...in windows the escape is a ^ for some reason