Pixiv feed download feature.

[GoogleCodeExporter]

I get upwards of 30 or 40 new pictures per day on my Pixiv feed, and I'd like a 
convenient way to be able to download all of them at once. 

Implementation would be greatly appreciated. 

Original issue reported on code.google.com by soundwaf...@gmail.com on 27 Jul 2014 at 7:40

[GoogleCodeExporter]

Not that useful option without feature to update a list.
I'll see what I can do.

Original comment by catgirlfighter on 28 Jul 2014 at 8:53

[GoogleCodeExporter]

With the new change list feature, isn't it basically possible to update a list 
now? Plus, I don't see how it would be terribly hard as there's a static url 
that displays the feed. It could be in the drop down box in which select 
keyword or artist id, etc. and override the other settings, as it just checks 
http://www.pixiv.net/bookmark_new_illust.php

Original comment by soundwaf...@gmail.com on 5 Sep 2014 at 10:43

[GoogleCodeExporter]

It's not terribly hard, but it's hard to find a time to make it :3
Feature to stop a getting list when list starting to repeat it self still 
needed, excluding a feature to "restart" getting list without recreating it.

Actually, for now I can make a half-assed version. And you will have to check 
for duplicates by your self (i.e. add url=url in doubles, and watch, when 
grabber will start to count duplicates). But at last you will be able to 
download feed and "new works".

Original comment by catgirlfighter on 8 Sep 2014 at 9:00

[GoogleCodeExporter]

Nah, even with half-assed way it will not be that easy. Only source of feed is 
this json page

www.pixiv.net/stacc/my/home/all/activity/{maxpicid}/.json?tt={hash}

I have to improve JSON parsing in app ("\" escapes in text, etc) and add an 
inscript feature to get access to child nodes without their names (all nodes 
named as ID of picture instead of "image" or "picture" with "id" attribute, how 
it usually done in XML).

I think I finish it this week.

Original comment by catgirlfighter on 8 Sep 2014 at 12:08

[GoogleCodeExporter]

Oh, alright, I can easily check for duplicates, so no problems with that. Thank 
you very much for the implementation!

Original comment by soundwaf...@gmail.com on 10 Sep 2014 at 3:49

[GoogleCodeExporter]

Didn't make it this week, but for sure will be in the beginning of the next :)

Original comment by catgirlfighter on 13 Sep 2014 at 10:56

[GoogleCodeExporter]

I mean, I don't want to rush you at all, I realize that you're making this for 
free, so take your time. 

Original comment by soundwaf...@gmail.com on 14 Sep 2014 at 3:34

[GoogleCodeExporter]

Forgot to mention. I done it. I'll try to finish "list reloading" this week.

Original comment by catgirlfighter on 17 Sep 2014 at 9:04

[GoogleCodeExporter]

About duplicates, grabber usually always find 2-5 duplicates per every page 
when you getting list from FEED page (it's how their json source works), you 
can be sure it's starting to repeat only when it stops to add any new pictures.

Original comment by catgirlfighter on 17 Sep 2014 at 9:07

[GoogleCodeExporter]

I thought it was a one off, but it seems that sometimes, the new works doesn't 
save the files into the correct folder. The folder sometimes ends up as a 
string of random characters like "A78Z9Q~K". 

Original comment by soundwaf...@gmail.com on 19 Sep 2014 at 4:26

[GoogleCodeExporter]

I need more precise data. Can you leave a pixiv settings, name format, full 
resulting path + name?

Original comment by catgirlfighter on 19 Sep 2014 at 7:25

[GoogleCodeExporter]

The path is:
    $rootdir$\picstest\Artist %author%\$fname$
The resulting path is something like:
    S:\Encrypted\picstest\ABQS3S~9
The file names are saved correctly though. 

Special settings are untouched, nothing in the tag space, and User ID is 
checked. 

Original comment by soundwaf...@gmail.com on 19 Sep 2014 at 10:47

[GoogleCodeExporter]

It also doesn't seem to have anything to do with special characters or symbols. 

Original comment by soundwaf...@gmail.com on 19 Sep 2014 at 10:55

[GoogleCodeExporter]

Is it working only for feed?
Grabber's root dir is >S:\Encrypted?
Are you sure file was saved in >\pictest, not in >\Artist %author%?
Is it working for the same pictures everytime, or happens totally randomly?

Trying to recognize a pattern. Tests doesn't give any results for now :/

Original comment by catgirlfighter on 22 Sep 2014 at 9:38

[GoogleCodeExporter]

No, the file is saved inside picstest, and the Artist %author% directory is 
replaced by a random string of characters. 

Original comment by soundwaf...@gmail.com on 22 Sep 2014 at 4:18