Nandaka / PixivUtil2

Download images from Pixiv and more!
http://nandaka.devnull.zone/
BSD 2-Clause "Simplified" License
2.4k stars 254 forks source link

[BUG] [new change of site] some link src of big mode are unable to download #60

Closed sabearcher closed 9 years ago

sabearcher commented 9 years ago

pixiv site changed link of big mode. there's an example: big mode is not a link "http://www.pixiv.net/member_illust.php?mode=big&illust_id=47503045" but a lable, please see below.

----- console info --------------------- Input: 2 Image ids: 47503045 Processing Image Id: 47503045 send: 'GET /member_illust.php?mode=medium&illust_id=47503045 HTTP/1.1\r\nAccept- Encoding: identity\r\nReferer: http://www.pixiv.net\r\nHost: www.pixiv.net\r\nCo okie: module_orders_mypage=%5B%7B%22name%22%3A%22everyone_new_illusts%22%2C%22vi sible%22%3Atrue%7D%2C%7B%22name%22%3A%22spotlight%22%2C%22visible%22%3Atrue%7D%2 C%7B%22name%22%3A%22featured_tags%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3 A%22contests%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22following_new_ill usts%22%2C%22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22mypixiv_new_illusts%22%2C %22visible%22%3Atrue%7D%2C%7B%22name%22%3A%22booth_follow_items%22%2C%22visible% 22%3Atrue%7D%5D; p_ab_id=2; PHPSESSID=5021835_620eb5ddaa84fa19e0e2049b06145141\r \nConnection: close\r\nUser-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebK it/537.36 (KHTML, like Gecko) Chrome/37.0.2062.124 Safari/537.36\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: Server: nginx header: Date: Thu, 11 Dec 2014 13:35:26 GMT header: Content-Type: text/html; charset=UTF-8 header: Transfer-Encoding: chunked header: Connection: close header: Vary: Accept-Encoding header: X-Host-Time: 158 header: Expires: Thu, 19 Nov 1981 08:52:00 GMT header: Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-ch eck=0 header: Pragma: no-cache header: X-Frame-Options: SAMEORIGIN Traceback (most recent call last): File "PixivUtil2.py", line 608, in process_image File "PixivModel.pyc", line 224, in init File "PixivModel.pyc", line 287, in ParseInfo UnboundLocalError: local variable 'temp' referenced before assignment Error at process_image(): (<type 'exceptions.UnboundLocalError'>, UnboundLocalEr ror("local variable 'temp' referenced before assignment",), <traceback object at 0x033FEEE0>) Traceback (most recent call last): File "PixivUtil2.py", line 1792, in main File "PixivUtil2.py", line 1590, in main_loop File "PixivUtil2.py", line 1329, in menu_download_by_image_id File "PixivUtil2.py", line 608, in process_image File "PixivModel.pyc", line 224, in init File "PixivModel.pyc", line 287, in ParseInfo UnboundLocalError: local variable 'temp' referenced before assignment press enter to exit.

----- site html ------------------------ <div class="works_display"> <div class="_illust_modal _layout-big"> <img class="medium" alt="艦これイラスト集" src="http://i2.pixiv.net/c/600x600/img-master/img/2014/12/11/12/36/53/47503045_p0_master1200.jpg"&gt; <img class="big" width="714" height="1000" alt="艦これイラスト集" data-src="http://i2.pixiv.net/img-original/img/2014/12/11/12/36/53/47503045_p0.jpg" src="http://i2.pixiv.net/img-original/img/2014/12/11/12/36/53/47503045_p0.jpg" style=""> </div> </div>

Nandaka commented 9 years ago

try http://nandaka.wordpress.com/2014/12/12/pixiv-downloader-20141212/

sabearcher commented 9 years ago

Greate Wall forbid my link to the address, maybe I should try to pack it myself.

I already run it and had a test, bug is fixed. But, could you give me a guide of HOW TO PACK EXE ?

sabearcher commented 9 years ago

@Nandaka Just now, I run the commands successively, (I've copied Python27 to this directory) ---C:\TDDownload\PixivUtil2-master\python.exe setup.py build ---C:\TDDownload\PixivUtil2-master\python.exe setup.py clean ---C:\TDDownload\PixivUtil2-master\python.exe setup.py install ---C:\TDDownload\PixivUtil2-master\python.exe setup.py sdist ---C:\TDDownload\PixivUtil2-master\python.exe setup.py bdist ---C:\TDDownload\PixivUtil2-master\python.exe setup.py py2exe

THAN, I got this

skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\warnings.py to warnings.pyc skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\weakref.py to w eakref.pyc skipping byte-compilation of C:\TDDownload\PixivUtil2-master\lib\zipfile.py to z ipfile.pyc * copy extensions * * copy dlls * copying C:\TDDownload\PixivUtil2-master\lib\site-packages\py2exe\run.exe -> C:\T DDownload\PixivUtil2-master\dist\PixivUtil2.exe The following modules appear to be missing ['_scproxy', 'chardet', 'cjkcodecs.aliases', 'iconv_codec', 'mechanize', 'win32e vtlog', 'win32evtlogutil']

* binary dependencies * Your executable(s) also depend on these dlls which are not included, you may or may not need to distribute them.

Make sure you have the license if you distribute any of them, and make sure you don't distribute files belonging to the operating system.

USER32.dll - C:\Windows\system32\USER32.dll SHELL32.dll - C:\Windows\system32\SHELL32.dll WSOCK32.dll - C:\Windows\system32\WSOCK32.dll ADVAPI32.dll - C:\Windows\system32\ADVAPI32.dll WS2_32.dll - C:\Windows\system32\WS2_32.dll KERNEL32.dll - C:\Windows\system32\KERNEL32.dll


so I get to check the dlls and found there's nothing wrong with them. Would you please give me a solution ?

Nandaka commented 9 years ago

The following modules appear to be missing

Make sure you have the required lib

sabearcher commented 9 years ago

The following modules appear to be missing ['_scproxy', 'chardet', 'cjkcodecs.aliases', 'email.Utils', 'iconv_codec', 'win3 2evtlog', 'win32evtlogutil']


console debug message above .

So, how can I got these to install? I'm no familiar with these packages.

I've found files: lib/BeautifulSoup.py lib/mechanize/init.py and so on lib/site-packages/socks.py lib/site-packages/py2exe/...

Nandaka commented 9 years ago

use pip to install those packages, see https://pip.pypa.io/en/latest/installing.html

Nandaka commented 9 years ago

Updated in #63