dirname:E:\BaiduNetdiskDownload\bustag_win_0.2.0\bustag
Bustag server starting: version: 0.2.0
CWD: E:\BaiduNetdiskDownload\bustag_win_0.2.0\bustag
Bottle v0.12.17 server starting up (using PasteServer())...
Listening on http://0.0.0.0:8000/
Hit Ctrl-C to quit.
system error
Press Enter to continue ...
start download
args : Namespace(count='100', exclude=None, include=None, level=1, max_redirect=10, max_tasks=5, max_tries=4, no_parse_links=False, output=None, proxy=None, roots=('https://www.busdmm.work',), strict=True)
还没有训练好的模型, 无法推荐
process page 5
process page 10
process page 9
process page 3
process page 8
process page 4
process page 2
process page 7
process page 6
item NASH-184 is processed
item GNAX-017 is processed
item YOPI-001 is processed
item LMPI-014 is processed
item MASA-001 is processed
process page 12
process page 14
process page 11
item IPX-407 is processed
process page 15
item MEYD-547 is processed
item IPX-395 is processed
item IPX-393 is processed
item IPX-398 is processed
item IPX-399 is processed
item JUFE-116 is processed
item JUFE-117 is processed
item MEYD-545 is processed
item JUFE-115 is processed
item IPX-401 is processed
item JUFE-114 is processed
item JUFE-118 is processed
item MIAA-181 is processed
item EBOD-721 is processed
item IPX-394 is processed
item IPX-403 is processed
item EYAN-144 is processed
item IPX-404 is processed
process page 13
item IPX-405 is processed
item IPX-392 is processed
item IPX-406 is processed
item IPX-400 is processed
item MIAA-180 is processed
item IPX-397 is processed
item IPX-402 is processed
item MEYD-546 is processed
item IPX-396 is processed
item MEYD-548 is processed
item MEYD-544 is processed
item AP-712 is processed
item DVAJ-422 is processed
item MDBK-066 is processed
item HGOT-016 is processed
item VENU-896 is processed
item SQTE-273 is processed
item UMD-707 is processed
item SQTE-272 is processed
item SABA-575 is processed
item APOD-013 is processed
item OIGS-030 is processed
item UMD-710 is processed
item VAGU-219 is processed
item MUDR-089 is processed
item KRHK-009 is processed
item MEYD-543 is processed
item OFKU-132 is processed
item UMD-709 is processed
item VENU-895 is processed
item GMEM-001 is processed
item HJMO-418 is processed
item HJMO-419 is processed
item AVSA-109 is processed
item SABA-574 is processed
item HGOT-017 is processed
item MEYD-542 is processed
item CEAD-275 is processed
item VENU-894 is processed
item SABA-576 is processed
item ARM-814 is processed
item SPZ-1051 is processed
item TIKC-039 is processed
item SOAN-043 is processed
item UMD-708 is processed
item DVDMS-468 is processed
item ZEX-383 is processed
item VEC-392 is processed
item DOCP-184 is processed
item CHN-178 is processed
item AMA-053 is processed
item TKBN-001 is processed
2019-11-17 18:23:03,616 - bustag - ERROR - db.py - saveit
UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id
Traceback (most recent call last):
File "lib\site-packages\peewee.py", line 2949, in execute_sql
sqlite3.IntegrityError: UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "bustag\spider\db.py", line 130, in saveit
File "lib\site-packages\peewee.py", line 6012, in create
File "lib\site-packages\peewee.py", line 6201, in save
File "lib\site-packages\peewee.py", line 1785, in inner
File "lib\site-packages\peewee.py", line 1856, in execute
File "lib\site-packages\peewee.py", line 2572, in _execute
File "lib\site-packages\peewee.py", line 2320, in _execute
File "lib\site-packages\peewee.py", line 2962, in execute
File "lib\site-packages\peewee.py", line 2956, in execute_sql
File "lib\site-packages\peewee.py", line 2732, in exit
File "lib\site-packages\peewee.py", line 183, in reraise
File "lib\site-packages\peewee.py", line 2949, in execute_sql
peewee.IntegrityError: UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id
item RKI-504 is processed
item SPZ-1049 is processed
item SUJI-113 is processed
item TUS-078 is processed
item YMDD-172 is processed
item SPZ-1050 is processed
item TIKF-039 is processed
item ATOM-393 is processed
item DNW-058 is processed
2019-11-17 18:23:08,292 - aspider - WARNING - crawling.py - exit_on_empty_queue
reach count: 100, now quit
2019-11-17 18:23:08,293 - aspider - WARNING - crawling.py - crawl
closing the crawler
2019-11-17 18:23:08,296 - aspider - ERROR - crawling.py - fetch
5803200 html_bytes
1 redirect
Finished 101 urls in 62.958 secs (max_tasks=5) (0.321 urls/sec/task)
Todo: 194
Done: 101
Date: Sun Nov 17 18:23:09 2019 local time
gxtrobot
commented
4 years ago
dirname:E:\BaiduNetdiskDownload\bustag_win_0.2.0\bustag Bustag server starting: version: 0.2.0
CWD: E:\BaiduNetdiskDownload\bustag_win_0.2.0\bustag Bottle v0.12.17 server starting up (using PasteServer())... Listening on http://0.0.0.0:8000/ Hit Ctrl-C to quit.
system error Press Enter to continue ... start download args : Namespace(count='100', exclude=None, include=None, level=1, max_redirect=10, max_tasks=5, max_tries=4, no_parse_links=False, output=None, proxy=None, roots=('https://www.busdmm.work',), strict=True) 还没有训练好的模型, 无法推荐 process page 5 process page 10 process page 9 process page 3 process page 8 process page 4 process page 2 process page 7 process page 6 item NASH-184 is processed item GNAX-017 is processed item YOPI-001 is processed item LMPI-014 is processed item MASA-001 is processed process page 12 process page 14 process page 11 item IPX-407 is processed process page 15 item MEYD-547 is processed item IPX-395 is processed item IPX-393 is processed item IPX-398 is processed item IPX-399 is processed item JUFE-116 is processed item JUFE-117 is processed item MEYD-545 is processed item JUFE-115 is processed item IPX-401 is processed item JUFE-114 is processed item JUFE-118 is processed item MIAA-181 is processed item EBOD-721 is processed item IPX-394 is processed item IPX-403 is processed item EYAN-144 is processed item IPX-404 is processed process page 13 item IPX-405 is processed item IPX-392 is processed item IPX-406 is processed item IPX-400 is processed item MIAA-180 is processed item IPX-397 is processed item IPX-402 is processed item MEYD-546 is processed item IPX-396 is processed item MEYD-548 is processed item MEYD-544 is processed item AP-712 is processed item DVAJ-422 is processed item MDBK-066 is processed item HGOT-016 is processed item VENU-896 is processed item SQTE-273 is processed item UMD-707 is processed item SQTE-272 is processed item SABA-575 is processed item APOD-013 is processed item OIGS-030 is processed item UMD-710 is processed item VAGU-219 is processed item MUDR-089 is processed item KRHK-009 is processed item MEYD-543 is processed item OFKU-132 is processed item UMD-709 is processed item VENU-895 is processed item GMEM-001 is processed item HJMO-418 is processed item HJMO-419 is processed item AVSA-109 is processed item SABA-574 is processed item HGOT-017 is processed item MEYD-542 is processed item CEAD-275 is processed item VENU-894 is processed item SABA-576 is processed item ARM-814 is processed item SPZ-1051 is processed item TIKC-039 is processed item SOAN-043 is processed item UMD-708 is processed item DVDMS-468 is processed item ZEX-383 is processed item VEC-392 is processed item DOCP-184 is processed item CHN-178 is processed item AMA-053 is processed item TKBN-001 is processed 2019-11-17 18:23:03,616 - bustag - ERROR - db.py - saveit UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id Traceback (most recent call last): File "lib\site-packages\peewee.py", line 2949, in execute_sql sqlite3.IntegrityError: UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "bustag\spider\db.py", line 130, in saveit File "lib\site-packages\peewee.py", line 6012, in create File "lib\site-packages\peewee.py", line 6201, in save File "lib\site-packages\peewee.py", line 1785, in inner File "lib\site-packages\peewee.py", line 1856, in execute File "lib\site-packages\peewee.py", line 2572, in _execute File "lib\site-packages\peewee.py", line 2320, in _execute File "lib\site-packages\peewee.py", line 2962, in execute File "lib\site-packages\peewee.py", line 2956, in execute_sql File "lib\site-packages\peewee.py", line 2732, in exit File "lib\site-packages\peewee.py", line 183, in reraise File "lib\site-packages\peewee.py", line 2949, in execute_sql peewee.IntegrityError: UNIQUE constraint failed: item_tag.item_id, item_tag.tag_id item RKI-504 is processed item SPZ-1049 is processed item SUJI-113 is processed item TUS-078 is processed item YMDD-172 is processed item SPZ-1050 is processed item TIKF-039 is processed item ATOM-393 is processed item DNW-058 is processed 2019-11-17 18:23:08,292 - aspider - WARNING - crawling.py - exit_on_empty_queue reach count: 100, now quit 2019-11-17 18:23:08,293 - aspider - WARNING - crawling.py - crawl closing the crawler 2019-11-17 18:23:08,296 - aspider - ERROR - crawling.py - fetch
Traceback (most recent call last): File "lib\site-packages\aspider\crawling.py", line 276, in fetch File "lib\site-packages\aspider\crawling.py", line 151, in parse_links File "lib\site-packages\aiohttp\client_reqrep.py", line 969, in read File "lib\site-packages\aiohttp\streams.py", line 359, in read File "lib\site-packages\aiohttp\streams.py", line 381, in readany File "lib\site-packages\aiohttp\streams.py", line 297, in _wait concurrent.futures._base.CancelledError 2019-11-17 18:23:08,297 - aspider - WARNING - crawling.py - work canceling the worker 2019-11-17 18:23:08,298 - aspider - WARNING - crawling.py - work canceling the worker 2019-11-17 18:23:08,304 - aspider - WARNING - crawling.py - work canceling the worker Report https://www.busdmm.work 200 text/html UTF-8 67907 61/62 https://www.busdmm.work/AMA-053 200 text/html UTF-8 57731 12/44 https://www.busdmm.work/AP-712 200 text/html UTF-8 58475 13/45 https://www.busdmm.work/APOD-013 200 text/html UTF-8 57767 12/45 https://www.busdmm.work/ARM-814 200 text/html UTF-8 61238 21/52 https://www.busdmm.work/ATOM-393 200 text/html UTF-8 55826 12/45 https://www.busdmm.work/AVSA-109 200 text/html UTF-8 56540 11/45 https://www.busdmm.work/CEAD-275 200 text/html UTF-8 60944 17/50 https://www.busdmm.work/CHN-178 200 text/html UTF-8 55068 14/46 https://www.busdmm.work/DNW-058 200 text/html UTF-8 53404 8/45 https://www.busdmm.work/DOCP-184 200 text/html UTF-8 57452 12/45 https://www.busdmm.work/DVAJ-422 200 text/html UTF-8 57755 12/46 https://www.busdmm.work/DVDMS-468 200 text/html UTF-8 60200 15/46 https://www.busdmm.work/EBOD-721 200 text/html UTF-8 52965 11/44 https://www.busdmm.work/EYAN-144 200 text/html UTF-8 53705 11/44 https://www.busdmm.work/GMEM-001 200 text/html UTF-8 59396 16/48 https://www.busdmm.work/GNAX-017 200 text/html UTF-8 55738 19/48 https://www.busdmm.work/HGOT-016 200 text/html UTF-8 49829 11/44 https://www.busdmm.work/HGOT-017 200 text/html UTF-8 50850 12/44 https://www.busdmm.work/HJMO-418 200 text/html UTF-8 51947 13/48 https://www.busdmm.work/HJMO-419 200 text/html UTF-8 57452 10/47 https://www.busdmm.work/IPX-392 200 text/html UTF-8 56593 10/48 https://www.busdmm.work/IPX-393 200 text/html UTF-8 57404 14/48 https://www.busdmm.work/IPX-394 200 text/html UTF-8 55214 11/48 https://www.busdmm.work/IPX-395 200 text/html UTF-8 55739 14/48 https://www.busdmm.work/IPX-396 200 text/html UTF-8 56253 8/47 https://www.busdmm.work/IPX-397 200 text/html UTF-8 56800 11/46 https://www.busdmm.work/IPX-398 200 text/html UTF-8 54915 12/48 https://www.busdmm.work/IPX-399 200 text/html UTF-8 55349 13/47 https://www.busdmm.work/IPX-400 200 text/html UTF-8 55651 7/46 https://www.busdmm.work/IPX-401 200 text/html UTF-8 56269 11/46 https://www.busdmm.work/IPX-402 200 text/html UTF-8 55304 10/49 https://www.busdmm.work/IPX-403 200 text/html UTF-8 57244 9/48 https://www.busdmm.work/IPX-404 200 text/html UTF-8 54809 11/48 https://www.busdmm.work/IPX-405 200 text/html UTF-8 56384 11/48 https://www.busdmm.work/IPX-406 200 text/html UTF-8 55784 8/45 https://www.busdmm.work/IPX-407 200 text/html UTF-8 56050 19/49 https://www.busdmm.work/JUFE-114 200 text/html UTF-8 59527 15/49 https://www.busdmm.work/JUFE-115 200 text/html UTF-8 55459 10/44 https://www.busdmm.work/JUFE-116 200 text/html UTF-8 56070 15/47 https://www.busdmm.work/JUFE-117 200 text/html UTF-8 56385 12/48 https://www.busdmm.work/JUFE-118 200 text/html UTF-8 55841 12/48 https://www.busdmm.work/KRHK-009 200 text/html UTF-8 55735 15/48 https://www.busdmm.work/LMPI-014 200 text/html UTF-8 52125 14/44 https://www.busdmm.work/MASA-001 200 text/html UTF-8 53294 14/44 https://www.busdmm.work/MDBK-066 200 text/html UTF-8 60968 16/48 https://www.busdmm.work/MEYD-542 200 text/html UTF-8 54584 5/48 https://www.busdmm.work/MEYD-543 200 text/html UTF-8 53532 8/48 https://www.busdmm.work/MEYD-544 200 text/html UTF-8 55701 11/47 https://www.busdmm.work/MEYD-545 200 text/html UTF-8 54167 13/48 https://www.busdmm.work/MEYD-546 200 text/html UTF-8 53726 11/47 https://www.busdmm.work/MEYD-547 200 text/html UTF-8 54809 15/48 https://www.busdmm.work/MEYD-548 200 text/html UTF-8 53734 9/48 https://www.busdmm.work/MIAA-180 200 text/html UTF-8 55311 10/48 https://www.busdmm.work/MIAA-181 200 text/html UTF-8 54819 16/48 https://www.busdmm.work/MUDR-089 200 text/html UTF-8 53588 13/47 https://www.busdmm.work/NASH-184 200 text/html UTF-8 59298 28/46 https://www.busdmm.work/OFKU-132 200 text/html UTF-8 55648 15/45 https://www.busdmm.work/OIGS-030 200 text/html UTF-8 57883 17/48 https://www.busdmm.work/RKI-504 200 text/html UTF-8 55262 15/48 https://www.busdmm.work/SABA-574 200 text/html UTF-8 60248 11/46 https://www.busdmm.work/SABA-575 200 text/html UTF-8 55051 15/46 https://www.busdmm.work/SABA-576 200 text/html UTF-8 55870 9/44 https://www.busdmm.work/SOAN-043 200 text/html UTF-8 53136 12/42 https://www.busdmm.work/SPZ-1049 200 text/html UTF-8 55585 7/44 https://www.busdmm.work/SPZ-1050 200 text/html UTF-8 54964 11/45 https://www.busdmm.work/SPZ-1051 200 text/html UTF-8 55136 12/44 https://www.busdmm.work/SQTE-272 200 text/html UTF-8 57823 10/47 https://www.busdmm.work/SQTE-273 200 text/html UTF-8 57696 14/47 https://www.busdmm.work/SUJI-113 200 text/html UTF-8 54959 11/44 https://www.busdmm.work/TIKC-039 200 text/html UTF-8 53775 11/44 https://www.busdmm.work/TIKF-039 200 text/html UTF-8 55307 11/45 https://www.busdmm.work/TKBN-001 200 text/html UTF-8 55282 10/44 https://www.busdmm.work/TUS-078 200 text/html UTF-8 57152 11/45 https://www.busdmm.work/UMD-707 200 text/html UTF-8 66187 15/48 https://www.busdmm.work/UMD-708 200 text/html UTF-8 60076 12/49 https://www.busdmm.work/UMD-709 200 text/html UTF-8 63578 13/48 https://www.busdmm.work/UMD-710 200 text/html UTF-8 59073 16/49 https://www.busdmm.work/VAGU-219 200 text/html UTF-8 57966 12/47 https://www.busdmm.work/VEC-392 200 text/html UTF-8 56356 9/47 https://www.busdmm.work/VENU-894 200 text/html UTF-8 56639 11/47 https://www.busdmm.work/VENU-895 200 text/html UTF-8 58193 12/47 https://www.busdmm.work/VENU-896 200 text/html UTF-8 56944 10/47 https://www.busdmm.work/YMDD-172 200 text/html UTF-8 56489 15/46 https://www.busdmm.work/YOPI-001 200 text/html UTF-8 54717 16/43 https://www.busdmm.work/ZEX-383 200 text/html UTF-8 53797 13/46 https://www.busdmm.work/page/1 301 redirect https://www.busdmm.work https://www.busdmm.work/page/10 200 text/html UTF-8 69013 38/61 https://www.busdmm.work/page/11 200 text/html UTF-8 68994 33/62 https://www.busdmm.work/page/12 200 text/html UTF-8 65999 35/62 https://www.busdmm.work/page/13 200 text/html UTF-8 66832 33/62 https://www.busdmm.work/page/14 200 text/html UTF-8 64066 35/62 https://www.busdmm.work/page/15 200 text/html UTF-8 67269 34/61 https://www.busdmm.work/page/2 200 text/html UTF-8 68825 33/61 https://www.busdmm.work/page/3 200 text/html UTF-8 68961 33/61 https://www.busdmm.work/page/4 200 text/html UTF-8 68159 33/61 https://www.busdmm.work/page/5 200 text/html UTF-8 68445 33/62 https://www.busdmm.work/page/6 200 text/html UTF-8 70620 33/61 https://www.busdmm.work/page/7 200 text/html UTF-8 68353 33/61 https://www.busdmm.work/page/8 200 text/html UTF-8 68686 33/61 https://www.busdmm.work/page/9 200 text/html UTF-8 71562 33/61
5803200 html_bytes 1 redirect Finished 101 urls in 62.958 secs (max_tasks=5) (0.321 urls/sec/task) Todo: 194 Done: 101 Date: Sun Nov 17 18:23:09 2019 local time
ALL DONE NOW
2019-11-17 18:23:09,341 - aspider - WARNING - crawling.py - exit_on_empty_queue reach count: 100, now quit