search

Aqua-Dream / Tieba_Spider

百度贴吧爬虫(基于scrapy和mysql)
397 stars 116 forks source link

mysql boom了 #1

Closed tetsaicn closed 7 years ago

tetsaicn commented 7 years ago

--- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:64:insert_thread /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'LoserPanshao', 'good': False, 'id': 5009721898L, 'reply_num': 2, 'title': u'\u5982\u679c\u4e16\u754c\u6f06\u9ed1\u5176\u5b9e\u4f60\u5f88\u7f8e'}

Aqua-Dream commented 7 years ago

你好，希望你把错误提示的上下文再多拿出来一些，这样似乎看不到错误原因

tetsaicn commented 7 years ago

/usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 3, 'content': u'http://www.bilibili.com/video/av7630706/', 'floor': 8, 'id': 101635057549L, 'thread_id': 4880973048L, 'time': u'2016-12-21 19:36'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'hyz621', 'comment_num': 0, 'content': u'\u6211\u4e5f\u88ab\u5220\u4e862\u4e2a\u5e16\u5b50', 'floor': 2, 'id': 98488066827L, 'thread_id': 4802204556L, 'time': u'2016-09-29 18:08'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u4ec0\u4e48\u65f6\u5019\u5199\u4e2a\u811a\u672c\u628a\u8fd9\u4e2a\u5427\u7684\u4e1c\u897f\u6252\u4e0b\u6765\u5c31\u597d\u4e86\uff0c\u6211\u611f\u89c9\u8d34\u5427\u8fdf\u65e9\u836f\u4e38', 'floor': 3, 'id': 98503911176L, 'thread_id': 4802204556L, 'time': u'2016-09-30 07:27'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u955c\u5f71\u7b9c\u7487', 'comment_num': 16, 'content': u'\u5bf9\u4e86\uff0c\u6211\u80fd\u8bf7\u4f60\u505a\u4e00\u4e2amod\u5417\uff1f', 'floor': 4, 'id': 98628962450L, 'thread_id': 4802204556L, 'time': u'2016-10-03 20:21'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 4, 'content': u'\u53c8\u5f00\u59cb\u5220\u5e16\u4e86\uff0c\u6211\u771f\u6709\u79cd\u5371\u673a\u611f\u3002\u6700\u5fc3\u75bc\u7684\u83ab\u8fc7\u4e8e\u672c\u5427\u7684\u6240\u6709\u5e16\u5b50\u4ee5\u53ca\u4e94\u5916\u5427\u7684\u51e0\u4e2a\u5e16\u5b50\uff0c\u5f88\u60f3\u5907\u4efd\u4e0b\u6765\u3002', 'floor': 5, 'id': 98982018876L, 'thread_id': 4802204556L, 'time': u'2016-10-11 07:41'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u955c\u5f71\u7b9c\u7487', 'comment_num': 1, 'content': u'\u5b83\u5220\u7684\u4f60\u54ea\u4e2a\u65f6\u5019\u7684\u5e16\u5b50\uff1f', 'floor': 6, 'id': 98988901073L, 'thread_id': 4802204556L, 'time': u'2016-10-11 12:07'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'3025525B', 'comment_num': 5, 'content': u'\u81ea\u4ece\u5347\u4e86win10\u5c31\u9891\u7e41\u51fa\u73b0\uff0c\u517c\u5bb9\u4e86\uff0c\u7ba1\u7406\u5458\u8eab\u4efd\u4e86\uff0c\u6740\u8f6f\u4e5f\u4fe1\u4efb\uff0c\u7136\u800c\u6ca1\u6709\u7528\u3002\n https://imgsa.baidu.com/forum/w%3D580/sign=7b774a91f3f2b211e42e8546fa816511/0d99252a6059252dbf6531e63c9b033b5ab5b947.jpg', 'floor': 7, 'id': 98995249390L, 'thread_id': 4802204556L, 'time': u'2016-10-11 15:44'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'https://imgsa.baidu.com/forum/w%3D580/sign=640c638eba1c8701d6b6b2ee177e9e6e/6325b1a98226cffc546862d8b0014a90f703eaf8.jpg \n\n\u54fc\u54fc', 'floor': 9, 'id': 102087383535L, 'thread_id': 4880973048L, 'time': u'2017-01-02 15:47'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'7\u53ea\u602a\u7684\u65f6\u5019\uff0c\u5934\u5dfe+\u8d85\u5934\u5dfe+\u9b42\u4e4b\u7406\u521a\u597d100\u6c14\uff0c\u65e0\u9650\u7206S\u3002\n\u8bf4\u7684\u5c31\u662f\u6df1\u6e0a\u7b2c\u4e8cboss', 'floor': 10, 'id': 102130096179L, 'thread_id': 4880973048L, 'time': u'2017-01-03 16:21'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 3, 'content': u'\u5237\u732b\u54aa\u5957\u88c5\n\u73b2\n\u9970\u54c1\u5c0f\u4e11+\u602a\u76d7\n\u8863\u670d\u732b\u54aa\n\u978b\u5b50\u8010\u70ed\n\u56de\u8def\u673a\u529f2+\u9ed1\u8000\u73e0+\u9a71\u52a82+\u91d1\u8000\u73e0+\u8303\u56f42+\u7f8e\u81ed+\u5e78\u8fd0\n\u53e6\u5916\u4e09\u4e2a\u4eba\u5168\u51cf\u901f\uff0c\u5e26\u4e00\u4e2a\u795e\u901f\n\u540e\u63f4\u4e54\u65af\u7279\n\u5728\u6697\u8ff7\u5bab\uff0c\u7528\u82cd\u767d\u5730\u72f1\u5237\u55a7\u95f9\u7cbe\u7075', 'floor': 11, 'id': 102144204198L, 'thread_id': 4880973048L, 'time': u'2017-01-03 22:43'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u524d\u9762\u5408\u6210\u6728\u8000\u73e0\uff0c\u91d1\u8000\u73e0\u548c\u8303\u56f42\u592a\u591a\u4e86\uff0c\u6240\u4ee5\u4e0d\u5f97\u4e0d\n\u5237\u7a7a\u8000\u73e0\n\u73b2\n\u9970\u54c1\u5c0f\u4e11+\u5e78\u798f\u4e4b\u77f3\n\u8863\u670d\u978b\u5b50\u732b\u54aa+\u8010\u70ed\n\u56de\u8def\u673a\u529f2+\u9ed1\u8000\u73e0+\u9a71\u52a82+\u8303\u56f42+\u8000\u8109+\u5e78\u8fd0+\u7f8e\u81ed\n\u53e6\u5916\u4e00\u4e2a\u6b63\u5e38\u88c5\u5907\uff0c\u4e24\u4e2a\u5c3d\u91cf\u51cf\u901f\uff0c\u8981\u795e\u901f\n\u540e\u63f4\u8389\u4e1d\n\n\u5728\u7b2c\u4e09\u5c42\u91d1\u8ff7\u5bab\u77f3\u7891\u90a3\u91cc\u53f3\u8f6c\u6709\u4e00\u4e2a\u4ec0\u4e48\u7518\u9732\u602a\uff0c\u9047\u602a\u4e00\u822c\u662f3\u4e2a+\u4e00\u4e2a\u9632\u98ce\u7684\u602a\n\u591a\u4f59\u7684\u90a3\u4e2a\u602a\u7531\u961f\u5458\u5e73\u780d\u89e3\u51b3\uff0c\u5176\u4f592\u4e2a\u7528\u98ce\u4e4b\u9886\u57df', 'floor': 12, 'id': 102164038310L, 'thread_id': 4880973048L, 'time': u'2017-01-04 13:17'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 1, 'content': u'\u554a\u554a\u4e8f\u4e86\uff0c\u6ca1\u60f3\u5230boss\u90a3\u4e48\u8106\uff0c\u4e8f\u6211\u82b1\u4e86\u4e00\u4e2a\u661f\u671f\u7ed9\u6bcf\u4e2a\u4eba\u5f04\u597d\u51c6\u5907\u548c\u56de\u8def\uff0c\u6218\u6597\u7684\u65f6\u5019\u72b6\u6001\u8fd8\u6ca1\u6765\u5f97\u53ca\u653e\u5b8c\u5c31\u7ed3\u675f\u4e86', 'floor': 13, 'id': 102187955523L, 'thread_id': 4880973048L, 'time': u'2017-01-04 23:59'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'3025525B', 'comment_num': 2, 'content': u'\u521a\u53d1\u73b0\u4e00\u4e2a\u3002\u5f53\u524d\u56de\u5408\u8f7d\u5165global.WaitForBattleSEEnd(141) \u540e\u9762\u968f\u4fbf\u5199\u70b9\u3002 \uff08\u65e0\u6781\u7535\u8292\u7279\u6548id="141"\uff09\n\u53ef\u4ee5\u4e0b\u4e2a\u56de\u5408\u4f7f\u7528\u65e0\u6781\u7535\u8292\uff0c\u6216\u8005\u8fc7\u51e0\u4e2a\u56de\u5408\u4f7f\u7528\u4e5f\u884c\u3002\u65e0\u6781\u7535\u8292\u7ed3\u675f\u540e\u4f1a\u8f7d\u5165global.WaitForBattleSEEnd\u540e\u8fb9\u7684\u5185\u5bb9\u3002\u611f\u89c9\u53ef\u4ee5\u5229\u7528\u4e0b\u3002', 'floor': 8, 'id': 99003771534L, 'thread_id': 4802204556L, 'time': u'2016-10-11 20:19'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u5927\u6e2f\u53e3\u8230', 'comment_num': 1, 'content': u'\u65e9\u5c31\u5f00\u59cb\u4e86\uff0c\u53ea\u662f\u6700\u8fd1\u6bd4\u8f83\u9891\u7e41', 'floor': 9, 'id': 99020603892L, 'thread_id': 4802204556L, 'time': u'2016-10-12 09:55'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u561b\u5185\u5bb9\u592a\u591a\u4e0d\u8ba9\u53d1 \u5176\u4f59\u7684\u5c31\u4e0d\u53d1\u4e86 \u63a5\u4e0b\u6765\u8fd8\u6709\u5f88\u591a\u6b65\u9aa4', 'floor': 11, 'id': 99035426485L, 'thread_id': 4802204556L, 'time': u'2016-10-12 18:12'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 1, 'content': u'http://tieba.baidu.com/p/comment?tid=\u5e16\u5b50ID&pid=\u56de\u590dID&pn=1\nNICE \u767b\u9646\u90fd\u4e0d\u9700\u8981\u4e86 \u7701\u4e86\u5f88\u591a\u4e8b\u60c5', 'floor': 12, 'id': 99045772455L, 'thread_id': 4802204556L, 'time': u'2016-10-12 23:27'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u55ef\u867d\u7136\u6700\u8fd1\u6ca1\u6709\u4e71\u5220\u5e16\u4e86\u4f46\u8fd8\u662f\u53ef\u4ee5\u8003\u8651\u722c\n\u7b2c\u4e00\u6b65\u5dee\u4e0d\u591a\u5b8c\u6210\u4e86 scrapy\u771f\u5fc3\u597d\u7528\n https://imgsa.baidu.com/forum/w%3D580/sign=385c059d12d5ad6eaaf964e2b1ca39a3/efa76d3df8dcd10050e6c6787b8b4710b8122fd6.jpg', 'floor': 13, 'id': 102411089705L, 'thread_id': 4802204556L, 'time': u'2017-01-10 14:16'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u56de\u590d\u6570\u91cf\u7834\u767e\u7684\u5e16\u5b50\uff1a\n https://imgsa.baidu.com/forum/w%3D580/sign=5c48c450bf003af34dbadc68052bc619/bf0304246b600c33eddffa91134c510fd8f9a1a2.jpg', 'floor': 14, 'id': 102411756987L, 'thread_id': 4802204556L, 'time': u'2017-01-10 14:36'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u975e\u697c\u4e2d\u697c\u722c\u597d\u4e86\uff0c\u5904\u7406\u4e86\u56fe\u50cf\u548c\u57fa\u7840\u8868\u60c5~\u722c\u4e00\u6b21\u53ea\u8981\u534a\u5206\u949f\n https://imgsa.baidu.com/forum/w%3D580/sign=7a1d974518dfa9ecfd2e561f52d1f754/5361538b87d6277f16e1c76121381f30e824fc5e.jpg \n\n https://imgsa.baidu.com/forum/w%3D580/sign=d874ceda062442a7ae0efdade142ad95/a97e201b0ef41bd5eb4b1cad58da81cb39db3d34.jpg \n\n\u6700\u8fd1\u9664\u4e86\u6211\u6ca1\u4ec0\u4e48\u4eba\u8bf4\u8bdd\u7684', 'floor': 15, 'id': 102433910780L, 'thread_id': 4802204556L, 'time': u'2017-01-11 00:11'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 2, 'content': u'\u6570\u636e\u5e93\u8d44\u6599\uff08\u8fd8\u6709\u4e00\u4e2a\u8868\u6ca1\u8865\u5145\u5b8c\uff09\n\u53ea\u5f00\u653e\u4e86select\uff0c\u6b22\u8fce\u968f\u4fbf\u6298\u817e~\nhttp://aqua.hk.cn/adminer.php\n\u7528\u6237\u540d\uff1aPal5Q\n\u5bc6\u7801\uff1a123456', 'floor': 16, 'id': 102453838795L, 'thread_id': 4802204556L, 'time': u'2017-01-11 14:18'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u697c\u4e2d\u697c\u4e5f\u722c\u5b8c\u4e86\uff0c\u8017\u65f6\u6bd4\u697c\u5c42\u8fd8\u957f\uff08\u771f\u662f\u4e00\u4e2a\u5947\u602a\u7684\u5427\uff09\uff0c\u4e0d\u8fc7\u8fd8\u662f\u5c11\u4e8e\u4e00\u5206\u949f\u641e\u5b9a\n\n\u5e16\u5b50\u6570\u91cf: 529\n\u697c\u5c42\u6570\u91cf: 3513\n\u697c\u4e2d\u697c\u6570\u91cf: 9976', 'floor': 17, 'id': 102503608396L, 'thread_id': 4802204556L, 'time': u'2017-01-12 17:45'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:__bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u"select count() from post where content like '%[\u6ed1\u7a3d]%';\nselect count() from comment where content like '%[\u6ed1\u7a3d]%';\n102+293=395\u6761\u6ed1\u7a3d https://tb2.bdstatic.com/tb/editor/images/face/i_f25.png?t=20140803 \nselect count() from post where content like '%[\u6ed1\u7a3d]%' and author!='\u5927\u6e2f\u53e3\u8230'\nselect count() from comment where content like '%[\u6ed1\u7a3d]%' and author!='\u5927\u6e2f\u53e3\u8230'\n43+89=132", 'floor': 18, 'id': 102503765599L, 'thread_id': 4802204556L, 'time': u'2017-01-12 17:50'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u627e\u51fa\u4e00\u5171\u6709\u4e00\u4e2a\u697c\u5c42\uff0c\u5b83\u7684\u697c\u4e2d\u697c\u6570\u91cf\u4e0d\u4e00\u81f4\u3002\nhttp://tieba.baidu.com/p/3977041398\n\u8fd9\u4e2a\u5e16\u5b50\u768417\u697c\uff0c\u8fdb\u5165\u65f6\u663e\u793a"\u8fd8\u67098\u6761\u56de\u590d"\uff0c\u70b9\u5f00\u540e\u6570\u6570\u53d1\u73b0\u53ea\u67097\u6761\u3002', 'floor': 19, 'id': 102506679358L, 'thread_id': 4802204556L, 'time': u'2017-01-12 19:11'} 2017-03-16 19:47:41 [tieba] ERROR: Insert to database error: [Failure instance: Traceback: <type 'exceptions.LookupError'>: unknown encoding: utf8mb4 /usr/lib/python2.7/threading.py:810:bootstrap_inner /usr/lib/python2.7/threading.py:763:run /usr/local/lib/python2.7/dist-packages/twisted/_threads/_threadworker.py:46:work /usr/local/lib/python2.7/dist-packages/twisted/_threads/_team.py:190:doWork --- --- /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:246:inContext /usr/local/lib/python2.7/dist-packages/twisted/python/threadpool.py:262: /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:118:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/python/context.py:81:callWithContext /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:477:_runInteraction /usr/local/lib/python2.7/dist-packages/twisted/enterprise/adbapi.py:467:_runInteraction /home/yangyilang/Tieba_Spider/tieba/pipelines.py:72:insert_post /usr/lib/python2.7/dist-packages/MySQLdb/cursors.py:159:execute /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:264:literal /usr/lib/python2.7/dist-packages/MySQLdb/connections.py:202:unicode_literal ] when dealing with item: {'author': u'\u98ce\u9761\u4e49\u78ca', 'comment_num': 0, 'content': u'\u627e\u5230\u4e86\u8868\u60c5\u540d\u79f0\u548c\u94fe\u63a5\u76f8\u5173\u7684\u811a\u672c\u5185\u5bb9\nhttp://tb1.bdstatic.com/tb/static-common/component/ueditor_emotion/ueditor_emotion.js', 'floor': 20, 'id': 102604377168L, 'thread_id': 4802204556L, 'time': u'2017-01-14 23:46'}

Aqua-Dream commented 7 years ago

你好，请确认你的mysql版本在5.5.3及以上，python的依赖MySQL-python已经是最新版。

tetsaicn commented 7 years ago

Server version: 5.5.53-0+deb8u1 (Debian)

tetsaicn commented 7 years ago

无法更新python-mysql啊啊啊啊

Aqua-Dream commented 7 years ago

抱歉，我真不知道为什么会无法识别utf8mb4，我这边是完全运作良好的

Aqua-Dream commented 7 years ago

pip show MySQL-python 看下版本

tetsaicn commented 7 years ago

已经最新版本，然后

_mysql_exceptions.OperationalError: (2002, "Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)")

tetsaicn commented 7 years ago

成功了，谢谢！！