VijayQin / DMHY-spider

This project aims at crawling on DMHY, and store the html and torrent of each animation in our local file systems and in database(SQLite3). The future work will be filtering animation we want by the given rules and alert us to those updated every day.
14 stars 2 forks source link

sqlite3 ProgrammingError is thrown while downloading the animation from[2016-07-01,2016-08-27] #7

Closed VijayQin closed 8 years ago

VijayQin commented 8 years ago

sqlite3 ProgrammingError is thrown while downloading the animation from[2016-07-01,2016-08-27] The error message is Traceback (most recent call last): File "DMHY_DataBase.py", line 420, in DataBase.start_requests() File "DMHY_DataBase.py", line 223, in start_requests cu.execute(insert_sql, d) sqlite3.ProgrammingError: You must not use 8-bit bytestrings unless you use a text_factory that can interpret 8-bit bytestrings (like text_factory = str). It is highly recommended that you instead just switch your application to Unicode strings. It seems like the exception is thrown while inserting into database. image

VijayQin commented 8 years ago

This is caused by property attach encode error, and it has been fixed in version 2.0.0.