search

cnshot / CNShot

@cnshot Twitter bot
https://twitter.com/cnshot
1 stars 0 forks source link

Slow crawl command #8

Open cnshot opened 13 years ago

cnshot commented 13 years ago

Crawl command lasts minutes. It's believed to be caused by slow SQL queries, especially the query to update Tweet object in processStatus().

cnshot commented 13 years ago

mysql> INSERT INTO lts_link (url, alias_of_id) VALUES ('http://www.nobody.com', NULL);

Query OK, 1 row affected (1.67 sec)

cnshot commented 13 years ago 
`UPDATE `lts_tweet` SET `text` = '《里约大冒险》—— 小鸟拯救宅男。\nhttp://fl5.me/7ojuha', `created_at` = '2011-04-14 08:08:20', `user_screenname` = 'QiaoX' WHERE `lts_tweet`.`id` = 0;`
Query OK, 0 rows affected (1.37 sec)
Rows matched: 1  Changed: 0  Warnings: 0