search

hupili / snsapi

Cross platform middleware for Social Networking Services: Twitter, Facebook, SinaWeibo, Renren, RSS, Email, Sqlite, ... (more coming)
http://snsapi.ie.cuhk.edu.hk
159 stars 53 forks source link

Async improvements #100

Open hupili opened 10 years ago

hupili commented 10 years ago

Add action log in DB

We can not trace previously updated messages. Add one log entry in the DB for each updated messages.

Add a fail queue

Or else, async daemon will continuously try and fail on the same error.

Multi-thread not only SNSPocket.home_timeline but also Platform.home_timeline

the current async pocket takes sync version of home_timeline in a batch. If one channel get stuck, others are also stuck.

hupili commented 10 years ago

@fqj1994

hupili commented 10 years ago

log mixing is one problem of snscli-async. It's inconvenient to operate.