search

tether / roach

A very adaptable web crawler framework. Impossible to kill.
Other
7 stars 1 forks source link

Roadmap for Roach? #39

Open victorhooi opened 10 years ago

victorhooi commented 10 years ago

This project looks really awesome =), I was just wondering if you guys can share any insight on the future roadmap for Roach?

Also, is it something that's funded by PetroFeed, and actively used by them in production?

The reason I ask is that there was previously a project called node.io (https://github.com/chriso/node.io), but that seems to have been abandoned. And there doesn't seem to be any real alternatives at the moment:

https://groups.google.com/d/topic/nodejs/0E76dy0mgwI/discussion

It would be awesome if Roach could be the go-to crawling framework for Node, much like Scrapy is for Python.

ADunfield commented 10 years ago

Hey @victorhooi,

Yes Roach is being used in production by PetroFeed. We are deeply committed to it and will continue to fund it for the foreseeable future. @ekryski has detailed road map and will be sharing it in detail very soon.

victorhooi commented 10 years ago

Hi @ADunfield

Aha, coolies - that's good to hear.

Yeah, a Roadmap would be aweesome. Is @ekryski still with PetroFeed?