issues
search
tether
/
roach
A very adaptable web crawler framework. Impossible to kill.
Other
7
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Allow setting job params in addJob other than name
#40
gavingmiller
opened
10 years ago
0
Roadmap for Roach?
#39
victorhooi
opened
10 years ago
2
You should be able to submit information into a form
#38
ekryski
opened
10 years ago
0
Migrate to amqplib instead of node-amqp
#37
ekryski
opened
10 years ago
0
Fetch jobs via API
#36
ekryski
opened
10 years ago
0
Ability to pass config options to server via CLI
#35
ekryski
opened
10 years ago
0
Add hipchat integration
#34
ekryski
opened
10 years ago
0
Add slack integration
#33
ekryski
opened
10 years ago
0
Add web hook support
#32
ekryski
opened
10 years ago
0
Add in Coveralls to show code coverage
#31
ekryski
opened
10 years ago
0
Create website for roach
#30
ekryski
opened
10 years ago
0
Asynchronous goodness with co
#29
bredele
closed
10 years ago
7
Add a logging transport
#28
ekryski
closed
10 years ago
2
Support delays before job runs
#27
ekryski
opened
10 years ago
0
Support retries on failure
#26
ekryski
opened
10 years ago
0
We need to support complex schedules
#25
ekryski
opened
10 years ago
0
Upgrade to the latest version of rabbitMQ
#24
ekryski
closed
10 years ago
2
Create crawler.stop() method
#23
ekryski
closed
10 years ago
3
Look into handling process errors
#22
ekryski
closed
10 years ago
1
Handle file not found errors
#21
ekryski
closed
10 years ago
0
queue finished (and failed)
#20
bredele
closed
10 years ago
1
Crawler has a separate process
#19
bredele
closed
10 years ago
4
word up
#18
bredele
closed
10 years ago
0
Crawlers should support custom steps
#17
ekryski
opened
10 years ago
14
Crawlers should support parsing PDF files
#16
ekryski
opened
10 years ago
3
Crawlers should support parsing ZIP files
#15
ekryski
closed
10 years ago
1
Crawlers should support parsing XLS/XLSX
#14
ekryski
closed
10 years ago
3
Crawlers should support parsing CSV
#13
ekryski
closed
10 years ago
3
Crawlers should support parsing Text
#12
ekryski
closed
10 years ago
1
Crawlers should support parsing HTML
#11
ekryski
closed
10 years ago
4
Crawlers should support parsing XML
#10
ekryski
closed
10 years ago
3
Data from crawler should be shipped off to RabbitMQ
#9
ekryski
closed
10 years ago
5
We should have a way to run the roach server
#8
ekryski
closed
10 years ago
1
We should have a CLI for scaffolding a crawler
#7
ekryski
closed
10 years ago
0
Deploy Roach onto Heroku
#6
ekryski
opened
10 years ago
0
Get available crawlers via REST API
#5
ekryski
closed
10 years ago
4
Schedule Jobs via Rest API
#4
ekryski
opened
10 years ago
0
A comment about dependencies...
#3
bredele
opened
10 years ago
2
Use lodash for utils
#2
ekryski
closed
10 years ago
2
command line / api json / roach command
#1
bredele
opened
10 years ago
7