search

tether / roach

A very adaptable web crawler framework. Impossible to kill.
Other
7 stars 1 forks source link

We should have a way to run the roach server #8

Closed ekryski closed 10 years ago

ekryski commented 10 years ago

If we do npm install -g roach we should then be able to simply run the server in two ways:

  1. CLI:

roach run --port 5000 --crawlers /users/eric/dev/crawlers

  1. In our own custom js file:
var roach = require('roach').server({
  port: 5000,
  crawlers: './crawlers'
});

// Do some stuff.

roach.run();
bredele commented 10 years ago 
roach run -r

the -r --redis option allows you to configure a redis client (port, host) with a nice and easy prompt.