medialab / sandcrawler-dashboard

A handy terminal dashboard plugin for sandcrawler.
20 stars 2 forks source link

sandcrawler-dashboard

A handy terminal dashboard displaying advanced information about one of your sandcrawler spiders.

demo

Installation

You can install sandcrawler-dashboard through npm:

npm install sandcrawler-dashboard

Usage

var sandcrawler = require('sandcrawler'),
    dashboard = require('sandcrawler-dashboard');

var spider = sandcrawler.spider('MyFancySpider')
  .use(dashboard())
  .url('http://nicesite.org')
  .scraper(function($, done) {
    done(null, $('title').text());
  })
  .run();

Options

Example

var sandcrawler = require('sandcrawler'),
    logger = require('sandcrawler-logger');

var spider = sandcrawler.spider('MyFancySpider')
  .use(dashboard({logger: {color: 'red'}}));

License

MIT