gocolly / redisstorage

Redis based storage backend for Colly
https://godoc.org/github.com/gocolly/redisstorage
Apache License 2.0
35 stars 11 forks source link

Redis Storage for Colly

This is a redis based storage backend for Colly collectors.

GoDoc

Install

go get -u github.com/gocolly/redisstorage

Usage

import (
    "github.com/gocolly/colly"
    "github.com/gocolly/redisstorage"
)
c := colly.NewCollector()

storage := &redisstorage.Storage{
    Address:  "127.0.0.1:6379",
    Password: "",
    DB:       0,
    Prefix:   "job01",
}

err := c.SetStorage(storage)
if err != nil {
    panic(err)
}

Bugs

Bugs or suggestions? Visit the issue tracker or join #colly on freenode