postmodern / spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
MIT License
806 stars 109 forks source link

handle css @import spidering #8

Open zapnap opened 14 years ago

zapnap commented 14 years ago

Discussed in IRC the other day. Noting it here for posterity. Could look into using http://github.com/alexdunae/css_parser for this, although there may be a more efficient path.

parser = CssParser::Parser.new
parser.load_uri!(uri)
parser.loaded_uris
=> [uri, imported_uri_1, imported_uri_2, etc]