Crawler to automatically import sites

ImmaculateObsession / nest

The platform for Quail Comics

MIT License

1 stars 0 forks source link

Crawler to automatically import sites #10

Open elzilrac opened 11 years ago

elzilrac commented 11 years ago

Subtasks: -Study comics sites; try to find common patterns -make it generic, but flexible -figure out how to store the crawled stuff -look at site base directories

phildini commented 11 years ago

This one's pretty much all you, because I know next to nothing about writing crawlers. I know a little about web scrapers, so I'll help where I can, but you're definitely the expert here.