Split into two or export functions?

fergiemcdowall / norch-fetch

Fetch pure HTML from a webserver and save it to disk

MIT License

8 stars 2 forks source link

Split into two or export functions? #14

Open eklem opened 10 years ago

eklem commented 10 years ago

I'm thinking of using some of the norch-fetch functionality through another script. What's the best way forward? Export all functions as is or make a new "download"-script that does just that? Then other crawlers could use the same download/get function.

There are a lot of different crawlers one could write. From very generic to specific cases.

eklem commented 10 years ago

Anyway. I'll have a go at making a norch-fetch-download that exports just that function.