search

alltherooms / cached-request

Node.js module to perform HTTP requests with caching support
MIT License
61 stars 23 forks source link

in memory version #7

Closed RichardWright closed 8 years ago

RichardWright commented 8 years ago

Hi!

Great idea, I'm thinking about taking on the missing helper methods (get, etc) but before I started I thought I'd ask - how come the cache isn't in memory? Would it be possible to have that as an option?

danypype commented 8 years ago

We designed this module with huge volumes or requests in mind. We currently use it in multiple projects that crawl websites, sending an average of 2MM requests daily. Disk caching seemed as the right answer since the bottle neck is the requests / second limits that the websites impose.

If you're interested in adding memory caching support, please send us a PR. Thank you! :)