How is this better than Hadoop? <EOM>

jlouis / positive

Check if a term is positive

MIT License

13 stars 3 forks source link

How is this better than Hadoop? <EOM> #6

Open lucperkins opened 8 years ago

jlouis commented 8 years ago

What version of Hadoop do you have in mind?

Licenser commented 8 years ago

The simpler architecture allows for a better horizontal scaling. Unlike hadoop it totally avoid locks with can become a headache once a few thousand instances are running in parallel.

jlouis commented 8 years ago

This remdinds me, we should of course spawn a new gen_server for each request in #3

jlouis commented 8 years ago

I have been contemplating this issue for a while. Can we solve it with a Map/Reduce framework over the data, or do we need to employ a microbatching solution based on Apache Kafka?