search

nathanmarz / cascalog

Data processing on Hadoop without the hassle.
Other
1.38k stars 178 forks source link

Why use out of date hadoop-core instead of replacement hadoop-common? #303

Open thoughtmanifest opened 8 years ago

thoughtmanifest commented 8 years ago

Shouldn't hadoop-common be used in place of hadoop-core in the dependencies of the various Cascalog projects, per this stackoverflow question or is there something else keeping it from being updated/changed to use hadoop-common or even hadoop-client instead of hadoop-core.

sritchie commented 8 years ago

The only thing preventing this change is a solid maintainer. If you'd be interested I'd be happy to add you to the list! On Thu, May 5, 2016 at 12:29 PM David S notifications@github.com wrote:

Shouldn't hadoop-common be used in place of hadoop-core in the dependencies of the various Cascalog projects, per this stackoverflow question http://stackoverflow.com/questions/28856096/differences-between-hadoop-common-hadoop-core-and-hadoop-client or is there something else keeping it from being updated/changed to use hadoop-common or even hadoop-client instead of hadoop-core.

— You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub https://github.com/nathanmarz/cascalog/issues/303

jiacai2050 commented 5 years ago

Hi @sritchie, I would like spending my spare time maintaining cascalog, I used it in production in 2014[1], since then move on to other fields, but still related to Hadoop and clojure thing.

[1]: https://github.com/jiacai2050/hebo this is the project to schedule cascalog jobs.

sritchie commented 5 years ago

@jiacai2050, I'm sure that's fine. I'm so out of the loop that I don't really understand what needs work, but if you have anything you'd like to work on I could probably help code review while you get spun up.

Thanks for thinking of Cascalog!

jiacai2050 commented 5 years ago

Thanks. First of all, I will try upgrade hadoop/cascading version, then check existing issues/pulls. Any ideas ?

sritchie commented 5 years ago

@jiacai2050 I've been out of the Cascalog game for maybe 6 years now so unfortunately I don't. Best of luck!