search

scala / pickling

Fast, customizable, boilerplate-free pickling support for Scala
lampwww.epfl.ch/~hmiller/pickling
BSD 3-Clause "New" or "Revised" License
831 stars 79 forks source link

Clarify whether this is production-ready? #190

Closed Blaisorblade closed 10 years ago

Blaisorblade commented 10 years ago

Is this just an interesting research prototype, or is this also intended for production use? I see the warnings in the README, but they don't seem clear enough to everybody.

Here's a relevant rant on Twitter. I can't judge the content myself.

https://twitter.com/extempore2/status/480844387295846401 https://twitter.com/extempore2/status/480844536415940608 https://twitter.com/extempore2/status/480844760551157761 https://twitter.com/extempore2/status/480844760551157761 https://twitter.com/extempore2/status/480853486330851328

Also, the mentioned bug is already fixed by fe79d7e1b8c31f3900d8e1ed781fc2c98e6001fb (it's unfortunate I did not forward that as a report earlier).

Apparently this is also listed among libraries intended for use. https://twitter.com/extempore2/status/512620068790738944 https://twitter.com/extempore2/status/512620212185595904

I think writing "not stable enough for production use" and "prototype" in the README might address the issue.

Blaisorblade commented 10 years ago

(I don't have a strong opinion myself, but I do think opening an issue is a better approach than ranting on Twitter).

heathermiller commented 10 years ago

I have Spark running distributed machine learning jobs on top of pickling for the past 1.5 months. All serialization frameworks have limitations – e.g. Kryo can only serialize objects with no-arg constructors. When I announce a stable release, I'll document what precisely is supported. Further, the status of the framework is clearly marked in the README with "Scala/pickling is currently in the early development stages, and any user feedback is highly appreciated!".

Myself and Philipp have been hard at work bringing pickling up to production quality for Spark in the past 1.5-2 months, so complaints are likely now moot. ...Especially the however many tweets related to the one (fixed) array bounds overflow bug. Don't need to feed the trolls.

Blaisorblade commented 10 years ago

Hi @heathermiller, thanks for the answer! I didn't mean to "feed the trolls", sorry for that: I meant to turn whining into useful feedback, apparently I missed sensible timing.

Anyway, I'll try Pickling out next time I need this technology :-).