search

radanalyticsio / silex

something to help you spark
Apache License 2.0
65 stars 13 forks source link

Json Transformer #20

Closed rnowling closed 9 years ago

rnowling commented 9 years ago

Initial work on JSON transformer. Implemented as an implicit function of RDD[string]s which applies a partialfunction to each string using json4s' transform() function.

Unit tests do not currently compile -- example needs to be reworked.

Would it be better to use transformField instead of transform?

rnowling commented 9 years ago

I dropped use of implicits since I couldn't get them working. The tests pass now. I suggest we add a transformField() method next and then try to get implicits working.

rnowling commented 9 years ago

Ok, moved to rdd.json