Making RTree Serializable

[rahulmidha31]

Hi,

I was trying to integrate this in Spark for one of my use cases. However, post constructing the RTree object I wanted to broadcast it to the executors, but failed since the RTree object was not serializable.

Work around: Initialized it once per executor, but still it would be great if we could simply mark it serializable.

[davidmoten]

Serialization is supported and is discussed in the README.md.

On Thu, 3 Nov 2016, 02:13 rahulmidha31 notifications@github.com wrote:

Hi,

I was trying to integrate this in Spark for one of my use cases. However, post constructing the RTree object I wanted to broadcast it to the executors, but failed since the RTree object was not serializable.

Work around: Initialized it once per executor, but still it would be great if we could simply mark it serializable.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/davidmoten/rtree/issues/62, or mute the thread https://github.com/notifications/unsubscribe-auth/AATa69zGcGIIMKT2LSxFeE687t6MP5_iks5q6KfXgaJpZM4KnWlm .

[rahulmidha31]

Thanks David, though i was talking about the default java serialization but found a way to make it work with Spark. Thanks..

[netanel246]

Hi, Can you please describe how did you solve it? Thanks.

[rahulmidha31]

Hi,

For spark, I just added a property for using the default serializer as Kryo.

Property : spark.serializer=org.apache.spark.serializer.KryoSerializer

[q127981]

Hi,

For spark, I just added a property for using the default serializer as Kryo.

Property : spark.serializer=org.apache.spark.serializer.KryoSerializer

Hello, may I ask, I also want to use it in spark. But I added custom geometry, how can I serialize it?In addition to adding attributes, what else to do？ thank you! @rahulmidha31