search

astrolabsoftware / spark3D

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
https://astrolabsoftware.github.io/spark3D/
Apache License 2.0
30 stars 16 forks source link

Refactor the API #106

Closed JulienPeloton closed 5 years ago

JulienPeloton commented 5 years ago

I feel it would be easier to use spark3D if we hide to user classes such as Point3D, ShellEnvelope, etc.. which would be only used internally to perform the computation. The users would give an input (file, or RDD, or DF) and get back a standard RDD[primitive]. By doing so, it will be easier to (1) integrate spark3D to other tools and pipelines, and (2) interface Scala functionalities in Python.

JulienPeloton commented 5 years ago

done in #108 #109 #110 #111 #112 #113 #114 etc.