astrolabsoftware / spark3D

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
https://astrolabsoftware.github.io/spark3D/
Apache License 2.0
30 stars 16 forks source link

Introducing Window Query + DataFrame API #112

Closed JulienPeloton closed 5 years ago

JulienPeloton commented 5 years ago

This PR re-introduces the Window query method, but with the DataFrame API.

The core of the routine remains untouched (using RDD), but the I/O are different. It takes a DataFrame as input, and return a DataFrame containing the coordinates of the objects found in the window.

codecov-io commented 5 years ago

Codecov Report

Merging #112 into master will increase coverage by 1.07%. The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master    #112      +/-   ##
=========================================
+ Coverage   89.72%   90.8%   +1.07%     
=========================================
  Files          32      33       +1     
  Lines        1178    1229      +51     
  Branches      194     202       +8     
=========================================
+ Hits         1057    1116      +59     
+ Misses        121     113       -8
Flag Coverage Δ
#python 93.65% <ø> (+2.4%) :arrow_up:
#scala 89.54% <100%> (+0.46%) :arrow_up:
Impacted Files Coverage Δ
src/main/scala/com/spark3d/Queries.scala 100% <100%> (ø) :arrow_up:
...cala/com/spark3d/spatialOperator/WindowQuery.scala 100% <100%> (ø)
src/main/scala/com/spark3d/utils/Utils.scala 97.05% <0%> (+2.94%) :arrow_up:
queries.py 100% <0%> (+58.33%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update f5546f2...b4b29b0. Read the comment docs.