search

astrolabsoftware / spark3D

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
https://astrolabsoftware.github.io/spark3D/
Apache License 2.0
30 stars 16 forks source link

Scala visualization tools #125

Closed JulienPeloton closed 4 years ago

JulienPeloton commented 4 years ago

Linked to issue: #122

In many cases, we would like to perform some visual inspection of the partitioning, but displaying large data sets is not a trivial task. The approach of this PR consists in repartitioning the DataFrame, and sampling the data for the display. The display is done using a scala client of plotly.

For more information about the resulting plots, see the spark3D website.

codecov-io commented 4 years ago

Codecov Report

Merging #125 into master will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #125   +/-   ##
=======================================
  Coverage   93.68%   93.68%           
=======================================
  Files          33       33           
  Lines        1235     1235           
  Branches      188      188           
=======================================
  Hits         1157     1157           
  Misses         78       78
Flag Coverage Δ
#python 93.65% <ø> (ø) :arrow_up:
#scala 93.69% <ø> (ø) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update c905009...5de0d6c. Read the comment docs.