astrolabsoftware / spark3D

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
https://astrolabsoftware.github.io/spark3D/
Apache License 2.0
30 stars 16 forks source link

Add the conversion from FITS file (single HDU) to parquet #92

Closed JulienPeloton closed 5 years ago

JulienPeloton commented 5 years ago

fits2other.py can now write the data of one FITS HDU into a parquet file. The default behaviour makes use of snappy compression and pyarrow.

codecov-io commented 5 years ago

Codecov Report

Merging #92 into master will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master      #92   +/-   ##
=======================================
  Coverage   97.35%   97.35%           
=======================================
  Files          31       31           
  Lines        1133     1133           
  Branches      217      217           
=======================================
  Hits         1103     1103           
  Misses         30       30
Flag Coverage Δ
#python 97.7% <ø> (ø) :arrow_up:
#scala 97.24% <ø> (ø) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 8746a85...b51aefc. Read the comment docs.