search

harsha2010 / magellan

Geo Spatial Data Analytics on Spark
Apache License 2.0
534 stars 149 forks source link

Spark 2.3.1 Support #227

Closed NJordan72 closed 6 years ago

NJordan72 commented 6 years ago

This PR makes the changes necessary for Magellan to work with Spark 2.3.1 (#213). All tests are passing and it has been run lightly in production and there are no obvious negative side effects of the upgrade.

codecov-io commented 6 years ago

Codecov Report

Merging #227 into master will decrease coverage by 0.03%. The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #227      +/-   ##
==========================================
- Coverage   90.16%   90.12%   -0.04%     
==========================================
  Files          52       52              
  Lines        1789     1782       -7     
  Branches      124      125       +1     
==========================================
- Hits         1613     1606       -7     
  Misses        176      176
Impacted Files Coverage Δ
...main/scala/magellan/catalyst/SpatialJoinHint.scala 100% <100%> (ø) :arrow_up:
src/main/scala/magellan/catalyst/SpatialJoin.scala 95.23% <100%> (ø) :arrow_up:
...che/spark/sql/catalyst/expressions/functions.scala 94.44% <100%> (-0.17%) :arrow_down:
...he/spark/sql/catalyst/expressions/predicates.scala 99.33% <100%> (-0.01%) :arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update aa9021e...c949d0c. Read the comment docs.

harsha2010 commented 6 years ago

LGTM! Thanks for working on this!

andrescardenasp commented 5 years ago

Hello! this is the exact problem that i'm facing right now, Thanks a lot for fixing it, I have a question, when it will be available to be downloaded via maven?

How can use it right now?

Thanks in advance for your help!

King regards.

NJordan72 commented 5 years ago

@andrescardenasp https://jitpack.io/#harsha2010/magellan

amaciel81 commented 5 years ago

Hi,

Looks like the commit to make it compatible with Spark 2.3.1 (402df2f9514c0df1d80fff4fd1e36381765da6c5) couldn't be built: https://jitpack.io/com/github/harsha2010/magellan/402df2f951/build.log

smaley07 commented 5 years ago

@amaciel81 Indeed, cannot grab the jar for jitpack, did you find an alternative ?

andrestobelem commented 4 years ago

how can I get this jar file?