JaneliaSciComp / BigStitcher-Spark

Running compute-intense parts of BigStitcher distributed
BSD 2-Clause "Simplified" License
20 stars 11 forks source link

Dependencies need version updates in BigStitcher-Spark #14

Open kgabor opened 1 year ago

kgabor commented 1 year ago

For the records, I'm ticketing our discussion with @tpietzsch about the BigStitcher-Spark dependencies on 2023-03-09.

It seems that the dependencies of BigStitcher-Spark are getting too old... I tried to run BigStitcher-Spark main checkout as of 2023-03-08 with with a bigdataviewer-omezarr main branch build.

java -Xmx94g -cp $(cat cp.txt) -Dspark.master=local net.preibisch.bigstitcher.spark.AffineFusion 
-x /home/jupyter/data/exaSPIM_609281_2022-11-03_proc_2022-11-22/affine_ip_alignment.xml 
-o /home/jupyter/test-spark_2023-03-08 --bdv 0,0 --storage N5 
--xmlout=/home/jupyter/fusion_test_2023-03-08/dataset.xml

where cp.txt is generated from the BigStitcher-Spark build (bigdataviewer-omezarr is added manually)

mvn dependency:build-classpath -Dmdep.outputFile=cp.txt