The reason these commits were pushed, to make GT more compatible with DataBricks 9.1 LTS. This task tracks the drop of the Spark 3.1.x and the move of the whole library to Spark 3.2.x (which matches DataBricks 10.4 LTS runtime).
There are two ways of resolving the shapeless dependency inconsistency:
remove shapeless from the cluster class path (that means that users are responsible for taking care of the cluster deps)
this solution is more a workaround, that should be handled in every specific case
upgrade up to Spark 3.2.x which depends on the more recent shapeless version that matches the circe version GeoTrellis depends
This issue tracks the revert of https://github.com/locationtech/geotrellis/commit/37d8ca6e1e6f217b367dc35cd21fa23fb6651021, https://github.com/locationtech/geotrellis/commit/8f67fcfb3d083beb8fdf73504284452b3756d3b6, https://github.com/locationtech/geotrellis/commit/53f8f9776516b9ffb4b1848d2853ff0c135c6932, https://github.com/locationtech/geotrellis/commit/0ece50441db7f67a49ab48c8d80b7352851b4a5c, https://github.com/locationtech/geotrellis/commit/570d8d58280801a1bb25d425581a53481672fdb4, https://github.com/locationtech/geotrellis/commit/dfff1b5c29b4800867e5786fff63e83ef8eb913c, https://github.com/locationtech/geotrellis/commit/fdefb1d36315872cf0510978c091b182ac9eb367.
The reason these commits were pushed, to make GT more compatible with DataBricks 9.1 LTS. This task tracks the drop of the Spark 3.1.x and the move of the whole library to Spark 3.2.x (which matches DataBricks 10.4 LTS runtime).
There are two ways of resolving the shapeless dependency inconsistency: