Open ngulyaev opened 1 year ago
Hey @ngulyaev definitely looks like a bug.
I think that's been addressed in terms of https://github.com/azavea/stac4s/pull/496 and https://github.com/azavea/stac4s/pull/502 (see https://github.com/azavea/stac4s/issues/495 for the bug description). If you're on develop, it may be enough to bump stac4s dep up to 0.8.1. I forgot to create a PR with deps upgrade.
@pomadchin Thanks a lot, I tried to override jars through the spark settings but unfortunately it didn't help :
jars = [find_pyrasterframes_assembly(), '/home/ngulyaev/.m2/repository/com/azavea/stac4s/client_2.12/0.8.1/client_2.12-0.8.1.jar']
spark = create_rf_spark_session(**{
# 'spark.jars.packages': 'com.azavea.stac4s:client_2.12:0.8.1',
# 'spark.jars.repositories': 'https://repository.mulesoft.org/nexus/content/repositories/public/'
'spark.jars': ','.join(jars),
'spark.driver.extraClassPath': 'client_2.12-0.8.1.jar',
'spark.executor.extraClassPath': 'client_2.12-0.8.1.jar'
})
Maybe I'm doing it in wrong way? It seems that these filter parameters are simply ignored, it don't fail even if I pass a string object instead of geometry to 'intersects'
@ngulyaev yea I don't think it would work this way, it will still prefer the transitive dep over the extra I think. Publishing the local version based on the current dev is the only real way to check it.
Result of the same query using pystac-client:
Using the pyrasterframes STAC API:
I set the limit to 100 on purpose because it takes a long time to complete the request. Also I noticed that pystac-client is much faster than pyrasterframes STAC API