search

AbsaOSS / spline-spark-agent

Spline agent for Apache Spark
https://absaoss.github.io/spline/
Apache License 2.0
185 stars 95 forks source link

YAML config breaks on non-string values #616

Closed wajda closed 1 year ago

wajda commented 1 year ago

This is a continuation of #610

This is fixed in commons-configuration:1.7 https://issues.apache.org/jira/browse/CONFIGURATION-432

Unfortunately, Spark 2.4 depends on version 1.6

There already were other issues with YAML as version 1.2 being interpreted as float and there may be more. Other properties sources just treat everything as string and do the conversion once it is asked for. Maybe we could use Yaml the same way.