search

AlexIoannides / pyspark-example-project

Implementing best practices for PySpark ETL jobs and applications.
1.56k stars 672 forks source link

Does not work when running on yarn in client mode #30

Open Rustem opened 2 years ago

Rustem commented 2 years ago

Hi seems like etl_config.json is not accessible when running in yarn client mode. Could you please me to investigate this issue?

AlexIoannides commented 2 years ago

I don't have access to a YARN-based cluster I'm afraid - if you are able to figure-out the issue, it'd be greatly appreciated.