search

AlexIoannides / pyspark-example-project

Implementing best practices for PySpark ETL jobs and applications.
1.56k stars 672 forks source link

PEX integration? #11

Closed archenroot closed 4 years ago

archenroot commented 5 years ago

Hi guys, looking to template spark jobs as well, thx for this job!

What about PEX aproach? https://medium.com/criteo-labs/packaging-code-with-pex-a-pyspark-example-9057f9f144f3

AlexIoannides commented 4 years ago

I'd prefer it if people forked this (simple) repo and implemented the use of PEX themselves, rather than be channeled into using it via this project.