Current implementation of --pyfiles only keeps the files with .py extension in the archive. However, often non-py files are included into a package. Fix to make sure (ideally we could read setup.py/manifest/gitignore, but should work as a quick fix as dataproc will likely go away soon).
Current implementation of
--pyfiles
only keeps the files with.py
extension in the archive. However, often non-py files are included into a package. Fix to make sure (ideally we could readsetup.py
/manifest/gitignore, but should work as a quick fix as dataproc will likely go away soon).