awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
635 stars 299 forks source link

Python wheel for glue spark job invalid #175

Open StevenTollanis opened 1 year ago

StevenTollanis commented 1 year ago

Hi,

I'm trying to build a wheel for using it in a glue spark job. Already built it locally and even ran it, but when I added it to the glue job using --additional-python-modules and run the job. Logs say "Wheel 'name' located at /tmp/name-0.0.1-py3-none-any.whl is invalid" Finally glue shows LAUNCH ERROR | Python Module Installer indicates modules that failed to install, check logs from the PythonModuleInstaller.Please refer logs for details.

Thanks for any hint.