ThiagoPanini / terraglue

Providing an easy way to deploy a Glue job in any AWS account using Terraform
https://terraglue.readthedocs.io/en/latest/
23 stars 3 forks source link

[FEATURE] Create and improve unit testing on the Glue job application #69

Open ThiagoPanini opened 1 year ago

ThiagoPanini commented 1 year ago

:rocket: Feature needed: This issue signs an opportunity to create unit tests for the Spark application deployed as a Glue job in the project. As the Spark application is now using sparksnake package and a new auxiliar module transformers.py, when users calls the terraglue module with mode="learning", it's important to ensure that the Spark application deployed works as expected.


:trophy: Feature benefits: With this new features, user would: