search

awslabs / aws-glue-libs

AWS Glue Libraries are additions and enhancements to Spark for ETL operations.
Other
635 stars 300 forks source link

toDF ResolveOption doesn't work #106

Open alicehua11 opened 2 years ago

alicehua11 commented 2 years ago

Hi all, Following your documentation on AWS Glue documentation, I ran into an error below. I checked your source codes and it should work but it doesn't, any idea why?

ValueError: Target type must be specified with project action.

That error happens when I convert dynamic frame to a Spark DF and try to resolve schema with ResolveOption as documented. dynamicframe_test.toDF([ResolveOption("extraction_time", "Project", DoubleType())])