Description of changes:
The current implementation reads all data twice as far as I can see.
The dynamicframe dropNull causes recomputeSchema to be triggered in
the toDF call.
Guess there is a thousand ways of achieving it. Just added something that solves the matter, in a quick way
cause I don't know if this project is still alive.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Issue #, if available: N/A
Description of changes: The current implementation reads all data twice as far as I can see. The dynamicframe dropNull causes recomputeSchema to be triggered in the toDF call. Guess there is a thousand ways of achieving it. Just added something that solves the matter, in a quick way cause I don't know if this project is still alive.
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.