search

scality / spark

Apache License 2.0
3 stars 0 forks source link

Remove limit for flag 16 #5

Closed ghost closed 2 years ago

ghost commented 2 years ago

Catch objects which are below 64MB and not split.

ghost commented 2 years ago

@patrickdos I believe this is the change you were suggesting?

ghost commented 2 years ago

Restored the overlooked parenthesis and the .select("_c1") for the df.filter() which was removed with the flag 16 conditional.

ghost commented 2 years ago

@patrickdos I believe this PR is what you requested. I'm waiting for a review before I approve/merge though.

Thanks