Open dolsysmith opened 3 years ago
Add option to specify concatenating JSON files up to a size.
Also move parse_size() from spark_utils.py to utils.py since it will need to be called to supply to_size value.
parse_size()
spark_utils.py
utils.py
to_size