This PR adds a new argument to DaskGeoDataFrame.pack_partitions_to_parquet named temp_format. This argument may be set to a format string containing a {partition} replacement field. If provided, this string is formatted with the output partition number to generate the temporary directory path for that partition.
For example temp_format="/tmp/spatial/part-{partition}" would create temporary directories:
/tmp/spatial/part-0
/tmp/spatial/part-1
/tmp/spatial/part-2
...
The temp_format string may also contain a {uuid} replacement field. If provided this will be replaced by a randomly generated UUID string. This makes it possible to reuse the same temp_format string in multiple simultaneous jobs without conflict.
This PR adds a new argument to
DaskGeoDataFrame.pack_partitions_to_parquetnamedtemp_format. This argument may be set to a format string containing a{partition}replacement field. If provided, this string is formatted with the output partition number to generate the temporary directory path for that partition.For example
temp_format="/tmp/spatial/part-{partition}"would create temporary directories:/tmp/spatial/part-0/tmp/spatial/part-1/tmp/spatial/part-2...The
temp_formatstring may also contain a{uuid}replacement field. If provided this will be replaced by a randomly generated UUID string. This makes it possible to reuse the sametemp_formatstring in multiple simultaneous jobs without conflict.