The smart_open API seems to not support file seeking, which tifffile uses. (See also #253)
We already have gcloud_storage_utils which buffers to a local file before using the gcloud CLI to upload (it's a lot more performant). That means, it has access to normal file seeking.
And we get a performance boost for large prediction TIFFs, yay 😎
The smart_open API seems to not support file seeking, which tifffile uses. (See also #253)
We already have gcloud_storage_utils which buffers to a local file before using the
gcloudCLI to upload (it's a lot more performant). That means, it has access to normal file seeking.And we get a performance boost for large prediction TIFFs, yay 😎