TileDB-Inc / TileDB

The Universal Storage Engine
https://tiledb.com
MIT License
1.8k stars 179 forks source link

Feature Request: VFS::copy_dir() and VFS::copy_file()` #1691

Open mikejiang opened 4 years ago

mikejiang commented 4 years ago

VFS is very handy but is missing some important APIs: copy a folder/file. Not sure how difficult it is to implement them. But it will make vfs module even more complete and powerful with this addition. (Right now I have to write a new tiledb to the dest even when I just simply need to do the copy, which I assume will be more efficient)

stavrospapadopoulos commented 4 years ago

Agreed, this is a good suggestion. We'll try to add it soon. Thanks!

mikejiang commented 4 years ago

That will be fantastic!

mikejiang commented 3 years ago

any updates on this?We have a data structure using tiledb as the backend, it's clone method needs to be able to create a copy of the original object. Without the vfs.copy_dir. It has to read the data from disk and invoke write routine to create a new tiledb array, which is really not efficient.

stavrospapadopoulos commented 3 years ago

Hi Mike, yeah we'll try to implement this soon. Thanks for the reminder.

mikejiang commented 3 years ago

Thanks. We've been actually waiting on this along with two other features

Currently h5 is still the default backend for our entire cytometry tool chains. but once these missing features are added, I think we are in good shape to fully adopt tiledb as the default.