search

apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://gravitino.apache.org
Apache License 2.0
1.1k stars 344 forks source link

[FEATURE] Support Fileset on JuiceFS #5576

Open caican00 opened 1 week ago

caican00 commented 1 week ago

Describe the feature

Support Fileset on JuiceFS

Motivation

No response

Describe the solution

No response

Additional context

No response

YxAc commented 1 week ago

Are you looking to utilize fuse of JuiceFS?

I believe we can support two approaches simultaneously: one is the native fuse of GVFS (which is track in #5504 ), and the other is to reuse the fuse from JuiceFS.

what do you think? @diqiu50 @jerryshao

diqiu50 commented 6 days ago

That's OK. Does this mean that the fileset only provides the JuiceFS path to be mounted, while the mounting operation is handled by another script or program, or is it executed by the Gravitino VFS?

caican00 commented 5 days ago

Does this mean that the fileset only provides the JuiceFS path to be mounted

yes, It can be understood this way.

while the mounting operation is handled by another script or program, or is it executed by the Gravitino VFS?

It seems more reasonable to provide a unified mount interface, which can be implemented by native fuse or juiceFS fuse, and the users can use a config to specify which one they want to use.

WDYT? cc @diqiu50

diqiu50 commented 5 days ago

If we only provide the JuiceFS mount path, adding an interface to GVFS would suffice. However, if we aim for unified mounting in GVFS, reference to the issue #5504