Add components for file interface

mosn / layotto

A fast and efficient cloud native application runtime

http://mosn.io/layotto/

Apache License 2.0

829 stars 173 forks source link

Add components for file interface #236

Closed wenxuwan closed 2 years ago

wenxuwan commented 3 years ago

What would you like to be added:

Layotto support file interface now, and have implemented the alioss component.

So this issue want to support other file system, eg,

[x] awsOss assigned to @zach030
[ ] local file system(file on local disk)
[ ] HDFS
[x] minIo assigned to @zach030
[ ] ftp
many other file systems...

You can refer the interface design document of file component interface design,api design

zach030 commented 3 years ago

I wanna take this issue

seeflood commented 3 years ago

I think we can use existing sdk libs to integrate with different file systems. For example, @zu1k once recommended https://github.com/beyondstorage/go-storage ,it can serve as clients for many backend storages:

seeflood commented 3 years ago

I wanna take this issue

Cool! Which file system component would u like to implement?

zach030 commented 3 years ago

I wanna take this issue

Cool! Which file system component would u like to implement?

I wanna implement aws Oss first! Since it's easy to integrate with sdk go-storage, I will try to implement other file system then.

seeflood commented 3 years ago

@zach030 Good! I assigned the task of aws Oss to you. We look forward to your valuable contributions!

seeflood commented 3 years ago

Some tips for who want to implement File API component: Currently the usage document of File API is WRONG and you can check the proto file as the real definition of File grpc API. We are waiting for @wenxuwan to fix it :)

wenxuwan commented 3 years ago

Some tips for who want to implement File API component: Currently the usage document of File API is WRONG and you can check the proto file as the real definition of File grpc API. We are waiting for @wenxuwan to fix it :)

done https://github.com/mosn/layotto/pull/245

bokket commented 3 years ago

Hi.I did the implementation of the hdfs service for the beyondstorage community over the summer.I would like to try to implement hdfs. Currently the community is changing its name to migrate to v5 version, beyondstorage can support many file storage services, if you want to integrate with beyondstorage, welcome to join in matrix room together to discuss :)

seeflood commented 3 years ago

@bokket Cool,where can we join in the matrix room? Besides, @zach030 is also preparing to integrate Layotto with beyondstorage.So which version of beyondstorage should we use?Is v5 version compatible with legacy systems based on v4 or even older version?

bokket commented 3 years ago

@bokket Cool,where can we join in the matrix room? Besides, @zach030 is also preparing to integrate Layotto with beyondstorage.So which version of beyondstorage should we use?Is v5 version compatible with legacy systems based on v4 or even older version?

sorry for my problem.Here is the link.v5.0 is mainly a restructuring of the project, not moving API.Next week it will basically work.

github-actions[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity in the last 30 days. It will be closed in the next 7 days unless it is tagged (pinned, good first issue or help wanted) or other activity occurs. Thank you for your contributions.