Add native support for monoio project

apache / opendal

Apache OpenDAL: access data freely.

https://opendal.apache.org

Apache License 2.0

3.18k stars 442 forks source link

Add native support for monoio project #4552

Open Xuanwo opened 3 months ago

Xuanwo commented 3 months ago

Apply for this project: https://summer-ospp.ac.cn/org/prodetail/241110346

Goal

Add monoio based fs support as mentioned in https://github.com/apache/opendal/issues/4520.

The usage will look like:

let op = Operator::via_map(Scheme::MonoioFs, map)?;
let bs = op.read("path/to/file").await?;

Requirement

Know about monoio
Know about how to build/test rust project
Better to have some knowledge about io-uring
The current fs API in monoio is incomplete; we may need to collaborate with upstream to finalize them.

Mentorship

Mentor: @Xuanwo Discussion: mailing list and discord

hoslo commented 3 months ago

@Xuanwo I'm interested in this.

Xuanwo commented 3 months ago

@Xuanwo I'm interested in this.

Thank you for your interest. However, this project is designated as an OSPP project; perhaps you would like to participate as a mentor instead?

hoslo commented 3 months ago

@Xuanwo I'm interested in this.

Thank you for your interest. However, this project is designated as an OSPP project; perhaps you would like to participate as a mentor instead?

I just noticed this, you are better as a mentor, I can go and solve other issues.

NKID00 commented 1 month ago

Task list to track progress of `monoiofs`

[x] init monoiofs service, introduce feature flag and dep (#4855)
[x] monoio runtime wrapper, thread management and operation dispatch (#4885)
[x] open, read & write (#4944)
[x] behavior tests (#4944)
[x] stat (#4944)
[x] delete (#4944)
[ ] create_dir
[ ] rename
[ ] benchmarks

Blocked by monoio

[ ] vectored io (bytedance/monoio#266)