Apache OpenDAL™: One Layer, All Storage.
OpenDAL is an Open Data Access Layer that enables seamless interaction with diverse storage services.
OpenDAL's development is guided by its vision of One Layer, All Storage and its core principles: Open Community, Solid Foundation, Fast Access, Object Storage First, and Extensible Architecture. Read the explained vision at OpenDAL Vision.
For ANY languages
| Name | Release | Docs |
|---|---|---|
| Rust Core |  |
  |
| C Binding | - | |
| Cpp Binding | - | |
| D Binding | - | - |
| Dotnet Binding | - | - |
| Go Binding |  |
|
| Haskell Binding | - | - |
| Java Binding |  |
|
| Lua Binding | - | - |
| Node.js Binding |  |
|
| Ocaml Binding | - | - |
| PHP Binding | - | - |
| Python Binding |  |
|
| Ruby Binding | - | - |
| Swift Binding | - | - |
| Zig Binding | - | - |
For ANY methods
| Name | Description | Release |
|---|---|---|
| oay | Access data via API Gateway |  |
| oli | Access data via Command Line (alternative to s3cmd, s3cli, azcopy) |  |
| ofs | Access data via POSIX file system API (alternative to s3fs) |  |
For ANY integrations
| Name | Description | Release | Docs |
|---|---|---|---|
| dav-server-opendalfs | a dav-server-rs implementation using opendal. |  |
|
| object_store_opendal | an object_store implementation using opendal. |  |
|
| fuse3_opendal | Access data via integrations to fuse3 |  |
|
| virtiofs_opendal | Access data via integrations to vhost-user-backend |  |
|
| unftp-sbe-opendal | an unftp storage backend implementation using opendal. |  |
|
| parquet_opendal | Provides parquet efficient IO utilities |
 |
|
For ANY services
| Type | Services |
|---|---|
| Standard Storage Protocols | ftp http sftp |
| Object Storage Services | azblob gcs oss b2 upyun |
| File Storage Services | fs alluxio azfile compfs dbfs hdfs ipfs |
| Consumer Cloud Storage Service | aliyun_drive onedrive icloud pcloud yandex_disk |
| Key-Value Storage Services | cacache dashmap memory etcd foundationdb redis sled redb atomicserver |
| Database Storage Services | d1 mysql sqlite |
| Cache Storage Services | ghac mini_moka vercel_artifacts |
| Git Based Storage Services | huggingface |
Examples
The examples are available at here.
Documentation
The documentation is available at https://opendal.apache.org.
Contribute
OpenDAL is an active open-source project. We are always open to people who want to use it or contribute to it. Here are some ways to go.
- Start with Contributing Guide.
- Submit Issues for bug report or feature requests.
- Start Discussions for questions or ideas.
- Talk to community directly at Discord.
- Report security vulnerabilities to private mailing list
Who is using OpenDAL?
Rust Core
- apache/iceberg-rust: Native Rust implementation of Apache Iceberg, the open table format for analytic datasets.
- CrateDB: An open-source, distributed SQL database for Real-Time Analytics and Hybrid Search
- Databend: A modern Elasticity and Performance cloud data warehouse.
- deepeth/mars: The powerful analysis platform to explore and visualize data from blockchain.
- GreptimeDB: An open-source, cloud-native, distributed time-series database.
- mozilla/sccache:
sccacheisccachewith cloud storage - OctoBase: the open-source database behind AFFiNE, local-first, yet collaborative.
- ParadeDB: Postgres for Search and Analytics - fast full-text search and analytics in Postgres and over cloud storage. Built as an extension.
- Pants: A fast, scalable, user-friendly build system for codebases of all sizes.
- QuestDB: An open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity.
- RisingWave: A Distributed SQL Database for Stream Processing
- Vector: A high-performance observability data pipeline.
C Binding
- Milvus: A cloud-native vector database, storage for next generation AI applications
Java Binding
- QuestDB: An open-source time-series database for high throughput ingestion and fast SQL queries with operational simplicity.
Branding
The first and most prominent mentions must use the full form: Apache OpenDAL™ of the name for any individual usage (webpage, handout, slides, etc.) Depending on the context and writing style, you should use the full form of the name sufficiently often to ensure that readers clearly understand the association of both the OpenDAL project and the OpenDAL software product to the ASF as the parent organization.
For more details, see the Apache Product Name Usage Guide.
License and Trademarks
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0
Apache OpenDAL, OpenDAL, and Apache are either registered trademarks or trademarks of the Apache Software Foundation.