Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations. Paimon innovatively combines lake format and LSM structure, bringing realtime streaming updates into the lake architecture.
Background and documentation are available at https://paimon.apache.org
Paimon's former name was Flink Table Store, developed from the Flink community. The architecture refers to some
design concepts of Iceberg. Thanks to Apache Flink and Apache Iceberg.
Collaboration
Paimon tracks issues in GitHub and prefers to receive contributions as pull requests.
Mailing Lists
| Name | Subscribe | Digest | Unsubscribe | Post | Archive |
|---|---|---|---|---|---|
|
user@paimon.apache.org User support and questions mailing list |
Subscribe | Subscribe | Unsubscribe | Post | Archives |
|
dev@paimon.apache.org Development related discussions |
Subscribe | Subscribe | Unsubscribe | Post | Archives |
Please make sure you are subscribed to the mailing list you are posting to! If you are not subscribed to the mailing list, your message will either be rejected (dev@ list) or you won't receive the response (user@ list).
Slack
You can join the Paimon community on Slack. Paimon channel is in ASF Slack workspace.
- Anyone with an @apache.org email address can become a full member of the ASF Slack workspace. Search Paimon channel and join it.
- If you don't have an @apache.org email address, you can email to
user@paimon.apache.orgto apply for an ASF Slack invitation. Then join Paimon channel.
Building
JDK 8/11 is required for building the project. Maven version >=3.3.1.
- Run the
mvn clean install -DskipTestscommand to build the project. - Run the
mvn spotless:applyto format the project (both Java and Scala). - IDE: Mark
paimon-common/target/generated-sources/antlr4as Sources Root.
How to Contribute
License
The code in this repository is licensed under the Apache Software License 2.