People who use apache beam.
Not just for personal studying, but also would like to help people with pipeline implementation.
See examples.
Pipeline Name | Description | State |
---|---|---|
MongoIOSimpleReadService | Simply read from mongodb | Done |
MongoIOSimpleWriteService | Simply write to mongodb | Done |
MongoIOSimpleQueryService | Simply read from mongodb using custom query | Done |
ElasticsearchIOSimpleReadService | Simply read from elasticsearch using custom query | Done |
ElasticsearchIOSimpleWriteService | Simply write to elasticsearch. | Done |
tbc
See TUTORIAL.md.
This is a instruction for running test locally. Tests are also ran in Github Action.
cd java/
./gradlew test
cd java/
./gradlew shadowJar
cd java
# Set environment variables accordingly
source ../envrc.sample
# Run JAR file
java -cp build/libs/java-1.0-SNAPSHOT-all.jar app.examples.APPNAME
e.g
java -cp build/libs/java-1.0-SNAPSHOT-all.jar app.examples.ElasticsearchIOSimpleRead