People who use apache beam.
Not just for personal studying, but also would like to help people with pipeline implementation.
See examples.
| Pipeline Name | Description | State |
|---|---|---|
| MongoIOSimpleReadService | Simply read from mongodb | Done |
| MongoIOSimpleWriteService | Simply write to mongodb | Done |
| MongoIOSimpleQueryService | Simply read from mongodb using custom query | Done |
| ElasticsearchIOSimpleReadService | Simply read from elasticsearch using custom query | Done |
| ElasticsearchIOSimpleWriteService | Simply write to elasticsearch. | Done |
tbc
See TUTORIAL.md.
This is a instruction for running test locally. Tests are also ran in Github Action.
cd java/
./gradlew testcd java/
./gradlew shadowJarcd java
# Set environment variables accordingly
source ../envrc.sample
# Run JAR file
java -cp build/libs/java-1.0-SNAPSHOT-all.jar app.examples.APPNAME
e.g
java -cp build/libs/java-1.0-SNAPSHOT-all.jar app.examples.ElasticsearchIOSimpleRead