bts-webber / SparkstreamingApp_python

9 stars 86 forks source link

A program running on spark.

Consume data from kafka,then produce to kafka,or write to Elasticsearch.

Usage

vim AppConfig.json

LIBRARY_PATH="./lib"
SCHEMA_PATH="./schema"
PYTHON_LIB_PATH="/pylib"

RUN

python StartJobShell.py -j jobname

python StartJobSehll.py --help