Spark Optimization - Githubissues

CSIRT-MU / Stream4Flow

A framework for the real-time network traffic analysis based on world-leading technologies for distributed stream processing, network traffic monitoring, and visualization.

https://csirt.muni.cz/?lang=en

MIT License

101 stars 36 forks source link

Spark Optimization #28

Closed tomjirsa closed 7 years ago

tomjirsa commented 7 years ago

Optimize parameters for run-application.sh
Use spark native configuration
Tune logging settings

tomjirsa commented 7 years ago

Check logging options, consult their relevancy with @cermmik If suitable, move them to spark default config.

cermmik commented 7 years ago

Will be updated within dynamic resource allocation.