quantitative data - Githubissues

RD-Connect / vcfLoader

From gVCFS to ElasticSearch through SparkSQL-Hive-Parquet

2 stars 1 forks source link

quantitative data #29

Open dpiscia opened 8 years ago

dpiscia commented 8 years ago

need to collect quantitative data about loading process,

dpiscia commented 8 years ago

add these to default conf file spark.eventLog.enabled true spark.serializer org.apache.spark.serializer.KryoSerializer spark.eventLog.dir file:///tmp/spark-events or hdfs instead of file

these will keep the log for the ui then start the history server ./start-history-server.sh

and go to host:18080