Hi!
lately we found our tasks are being paused forever while resetting kafka offsets
for example there is the log of first task :
First log
```
2019-08-01T13:17:58,059 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2019-08-01T13:17:58,080 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from runtime.properties
2019-08-01T13:17:58,261 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2019-08-01T13:17:59,717 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [org.apache.druid.common.config.NullValueHandlingConfig@56f0cc85]
2019-08-01T13:17:59,878 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions', useExtensionClassloaderFirst=false, hadoopDependenciesDir='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-histogram, druid-datasketches, druid-lookups-cached-global, postgresql-metadata-storage, druid-hdfs-storage, druid-kafka-indexing-service, kafka-emitter]}]
2019-08-01T13:17:59,891 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:17:59,989 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-histogram/druid-histogram-0.14.2-incubating.jar] for extension[druid-histogram]
2019-08-01T13:17:59,995 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:17:59,997 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/memory-0.12.2.jar] for extension[druid-datasketches]
2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/slf4j-api-1.6.4.jar] for extension[druid-datasketches]
2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/commons-math3-3.6.1.jar] for extension[druid-datasketches]
2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/sketches-core-0.13.3.jar] for extension[druid-datasketches]
2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/druid-datasketches-0.14.2-incubating.jar] for extension[druid-datasketches]
2019-08-01T13:18:00,001 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:18:00,012 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.14.2-incubating.jar] for extension[druid-lookups-cached-global]
2019-08-01T13:18:00,013 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:18:00,016 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar] for extension[postgresql-metadata-storage]
2019-08-01T13:18:00,017 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.14.2-incubating.jar] for extension[postgresql-metadata-storage]
2019-08-01T13:18:00,023 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-configuration-1.6.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-compress-1.16.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-framework-4.1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/objenesis-2.6.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/druid-hdfs-storage-0.14.2-incubating.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/xmlenc-0.52.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jersey-client-1.9.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-api-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/servlet-api-2.5.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-auth-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-net-3.1.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-hdfs-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okio-1.4.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-digester-1.8.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-recipes-4.1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jsp-api-2.1.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okhttp-2.4.0.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/stax-api-1.0-2.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/json-smart-1.1.1.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/gson-2.2.4.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,047 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/htrace-core4-4.0.1-incubating.jar] for extension[druid-hdfs-storage]
2019-08-01T13:18:00,164 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.14.2-incubating.jar] for extension[druid-kafka-indexing-service]
2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.2.jar] for extension[druid-kafka-indexing-service]
2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar] for extension[druid-kafka-indexing-service]
2019-08-01T13:18:00,170 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T13:18:00,171 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/slf4j-api-1.6.4.jar] for extension[kafka-emitter]
2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-clients-0.10.2.0.jar] for extension[kafka-emitter]
2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/lz4-1.3.0.jar] for extension[kafka-emitter]
2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-emitter-0.14.0-incubating.jar] for extension[kafka-emitter]
2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/snappy-java-1.1.2.6.jar] for extension[kafka-emitter]
2019-08-01T13:18:00,359 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2019-08-01T13:18:01,004 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,026 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,027 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,038 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,040 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,042 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.quantiles.DoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,044 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.tuple.ArrayOfDoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,046 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.hll.HllSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,047 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,049 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.server.lookup.namespace.NamespaceExtractionModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,049 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,051 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,052 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,054 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,054 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,056 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:01,056 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T13:18:01,058 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.emitter.kafka.KafkaEmitterModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T13:18:04,968 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-08-01T13:18:06,481 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.emitter.kafka.KafkaEmitterConfig] from props[druid.emitter.kafka.] as [KafkaEmitterConfig{bootstrap.servers='sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093', metric.topic='druid-metrics', alert.topic='druid-logs', request.topic='druid-requests', Producer.config={max.block.ms=10000, security.protocol=SSL, ssl.truststore.password=qwe123, ssl.truststore.location=/opt/cloudera/security/pki/server.truststore.jks}}]
2019-08-01T13:18:06,517 INFO [main] org.apache.kafka.clients.producer.ProducerConfig - ProducerConfig values:
acks = 1
batch.size = 16384
block.on.buffer.full = false
bootstrap.servers = [sbt-oaar-0811.delta.sbrf.ru:9093, sbt-oaar-0812.delta.sbrf.ru:9093, , sbt-oaar-0813.delta.sbrf.ru:9093, sbt-oaar-0814.delta.sbrf.ru:9093, sbt-oaar-0815.delta.sbrf.ru:9093]
buffer.memory = 33554432
client.id =
compression.type = none
connections.max.idle.ms = 540000
interceptor.classes = null
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 10000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.fetch.timeout.ms = 60000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.ms = 100
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = SSL
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks
ssl.truststore.password = [hidden]
ssl.truststore.type = JKS
timeout.ms = 30000
value.serializer = class org.apache.kafka.common.serialization.StringSerializer
2019-08-01T13:18:06,627 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.0
2019-08-01T13:18:06,627 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : 576d93a8dc0cf421
2019-08-01T13:18:06,662 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.security.Escalator] from props[druid.escalator.] as [NoopEscalator{}]
2019-08-01T13:18:06,687 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.CuratorConfig] from props[druid.zk.service.] as [org.apache.druid.curator.CuratorConfig@37348491]
2019-08-01T13:18:06,694 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [org.apache.druid.curator.ExhibitorConfig@10b687f2]
2019-08-01T13:18:06,814 INFO [main] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode
2019-08-01T13:18:06,819 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2019-08-01T13:18:06,880 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.metric.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T13:18:06,880 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.alert.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.bootstrap.servers property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.request.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.producer.config property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T13:18:06,894 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}]
2019-08-01T13:18:06,898 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [org.apache.druid.server.initialization.ZkPathsConfig@22e2266d]
2019-08-01T13:18:06,913 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}]
2019-08-01T13:18:06,985 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [org.apache.druid.server.metrics.DruidMonitorSchedulerConfig@ee8e7ff]
2019-08-01T13:18:06,990 WARN [main] org.apache.druid.server.metrics.MonitorsConfig - Deprecated Monitor class name[io.druid.java.util.metrics.JvmMonitor] found, please use name[org.apache.druid.java.util.metrics.JvmMonitor] instead.
2019-08-01T13:18:06,993 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class org.apache.druid.java.util.metrics.JvmMonitor]}]
2019-08-01T13:18:06,994 INFO [main] org.apache.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: org.apache.druid.emitter.kafka.KafkaEmitter@49433c98
2019-08-01T13:18:06,994 INFO [main] org.apache.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.14.2-incubating}
2019-08-01T13:18:07,789 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [org.apache.druid.server.initialization.CuratorDiscoveryConfig@415d88de]
2019-08-01T13:18:07,860 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, queueSize=2147483647, enableRequestLimit=false, maxIdleTime=PT5M, defaultQueryTimeout=10000, maxScatterGatherBytes=9223372036854775807, maxQueryTimeout=9223372036854775807, maxRequestHeaderSize=8192, gracefulShutdownTimeout=PT0S, unannouncePropagationDelay=PT0S, inflateBufferSize=4096, compressionLevel=-1}]
2019-08-01T13:18:08,393 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.java.util.metrics.JvmMonitor@3b4ef59f]
2019-08-01T13:18:08,395 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.query.ExecutorServiceMonitor@5a7b309b]
2019-08-01T13:18:08,395 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@353c6da1]
2019-08-01T13:18:08,400 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [org.apache.druid.server.log.StartupLoggingConfig@75e80a97]
2019-08-01T13:18:08,400 INFO [main] org.apache.druid.cli.CliPeon - Starting up with processors[16], memory[2,111,832,064], maxMemory[3,221,225,472], directMemory[3,221,225,472].
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.enabled: true
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.evictOnClose: true
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.sizeInBytes: 536870912
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.type: caffeine
2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter: kafka
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.alert.topic: druid-logs
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.bootstrap.servers: sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.metric.topic: druid-metrics
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.producer.config: {"max.block.ms":10000, "security.protocol":"SSL","ssl.truststore.password":"qwe123","ssl.truststore.location":"/opt/cloudera/security/pki/server.truststore.jks" }
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.request.topic: druid-requests
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.directory: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies
2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-histogram","druid-datasketches","druid-lookups-cached-global","postgresql-metadata-storage", "druid-hdfs-storage", "druid-kafka-indexing-service","kafka-emitter"]
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.host: sbt-oaar-0813.delta.sbrf.ru
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.directory: /user/druid/logs
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.durationToRetain: 86400000
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.enabled: true
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.runner.javaOptsArray: ["-server", "-Xmx3g","-XX:+ExitOnOutOfMemoryError", "-Duser.timezone=UTC", "-Dfile.encoding=UTF-8", "-XX:+UseG1GC", "-XX:MaxGCPauseMillis=200","-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager" ,"-Dlog4j.configurationFile=scripts/log4j2.xml"]
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.baseDir: /hdfs/druid_temp_segments/
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: false
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.javascript.enabled: false
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:postgresql://sbt-oaar-0810.delta.sbrf.ru:5432/druid_db
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.password:
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.user: druid
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.type: postgresql
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: pprb_eventlog
2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskType: index_kafka
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.monitoring.emissionPeriod: PT1m
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.monitoring.monitors: ["io.druid.java.util.metrics.JvmMonitor"]
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.plaintextPort: 8102
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.port: 18091
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 134217728
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.numThreads: 16
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.feed: druid_requests
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.requestLogEventBuilderFactory: {}
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.type: emitter
2019-08-01T13:18:08,419 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.http.defaultQueryTimeout: 10000
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.http.numThreads: 40
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.service: druid/middlemanager
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.sql.enable: true
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.storageDirectory: /user/druid/segments
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.type: hdfs
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.tlsPort: -1
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.worker.capacity: 4
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2019-08-01T13:18:08,420 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.service.host: sbt-oaar-0815.delta.sbrf.ru:2181
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * file.encoding: UTF-8
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * file.separator: /
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.class.path: /var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/yarn-conf:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/_common:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/middleManager:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-aether-provider-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/ion-java-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/janino-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-unix-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-servlet-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/metrics-core-4.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jmespath-java-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-module-jaxb-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-core-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections4-4.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/tesla-aether-0.0.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-smile-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-core-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/hibernate-validator-5.1.3.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/disruptor-3.3.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/antlr4-runtime-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlet-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compress-1.16.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jvm-attach-api-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-guice-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-framework-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-1.2-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/slf4j-api-1.6.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-server-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/okhttp-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/shims-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-hll-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-smile-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/esri-geometry-api-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-okhttp-0.0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aggdesigner-algorithm-6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcl-over-slf4j-1.7.12.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-server-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/opencsv-4.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/validation-api-1.1.0.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/objenesis-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-codec-1.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-io-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-file-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-io-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-guava-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jq-0.0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/airline-0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-databind-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-security-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool-1.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-continuation-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpcore-4.4.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-api-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-servlet-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jline-0.9.94.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-util-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-service-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-http-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/reactive-streams-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guava-16.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-interpolation-1.19.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/icu4j-54.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zstd-jni-1.3.3-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-core-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-epoll-4.1.29.Final-linux-x86_64.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-jul-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-sql-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-path-2.3.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joda-time-2.9.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/extendedset-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/error_prone_annotations-2.3.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/RoaringBitmap-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbyclient-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool2-2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-kms-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-text-1.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/caffeine-2.5.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jdbi-2.63.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/sigar-1.6.5.132.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/fastutil-8.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-processing-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-server-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-core-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.activation-1.2.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-core-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-services-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/compress-lzf-1.0.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-recipes-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/wagon-provider-api-2.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-multibindings-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-math3-3.6.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-http-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/config-magic-0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zookeeper-3.4.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jboss-logging-3.1.3.GA.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr305-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derby-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-s3-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.inject-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-mapper-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-metrics-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlets-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-netty-utils-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-server-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-aws-common-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-x-discovery-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-joda-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-linq4j-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-base-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-hadoop-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbynet-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/lz4-java-1.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-reactive-streams-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-socks-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-core-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-proxy-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-tree-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-proxy-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/mapdb-1.0.8.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joni-2.1.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-commons-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-util-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-ec2-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-client-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/rhino-1.7R5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-slf4j-impl-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-api-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/classmate-1.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-smart-2.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/spymemcached-2.12.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-repository-metadata-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-client-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-impl-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-cbor-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-dbcp2-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-utils-3.0.15.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-all-4.1.30.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jna-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-json-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-artifact-3.6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcodings-1.0.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-buffer-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-spi-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/checker-qual-2.5.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-console-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/protobuf-java-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/xz-1.8.jar
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.class.version: 52.0
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.endorsed.dirs: /usr/java/jdk1.8.0_161/jre/lib/endorsed
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.ext.dirs: /usr/java/jdk1.8.0_161/jre/lib/ext:/usr/java/packages/lib/ext
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.home: /usr/java/jdk1.8.0_161/jre
2019-08-01T13:18:08,421 INFO [main] org.apache.druid.cli.CliPeon - * java.io.tmpdir: /var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/tmp
2019-08-01T13:18:08,422 INFO [main] org.apache.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-08-01T13:18:08,422 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.name: Java(TM) SE Runtime Environment
2019-08-01T13:18:08,422 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.version: 1.8.0_161-b12
2019-08-01T13:18:08,422 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2019-08-01T13:18:08,422 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.version: 1.8
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.version: 1.8.0_161
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.info: mixed mode
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.name: Java HotSpot(TM) 64-Bit Server VM
2019-08-01T13:18:08,428 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.version: 25.161-b12
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * line.separator:
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * log4j.configurationFile: scripts/log4j2.xml
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: org.apache.druid.common.config.Log4jShutdown
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * os.arch: amd64
2019-08-01T13:18:08,430 INFO [main] org.apache.druid.cli.CliPeon - * os.name: Linux
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * os.version: 3.10.0-957.21.3.el7.x86_64
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * path.separator: :
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.arch.data.model: 64
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.boot.class.path: /usr/java/jdk1.8.0_161/jre/lib/resources.jar:/usr/java/jdk1.8.0_161/jre/lib/rt.jar:/usr/java/jdk1.8.0_161/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_161/jre/lib/jsse.jar:/usr/java/jdk1.8.0_161/jre/lib/jce.jar:/usr/java/jdk1.8.0_161/jre/lib/charsets.jar:/usr/java/jdk1.8.0_161/jre/lib/jfr.jar:/usr/java/jdk1.8.0_161/jre/classes
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.boot.library.path: /usr/java/jdk1.8.0_161/jre/lib/amd64
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.endian: little
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.isalist:
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.command: org.apache.druid.cli.Main internal peon /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/task.json /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/28403724-bf9a-43dc-9db1-f843d5e960eb/status.json /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/28403724-bf9a-43dc-9db1-f843d5e960eb/report.json
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * sun.os.patch.level: unknown
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * user.country: US
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * user.dir: /run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * user.home: /opt/druid
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * user.language: en
2019-08-01T13:18:08,431 INFO [main] org.apache.druid.cli.CliPeon - * user.name: druid
2019-08-01T13:18:08,432 INFO [main] org.apache.druid.cli.CliPeon - * user.timezone: UTC
2019-08-01T13:18:08,448 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [org.apache.druid.storage.hdfs.HdfsKerberosConfig@0]
2019-08-01T13:18:08,468 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [org.apache.druid.indexing.common.config.TaskConfig@3a0b6a]
2019-08-01T13:18:08,486 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [org.apache.druid.guice.http.DruidHttpClientConfig@29bbc63c]
2019-08-01T13:18:08,791 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [org.apache.druid.client.indexing.IndexingServiceSelectorConfig@73a845cb]
2019-08-01T13:18:08,867 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [org.apache.druid.indexing.common.RetryPolicyConfig@684ce74c]
2019-08-01T13:18:08,870 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [org.apache.druid.storage.hdfs.HdfsDataSegmentPusherConfig@4dd2ef54]
2019-08-01T13:18:08,878 INFO [main] org.apache.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2019-08-01T13:18:08,885 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [org.apache.druid.segment.loading.LocalDataSegmentPusherConfig@1860a7a1]
2019-08-01T13:18:08,903 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.DruidServerConfig] from props[druid.server.] as [org.apache.druid.client.DruidServerConfig@448ade1]
2019-08-01T13:18:08,913 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [org.apache.druid.server.initialization.BatchDataSegmentAnnouncerConfig@4975dda1]
2019-08-01T13:18:08,922 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [org.apache.druid.server.coordination.BatchDataSegmentAnnouncerProvider@10618775]
2019-08-01T13:18:08,925 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [org.apache.druid.client.coordinator.CoordinatorSelectorConfig@59328218]
2019-08-01T13:18:08,928 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [org.apache.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@dada335]
2019-08-01T13:18:08,939 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [134217728] for [druid.processing.buffer.sizeBytes] on [org.apache.druid.query.DruidProcessingConfig#intermediateComputeSizeBytesConfigured()]
2019-08-01T13:18:08,942 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [16] for [druid.processing.numThreads] on [org.apache.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2019-08-01T13:18:08,943 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [org.apache.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2019-08-01T13:18:08,945 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [org.apache.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2019-08-01T13:18:08,945 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [org.apache.druid.query.DruidProcessingConfig#isFifo()]
2019-08-01T13:18:08,945 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [org.apache.druid.query.DruidProcessingConfig#getTmpDir()]
2019-08-01T13:18:08,946 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [org.apache.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2019-08-01T13:18:08,946 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [org.apache.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2019-08-01T13:18:09,137 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.client.cache.CacheProvider] from props[druid.cache.] as [org.apache.druid.client.cache.CaffeineCacheProvider@7cc2c551]
2019-08-01T13:18:09,693 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [org.apache.druid.client.cache.CacheConfig@153cfd86]
2019-08-01T13:18:09,697 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.segment.writeout.SegmentWriteOutMediumFactory] from props[druid.peon.defaultSegmentWriteOutMediumFactory.] as [org.apache.druid.segment.writeout.TmpFileSegmentWriteOutMediumFactory@259195fe]
2019-08-01T13:18:09,711 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2019-08-01T13:18:09,720 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.TLSServerConfig] from props[druid.server.https.] as [TLSServerConfig{keyStorePath='null', keyStoreType='null', certAlias='null', keyManagerFactoryAlgorithm='null', includeCipherSuites=null, excludeCipherSuites=null, includeProtocols=null, excludeProtocols=null, requireClientCertificate=false, trustStoreType='null', trustStorePath='null', trustStoreAlgorithm='null', validateHostnames='true', crlPath='null'}]
2019-08-01T13:18:09,744 INFO [main] org.eclipse.jetty.util.log - Logging initialized @16556ms to org.eclipse.jetty.util.log.Slf4jLog
2019-08-01T13:18:09,777 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Creating http connector with port [8102]
2019-08-01T13:18:10,131 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.search.SearchQueryConfig] from props[druid.query.search.] as [org.apache.druid.query.search.SearchQueryConfig@4f402027]
2019-08-01T13:18:10,139 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [org.apache.druid.query.metadata.SegmentMetadataQueryConfig@145a821d]
2019-08-01T13:18:10,159 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [GroupByQueryConfig{defaultStrategy='v2', singleThreaded=false, maxIntermediateRows=50000, maxResults=500000, bufferGrouperMaxSize=2147483647, bufferGrouperMaxLoadFactor=0.0, bufferGrouperInitialBuckets=0, maxMergingDictionarySize=100000000, maxOnDiskStorage=0, forcePushDownLimit=false, forceHashAggregation=false, intermediateCombineDegree=8, numParallelCombineThreads=1, forcePushDownNestedQuery=false}]
2019-08-01T13:18:10,231 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[134,217,728]
2019-08-01T13:18:10,620 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[134,217,728]
2019-08-01T13:18:11,064 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[2] of size[134,217,728]
2019-08-01T13:18:11,512 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[3] of size[134,217,728]
2019-08-01T13:18:11,947 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[4] of size[134,217,728]
2019-08-01T13:18:12,418 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[5] of size[134,217,728]
2019-08-01T13:18:12,887 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[6] of size[134,217,728]
2019-08-01T13:18:13,359 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[7] of size[134,217,728]
2019-08-01T13:18:13,948 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[8] of size[134,217,728]
2019-08-01T13:18:14,197 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[9] of size[134,217,728]
2019-08-01T13:18:14,705 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[10] of size[134,217,728]
2019-08-01T13:18:15,377 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[11] of size[134,217,728]
2019-08-01T13:18:15,971 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[12] of size[134,217,728]
2019-08-01T13:18:16,766 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[13] of size[134,217,728]
2019-08-01T13:18:17,000 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[14] of size[134,217,728]
2019-08-01T13:18:17,304 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[15] of size[134,217,728]
2019-08-01T13:18:17,654 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[134,217,728]
2019-08-01T13:18:18,189 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[134,217,728]
2019-08-01T13:18:18,654 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[2] of size[134,217,728]
2019-08-01T13:18:19,051 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[3] of size[134,217,728]
2019-08-01T13:18:19,894 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.scan.ScanQueryConfig] from props[druid.query.scan.] as [ScanQueryConfig{legacy=false}]
2019-08-01T13:18:19,896 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [org.apache.druid.query.select.SelectQueryConfig@25fa6889]
2019-08-01T13:18:19,898 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [org.apache.druid.query.topn.TopNQueryConfig@7e31d53b]
2019-08-01T13:18:19,924 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [org.apache.druid.server.log.EmittingRequestLoggerProvider@15f861ee]
2019-08-01T13:18:19,946 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir='', enableLookupSyncOnStartup=true, numLookupLoadingThreads=8, coordinatorFetchRetries=3, lookupStartRetries=3, coordinatorRetryDelay=60000}]
2019-08-01T13:18:19,951 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [INIT]
2019-08-01T13:18:19,951 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@3b65084e].
2019-08-01T13:18:19,952 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [NORMAL]
2019-08-01T13:18:19,976 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.emitter.kafka.KafkaEmitter.start()] on object[org.apache.druid.emitter.kafka.KafkaEmitter@49433c98].
2019-08-01T13:18:19,976 INFO [main] org.apache.druid.emitter.kafka.KafkaEmitter - Starting Kafka Emitter.
2019-08-01T13:18:20,026 INFO [main] org.apache.druid.curator.CuratorModule - Starting Curator
2019-08-01T13:18:20,026 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2019-08-01T13:18:20,067 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built on 11/01/2017 18:06 GMT
2019-08-01T13:18:20,067 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=sbt-oaar-0813.delta.sbrf.ru
2019-08-01T13:18:20,067 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_161
2019-08-01T13:18:20,067 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2019-08-01T13:18:20,067 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/java/jdk1.8.0_161/jre
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/yarn-conf:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/_common:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/middleManager:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-aether-provider-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/ion-java-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/janino-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-unix-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-servlet-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/metrics-core-4.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jmespath-java-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-module-jaxb-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-core-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections4-4.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/tesla-aether-0.0.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-smile-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-core-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/hibernate-validator-5.1.3.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/disruptor-3.3.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/antlr4-runtime-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlet-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compress-1.16.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jvm-attach-api-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-guice-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-framework-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-1.2-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/slf4j-api-1.6.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-server-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/okhttp-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/shims-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-hll-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-smile-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/esri-geometry-api-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-okhttp-0.0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aggdesigner-algorithm-6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcl-over-slf4j-1.7.12.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-server-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/opencsv-4.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/validation-api-1.1.0.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/objenesis-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-codec-1.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-io-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-file-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-io-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-guava-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jq-0.0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/airline-0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-databind-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-security-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool-1.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-continuation-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpcore-4.4.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-api-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-servlet-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jline-0.9.94.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-util-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-service-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-http-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/reactive-streams-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guava-16.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-interpolation-1.19.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/icu4j-54.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zstd-jni-1.3.3-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-core-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-epoll-4.1.29.Final-linux-x86_64.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-jul-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-sql-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-path-2.3.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joda-time-2.9.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/extendedset-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/error_prone_annotations-2.3.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/RoaringBitmap-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbyclient-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool2-2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-kms-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-text-1.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/caffeine-2.5.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jdbi-2.63.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/sigar-1.6.5.132.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/fastutil-8.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-processing-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-server-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-core-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.activation-1.2.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-core-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-services-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/compress-lzf-1.0.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-recipes-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/wagon-provider-api-2.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-multibindings-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-math3-3.6.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-http-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/config-magic-0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zookeeper-3.4.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jboss-logging-3.1.3.GA.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr305-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derby-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-s3-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.inject-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-mapper-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-metrics-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlets-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-netty-utils-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-server-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-aws-common-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-x-discovery-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-joda-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-linq4j-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-base-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-hadoop-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbynet-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/lz4-java-1.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-reactive-streams-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-socks-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-core-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-proxy-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-tree-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-proxy-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/mapdb-1.0.8.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joni-2.1.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-commons-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-util-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-ec2-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-client-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/rhino-1.7R5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-slf4j-impl-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-api-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/classmate-1.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-smart-2.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/spymemcached-2.12.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-repository-metadata-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-client-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-impl-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-cbor-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-dbcp2-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-utils-3.0.15.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-all-4.1.30.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jna-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-json-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-artifact-3.6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcodings-1.0.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-buffer-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-spi-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/checker-qual-2.5.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-console-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/protobuf-java-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/xz-1.8.jar
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/tmp
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.10.0-957.21.3.el7.x86_64
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=druid
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/opt/druid
2019-08-01T13:18:20,068 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER
2019-08-01T13:18:20,070 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=sbt-oaar-0815.delta.sbrf.ru:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@621dc63d
2019-08-01T13:18:20,123 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2019-08-01T13:18:20,125 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.emitter.service.ServiceEmitter.start()] on object[ServiceEmitter{serviceDimensions={service=druid/middlemanager, host=sbt-oaar-0813.delta.sbrf.ru:8102, version=0.14.2-incubating}, emitter=org.apache.druid.emitter.kafka.KafkaEmitter@49433c98}].
2019-08-01T13:18:20,125 INFO [main] org.apache.druid.emitter.kafka.KafkaEmitter - Starting Kafka Emitter.
2019-08-01T13:18:20,127 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.metrics.MonitorScheduler.start()] on object[org.apache.druid.java.util.metrics.MonitorScheduler@4a122e68].
2019-08-01T13:18:20,127 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181. Will not attempt to authenticate using SASL (unknown error)
2019-08-01T13:18:20,131 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[org.apache.druid.storage.hdfs.HdfsStorageAuthentication@5cbe95b1].
2019-08-01T13:18:20,131 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [INIT]
2019-08-01T13:18:20,131 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [NORMAL]
2019-08-01T13:18:20,134 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.http.client.NettyHttpClient.start()] on object[org.apache.druid.java.util.http.client.NettyHttpClient@1dca62c2].
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [LAST]
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [http-client]
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider.start()] on object[org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider@43d3995f].
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - starting
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - started
2019-08-01T13:18:20,135 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@6c830ebd].
2019-08-01T13:18:20,137 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181, initiating session
2019-08-01T13:18:20,192 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181, sessionid = 0x56c4767ef6c2c96, negotiated timeout = 30000
2019-08-01T13:18:20,250 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2019-08-01T13:18:21,983 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.discovery.DruidLeaderClient.start()] on object[org.apache.druid.discovery.DruidLeaderClient@d8e4250].
2019-08-01T13:18:21,997 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [OVERLORD].
2019-08-01T13:18:22,068 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [OVERLORD].
2019-08-01T13:18:22,068 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Started.
2019-08-01T13:18:22,071 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.announcement.Announcer.start()] on object[org.apache.druid.curator.announcement.Announcer@61993d18].
2019-08-01T13:18:22,071 INFO [main] org.apache.druid.curator.announcement.Announcer - Starting announcer
2019-08-01T13:18:22,071 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@6f240187].
2019-08-01T13:18:22,192 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.discovery.DruidLeaderClient.start()] on object[org.apache.druid.discovery.DruidLeaderClient@3386ed8].
2019-08-01T13:18:22,192 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [COORDINATOR].
2019-08-01T13:18:22,256 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [COORDINATOR].
2019-08-01T13:18:22,256 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Started.
2019-08-01T13:18:22,258 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner.start()] on object[org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner@605eb072].
2019-08-01T13:18:22,265 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[org.apache.druid.indexing.worker.executor.ExecutorLifecycle@7a0f06ad].
2019-08-01T13:18:22,677 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0809.delta.sbrf.ru:18090:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/overlord', host='sbt-oaar-0809.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18090, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='OVERLORD', services={}}] appeared.
2019-08-01T13:18:22,780 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0809.delta.sbrf.ru:18081:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='sbt-oaar-0809.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18081, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='COORDINATOR', services={}}] appeared.
2019-08-01T13:18:22,792 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0810.delta.sbrf.ru:18090:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/overlord', host='sbt-oaar-0810.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18090, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='OVERLORD', services={}}] appeared.
2019-08-01T13:18:22,792 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher.
2019-08-01T13:18:22,804 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0810.delta.sbrf.ru:18081:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='sbt-oaar-0810.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18081, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='COORDINATOR', services={}}] appeared.
2019-08-01T13:18:22,852 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher.
2019-08-01T13:18:23,074 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_kafka",
"id" : "index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii",
"resource" : {
"availabilityGroup" : "index_kafka_pprb_eventlog_3d32631a5f7f703",
"requiredCapacity" : 1
},
"dataSchema" : {
"dataSource" : "pprb_eventlog",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "moduleId", "nodeId", "standId", "levelStr", "hostName", "callerClass", "callerMethod" ],
"dimensionExclusions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "HOUR",
"queryGranularity" : "MINUTE",
"rollup" : true,
"intervals" : null
},
"transformSpec" : {
"filter" : null,
"transforms" : [ ]
}
},
"tuningConfig" : {
"type" : "KafkaTuningConfig",
"maxRowsInMemory" : 50000,
"maxBytesInMemory" : 0,
"maxRowsPerSegment" : 1000000,
"maxTotalRows" : null,
"intermediatePersistPeriod" : "PT10M",
"basePersistDirectory" : "/var/run/cloudera-scm-agent/process/16149-druid-DRUID_OVERLORD/tmp/1558964010036-0",
"maxPendingPersists" : 0,
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"buildV9Directly" : true,
"reportParseExceptions" : false,
"handoffConditionTimeout" : 0,
"resetOffsetAutomatically" : true,
"segmentWriteOutMediumFactory" : null,
"intermediateHandoffPeriod" : "P2147483647D",
"logParseExceptions" : false,
"maxParseExceptions" : 2147483647,
"maxSavedParseExceptions" : 0,
"skipSequenceNumberAvailabilityCheck" : false
},
"ioConfig" : {
"type" : "kafka",
"taskGroupId" : 0,
"baseSequenceName" : "index_kafka_pprb_eventlog_3d32631a5f7f703",
"startPartitions" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"partitionOffsetMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
}
},
"endPartitions" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
},
"partitionOffsetMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
}
},
"startSequenceNumbers" : {
"type" : "start",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"partitionOffsetMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"exclusivePartitions" : [ ]
},
"endSequenceNumbers" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
},
"partitionOffsetMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
}
},
"consumerProperties" : {
"bootstrap.servers" : "sbt-oaar-0811.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0812.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0813.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0814.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0815.vm.mos.cloud.sbrf.ru:9093",
"ssl.truststore.location" : "/opt/cloudera/security/pki/server.truststore.jks",
"security.protocol" : "SSL",
"group.id" : "indexing-service3",
"ssl.truststore.password" : "qwe123",
"auto.offset.reset" : "latest"
},
"pollTimeout" : 100,
"useTransaction" : true,
"minimumMessageTime" : "2019-07-31T13:13:30.026Z",
"maximumMessageTime" : null,
"skipOffsetGaps" : true
},
"context" : {
"checkpoints" : "{\"0\":{\"0\":3171693501,\"1\":3679159365,\"2\":3565415885,\"3\":3623048574,\"4\":3716884056}}",
"IS_INCREMENTAL_HANDOFF_SUPPORTED" : true
},
"groupId" : "index_kafka_pprb_eventlog",
"dataSource" : "pprb_eventlog"
}
2019-08-01T13:18:23,171 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/lock].
2019-08-01T13:18:23,176 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/lock] in 4ms.
2019-08-01T13:18:23,249 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Running task: index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii
2019-08-01T13:18:23,251 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii] location changed to [TaskLocation{host='sbt-oaar-0813.delta.sbrf.ru', port=8102, tlsPort=-1}].
2019-08-01T13:18:23,252 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii] status changed to [RUNNING].
2019-08-01T13:18:23,252 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - SeekableStream indexing task starting up!
2019-08-01T13:18:23,252 INFO [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - Checkpoints [{"0":{"0":3171693501,"1":3679159365,"2":3565415885,"3":3623048574,"4":3716884056}}]
2019-08-01T13:18:23,262 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Starting Jetty Server...
2019-08-01T13:18:23,270 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Starting with sequences: [SequenceMetadata{sequenceId=0, sequenceName='index_kafka_pprb_eventlog_3d32631a5f7f703_0', assignments=[0, 1, 2, 3, 4], startOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusiveStartPartitions=[], endOffsets={0=9223372036854775807, 1=9223372036854775807, 2=9223372036854775807, 3=9223372036854775807, 4=9223372036854775807}, sentinel=false, checkpointed=false}]
2019-08-01T13:18:23,270 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Found chat handler of class[org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider]
2019-08-01T13:18:23,270 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii]
2019-08-01T13:18:23,271 INFO [main] org.eclipse.jetty.server.Server - jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_161-b12
2019-08-01T13:18:24,582 INFO [task-runner-0-priority-0] org.apache.kafka.clients.consumer.ConsumerConfig - ConsumerConfig values:
auto.commit.interval.ms = 5000
auto.offset.reset = none
bootstrap.servers = [sbt-oaar-0811.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0812.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0813.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0814.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0815.vm.mos.cloud.sbrf.ru:9093]
check.crcs = true
client.id =
connections.max.idle.ms = 540000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = indexing-service3
heartbeat.interval.ms = 3000
interceptor.classes = null
internal.leave.group.on.close = true
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 10000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 65536
reconnect.backoff.ms = 50
request.timeout.ms = 305000
retry.backoff.ms = 100
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = SSL
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks
ssl.truststore.password = [hidden]
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2019-08-01T13:18:24,993 INFO [main] org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2019-08-01T13:18:24,993 INFO [main] org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2019-08-01T13:18:24,996 INFO [main] org.eclipse.jetty.server.session - node0 Scavenging every 600000ms
2019-08-01T13:18:25,394 INFO [task-runner-0-priority-0] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.2
2019-08-01T13:18:25,394 INFO [task-runner-0-priority-0] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : cd80bc412b9b9701
2019-08-01T13:18:25,395 INFO [task-runner-0-priority-0] org.apache.druid.server.coordination.CuratorDataSegmentServerAnnouncer - Announcing self[DruidServerMetadata{name='sbt-oaar-0813.delta.sbrf.ru:8102', hostAndPort='sbt-oaar-0813.delta.sbrf.ru:8102', hostAndTlsPort='null', maxSize=0, tier='_default_tier', type=indexer-executor, priority=0}] at [/druid/announcements/sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T13:18:25,446 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announcing [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T13:18:25,521 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.http.SegmentListerResource as a root resource class
2019-08-01T13:18:25,588 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2019-08-01T13:18:25,589 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2019-08-01T13:18:25,589 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2019-08-01T13:18:25,589 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.ForbiddenExceptionMapper as a provider class
2019-08-01T13:18:25,589 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.BadRequestExceptionMapper as a provider class
2019-08-01T13:18:25,589 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.StatusResource as a root resource class
2019-08-01T13:18:25,605 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announced [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T13:18:25,627 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
2019-08-01T13:18:25,688 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Created Appenderator for dataSource[pprb_eventlog].
2019-08-01T13:18:25,878 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Loading sinks from[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii/work/persist]: []
2019-08-01T13:18:25,893 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.StreamAppenderatorDriver - Restored metadata[null].
2019-08-01T13:18:25,967 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[0], start[3171693501] -> end[9223372036854775807] to assignment.
2019-08-01T13:18:25,968 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[1], start[3679159365] -> end[9223372036854775807] to assignment.
2019-08-01T13:18:25,968 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[2], start[3565415885] -> end[9223372036854775807] to assignment.
2019-08-01T13:18:25,969 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[3], start[3623048574] -> end[9223372036854775807] to assignment.
2019-08-01T13:18:25,969 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[4], start[3716884056] -> end[9223372036854775807] to assignment.
2019-08-01T13:18:26,014 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[3] to sequenceNumber[3623048574].
2019-08-01T13:18:26,014 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[4] to sequenceNumber[3716884056].
2019-08-01T13:18:26,014 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[1] to sequenceNumber[3679159365].
2019-08-01T13:18:26,014 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[2] to sequenceNumber[3565415885].
2019-08-01T13:18:26,018 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[0] to sequenceNumber[3171693501].
2019-08-01T13:18:26,463 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T13:18:26,476 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.ForbiddenExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T13:18:26,477 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.BadRequestExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T13:18:26,502 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T13:18:26,538 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T13:18:29,942 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Offsets out of range with no configured reset policy for partitions: {pprb_eventlog-3=3623048574}]
2019-08-01T13:18:30,232 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii]: ResetDataSourceMetadataAction{dataSource='pprb_eventlog', resetMetadata=KafkaDataSourceMetadata{SeekableStreamStartSequenceNumbers=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={3=3623048574}, exclusivePartitions=[]}}}
2019-08-01T13:18:30,486 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii] to overlord: [ResetDataSourceMetadataAction{dataSource='pprb_eventlog', resetMetadata=KafkaDataSourceMetadata{SeekableStreamStartSequenceNumbers=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={3=3623048574}, exclusivePartitions=[]}}}].
2019-08-01T13:18:30,568 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2019-08-01T13:18:30,711 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.SegmentListerResource to GuiceManagedComponentProvider with the scope "PerRequest"
2019-08-01T13:18:30,751 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2019-08-01T13:18:30,771 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2019-08-01T13:18:30,814 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.security.ConfigResourceFilter to GuiceInstantiatedComponentProvider
2019-08-01T13:18:31,467 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2019-08-01T13:18:31,482 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2019-08-01T13:18:31,485 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2019-08-01T13:18:31,894 WARN [main] com.sun.jersey.spi.inject.Errors - The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.druid.server.http.SegmentListerResource.getSegments(long,long,long,javax.servlet.http.HttpServletRequest) throws java.io.IOException, MUST return a non-void type.
2019-08-01T13:18:32,011 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@48f4f03e{/,null,AVAILABLE}
2019-08-01T13:18:32,066 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@470c4229{HTTP/1.1,[http/1.1]}{0.0.0.0:8102}
2019-08-01T13:18:32,067 INFO [main] org.eclipse.jetty.server.Server - Started @38884ms
2019-08-01T13:18:32,068 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.query.lookup.LookupReferencesManager.start()] on object[org.apache.druid.query.lookup.LookupReferencesManager@1e57b783].
2019-08-01T13:18:32,069 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2019-08-01T13:18:32,141 WARN [main] org.apache.druid.query.lookup.LookupReferencesManager - No lookups found for tier [__default], response [org.apache.druid.java.util.http.client.response.FullResponseHolder@23c72128]
2019-08-01T13:18:32,142 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - Coordinator is unavailable. Loading saved snapshot instead
2019-08-01T13:18:32,142 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - No lookups to be loaded at this point
2019-08-01T13:18:32,143 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2019-08-01T13:18:32,144 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[org.apache.druid.query.lookup.LookupResourceListenerAnnouncer@2890e479].
2019-08-01T13:18:32,159 INFO [main] org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/http:sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T13:18:32,160 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [LAST]
2019-08-01T13:18:32,160 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [module]
2019-08-01T13:18:32,162 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Resetting sequences for datasource [pprb_eventlog]: {class=org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner, partitions=[3]}
2019-08-01T13:18:32,175 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
2019-08-01T14:18:24,273 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
2019-08-01T14:18:24,350 INFO [qtp376234567-111] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Updating endOffsets from [{0=9223372036854775807, 1=9223372036854775807, 2=9223372036854775807, 3=9223372036854775807, 4=9223372036854775807}] to [{0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}]
2019-08-01T14:18:24,350 INFO [qtp376234567-111] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Persisting Sequences Metadata [[SequenceMetadata{sequenceId=0, sequenceName='index_kafka_pprb_eventlog_3d32631a5f7f703_0', assignments=[0, 1, 2, 3, 4], startOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusiveStartPartitions=[], endOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, sentinel=false, checkpointed=true}]]
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Ingestion loop resumed
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Finished reading partition[0].
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Finished reading partition[1].
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Finished reading partition[2].
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Finished reading partition[3].
2019-08-01T14:18:24,382 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Finished reading partition[4].
2019-08-01T14:18:24,387 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - All partitions have been fully read
2019-08-01T14:18:24,387 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Persisting all pending data
2019-08-01T14:18:24,389 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.StreamAppenderatorDriver - Persisting data.
2019-08-01T14:18:24,398 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Submitting persist runnable for dataSource[pprb_eventlog]
2019-08-01T14:18:24,439 INFO [pprb_eventlog-incremental-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Committing metadata[AppenderatorDriverMetadata{segments={}, lastSegmentIds={}, callerMetadata={nextPartitions=SeekableStreamEndSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}}}}] for sinks[].
2019-08-01T14:18:24,503 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.StreamAppenderatorDriver - Persisted pending data in 114ms.
2019-08-01T14:18:24,504 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Publishing segments for sequence [SequenceMetadata{sequenceId=0, sequenceName='index_kafka_pprb_eventlog_3d32631a5f7f703_0', assignments=[], startOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusiveStartPartitions=[], endOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, sentinel=false, checkpointed=true}]
2019-08-01T14:18:24,540 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Pushing segments in background: []
2019-08-01T14:18:24,540 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Submitting persist runnable for dataSource[pprb_eventlog]
2019-08-01T14:18:24,540 INFO [pprb_eventlog-incremental-persist] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Committing metadata[AppenderatorDriverMetadata{segments={}, lastSegmentIds={}, callerMetadata={nextPartitions=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusivePartitions=[]}, publishPartitions=SeekableStreamEndSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}}}}] for sinks[].
2019-08-01T14:18:24,576 INFO [publish-0] org.apache.druid.segment.realtime.appenderator.BaseAppenderatorDriver - Nothing to publish, skipping publish step.
2019-08-01T14:18:24,586 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Published segments [] with metadata[AppenderatorDriverMetadata{segments={}, lastSegmentIds={}, callerMetadata={nextPartitions=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusivePartitions=[]}, publishPartitions=SeekableStreamEndSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}}}}].
2019-08-01T14:18:24,587 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Persisting Sequences Metadata [[]]
2019-08-01T14:18:24,598 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Handoff completed for segments [] with metadata[{nextPartitions=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusivePartitions=[]}, publishPartitions=SeekableStreamEndSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}}}].
2019-08-01T14:18:24,598 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Shutting down...
2019-08-01T14:18:24,630 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Unregistering chat handler[index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii]
2019-08-01T14:18:24,630 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Unannouncing [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T14:18:24,630 INFO [task-runner-0-priority-0] org.apache.druid.curator.announcement.Announcer - unannouncing [/druid/internal-discovery/PEON/sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T14:18:24,670 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Unannounced [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T14:18:24,670 INFO [task-runner-0-priority-0] org.apache.druid.server.coordination.CuratorDataSegmentServerAnnouncer - Unannouncing self[DruidServerMetadata{name='sbt-oaar-0813.delta.sbrf.ru:8102', hostAndPort='sbt-oaar-0813.delta.sbrf.ru:8102', hostAndTlsPort='null', maxSize=0, tier='_default_tier', type=indexer-executor, priority=0}] at [/druid/announcements/sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T14:18:24,670 INFO [task-runner-0-priority-0] org.apache.druid.curator.announcement.Announcer - unannouncing [/druid/announcements/sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T14:18:24,707 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii] status changed to [SUCCESS].
2019-08-01T14:18:24,714 INFO [task-runner-0-priority-0] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: {
"id" : "index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii",
"status" : "SUCCESS",
"duration" : 3601458,
"errorMsg" : null
}
2019-08-01T14:18:24,730 INFO [main] org.apache.druid.cli.CliPeon - Thread [Thread[pool-5-thread-3,5,main]] is non daemon.
2019-08-01T14:18:24,731 INFO [main] org.apache.druid.cli.CliPeon - Thread [Thread[pool-5-thread-2,5,main]] is non daemon.
2019-08-01T14:18:24,731 INFO [main] org.apache.druid.cli.CliPeon - Thread [Thread[pool-5-thread-1,5,main]] is non daemon.
2019-08-01T14:18:24,751 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [LAST]
2019-08-01T14:18:24,754 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [NORMAL]
2019-08-01T14:18:24,755 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer.stop()] on object[org.apache.druid.query.lookup.LookupResourceListenerAnnouncer@2890e479].
2019-08-01T14:18:24,755 INFO [main] org.apache.druid.curator.announcement.Announcer - unannouncing [/druid/listeners/lookups/__default/http:sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T14:18:24,777 INFO [main] org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer - Unannouncing start time on [/druid/listeners/lookups/__default/http:sbt-oaar-0813.delta.sbrf.ru:8102]
2019-08-01T14:18:24,777 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.query.lookup.LookupReferencesManager.stop()] on object[org.apache.druid.query.lookup.LookupReferencesManager@1e57b783].
2019-08-01T14:18:24,778 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopping.
2019-08-01T14:18:24,778 INFO [LookupReferencesManager-MainThread] org.apache.druid.query.lookup.LookupReferencesManager - Lookup Management loop exited, Lookup notices are not handled anymore.
2019-08-01T14:18:24,779 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is stopped.
2019-08-01T14:18:24,779 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Stopping Jetty Server...
2019-08-01T14:18:24,799 INFO [main] org.eclipse.jetty.server.AbstractConnector - Stopped ServerConnector@470c4229{HTTP/1.1,[http/1.1]}{0.0.0.0:8102}
2019-08-01T14:18:24,799 INFO [main] org.eclipse.jetty.server.session - node0 Stopped scavenging
2019-08-01T14:18:24,803 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Stopped o.e.j.s.ServletContextHandler@48f4f03e{/,null,UNAVAILABLE}
2019-08-01T14:18:24,830 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.indexing.worker.executor.ExecutorLifecycle.stop() throws java.lang.Exception] on object[org.apache.druid.indexing.worker.executor.ExecutorLifecycle@7a0f06ad].
2019-08-01T14:18:24,831 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner.stop()] on object[org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner@605eb072].
2019-08-01T14:18:24,831 INFO [main] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Starting graceful shutdown of task[index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii].
2019-08-01T14:18:24,831 INFO [main] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_3d32631a5f7f703_cfneliii] status changed to [FAILED].
2019-08-01T14:18:24,832 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.client.cache.CaffeineCache.close() throws java.io.IOException] on object[org.apache.druid.client.cache.CaffeineCache@3dc2f14].
2019-08-01T14:18:24,845 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.discovery.DruidLeaderClient.stop()] on object[org.apache.druid.discovery.DruidLeaderClient@3386ed8].
2019-08-01T14:18:24,845 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Stopped.
2019-08-01T14:18:24,846 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@6f240187].
2019-08-01T14:18:24,857 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.curator.announcement.Announcer.stop()] on object[org.apache.druid.curator.announcement.Announcer@61993d18].
2019-08-01T14:18:24,857 INFO [main] org.apache.druid.curator.announcement.Announcer - Stopping announcer
2019-08-01T14:18:24,858 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.discovery.DruidLeaderClient.stop()] on object[org.apache.druid.discovery.DruidLeaderClient@d8e4250].
2019-08-01T14:18:24,858 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Stopped.
2019-08-01T14:18:24,858 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.stop() throws java.io.IOException] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@6c830ebd].
2019-08-01T14:18:24,858 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider.stop()] on object[org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider@43d3995f].
2019-08-01T14:18:24,858 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - stopping
2019-08-01T14:18:24,859 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - stopped
2019-08-01T14:18:24,859 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [http-client] stage [LAST]
2019-08-01T14:18:24,859 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [http-client] stage [NORMAL]
2019-08-01T14:18:24,859 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.java.util.http.client.NettyHttpClient.stop()] on object[org.apache.druid.java.util.http.client.NettyHttpClient@1dca62c2].
2019-08-01T14:18:24,921 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [http-client] stage [INIT]
2019-08-01T14:18:24,921 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.storage.hdfs.HdfsStorageAuthentication.stop()] on object[org.apache.druid.storage.hdfs.HdfsStorageAuthentication@5cbe95b1].
2019-08-01T14:18:24,921 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.java.util.metrics.MonitorScheduler.stop()] on object[org.apache.druid.java.util.metrics.MonitorScheduler@4a122e68].
2019-08-01T14:18:24,926 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.java.util.emitter.service.ServiceEmitter.close() throws java.io.IOException] on object[ServiceEmitter{serviceDimensions={service=druid/middlemanager, host=sbt-oaar-0813.delta.sbrf.ru:8102, version=0.14.2-incubating}, emitter=org.apache.druid.emitter.kafka.KafkaEmitter@49433c98}].
2019-08-01T14:18:24,926 INFO [main] org.apache.kafka.clients.producer.KafkaProducer - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
2019-08-01T14:18:24,930 INFO [main] org.apache.druid.curator.CuratorModule - Stopping Curator
2019-08-01T14:18:24,932 INFO [Curator-Framework-0] org.apache.curator.framework.imps.CuratorFrameworkImpl - backgroundOperationsLoop exiting
2019-08-01T14:18:24,964 INFO [main] org.apache.zookeeper.ZooKeeper - Session: 0x56c4767ef6c2c96 closed
2019-08-01T14:18:24,965 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.emitter.kafka.KafkaEmitter.close()] on object[org.apache.druid.emitter.kafka.KafkaEmitter@49433c98].
2019-08-01T14:18:24,965 INFO [main-EventThread] org.apache.zookeeper.ClientCnxn - EventThread shut down for session: 0x56c4767ef6c2c96
2019-08-01T14:18:24,965 INFO [main] org.apache.kafka.clients.producer.KafkaProducer - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
2019-08-01T14:18:24,965 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Stopping lifecycle [module] stage [INIT]
2019-08-01T14:18:24,965 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking stop method[public void org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.stop()] on object[org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@3b65084e].
Finished peon task
2019-08-01 14:18:25,048 pool-4-thread-1 ERROR Unable to register shutdown hook because JVM is shutting down. java.lang.IllegalStateException: Not started
at org.apache.druid.common.config.Log4jShutdown.addShutdownCallback(Log4jShutdown.java:48)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.addShutdownCallback(Log4jContextFactory.java:273)
at org.apache.logging.log4j.core.LoggerContext.setUpShutdownHook(LoggerContext.java:256)
at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:216)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:145)
at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41)
at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103)
at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43)
at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42)
at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:265)
at org.apache.hadoop.hdfs.client.impl.LeaseRenewer.(LeaseRenewer.java:77)
at org.apache.hadoop.hdfs.DFSClient.getLeaseRenewer(DFSClient.java:480)
at org.apache.hadoop.hdfs.DFSClient.close(DFSClient.java:620)
at org.apache.hadoop.hdfs.DistributedFileSystem.close(DistributedFileSystem.java:1189)
at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2910)
at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2927)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
```
and there are a hour interval between messages
2019-08-01T13:18:32,175 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
2019-08-01T14:18:24,273 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
after that task got stopped ( 1 hour interval) and new task being scheduled, which is also stuck for another 1 hour :(
task 2
```
2019-08-01T14:20:34,343 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from common.runtime.properties
2019-08-01T14:20:34,346 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from runtime.properties
2019-08-01T14:20:34,416 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final
2019-08-01T14:20:35,403 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [org.apache.druid.common.config.NullValueHandlingConfig@56f0cc85]
2019-08-01T14:20:35,522 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions', useExtensionClassloaderFirst=false, hadoopDependenciesDir='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-histogram, druid-datasketches, druid-lookups-cached-global, postgresql-metadata-storage, druid-hdfs-storage, druid-kafka-indexing-service, kafka-emitter]}]
2019-08-01T14:20:35,529 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,558 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-histogram/druid-histogram-0.14.2-incubating.jar] for extension[druid-histogram]
2019-08-01T14:20:35,562 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,562 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/memory-0.12.2.jar] for extension[druid-datasketches]
2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/slf4j-api-1.6.4.jar] for extension[druid-datasketches]
2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/commons-math3-3.6.1.jar] for extension[druid-datasketches]
2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/sketches-core-0.13.3.jar] for extension[druid-datasketches]
2019-08-01T14:20:35,564 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/druid-datasketches-0.14.2-incubating.jar] for extension[druid-datasketches]
2019-08-01T14:20:35,575 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,575 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.14.2-incubating.jar] for extension[druid-lookups-cached-global]
2019-08-01T14:20:35,576 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,581 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar] for extension[postgresql-metadata-storage]
2019-08-01T14:20:35,582 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.14.2-incubating.jar] for extension[postgresql-metadata-storage]
2019-08-01T14:20:35,606 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-configuration-1.6.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-compress-1.16.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-framework-4.1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/objenesis-2.6.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/druid-hdfs-storage-0.14.2-incubating.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/xmlenc-0.52.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jersey-client-1.9.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-api-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/servlet-api-2.5.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-auth-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-net-3.1.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-hdfs-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okio-1.4.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-digester-1.8.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-recipes-4.1.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jsp-api-2.1.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-client-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okhttp-2.4.0.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,613 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,613 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/stax-api-1.0-2.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/json-smart-1.1.1.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-common-2.8.3.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/gson-2.2.4.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/htrace-core4-4.0.1-incubating.jar] for extension[druid-hdfs-storage]
2019-08-01T14:20:35,799 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.14.2-incubating.jar] for extension[druid-kafka-indexing-service]
2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.2.jar] for extension[druid-kafka-indexing-service]
2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar] for extension[druid-kafka-indexing-service]
2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.cli.CliCommandCreator]
2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/slf4j-api-1.6.4.jar] for extension[kafka-emitter]
2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-clients-0.10.2.0.jar] for extension[kafka-emitter]
2019-08-01T14:20:35,826 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/lz4-1.3.0.jar] for extension[kafka-emitter]
2019-08-01T14:20:35,826 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-emitter-0.14.0-incubating.jar] for extension[kafka-emitter]
2019-08-01T14:20:35,830 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/snappy-java-1.1.2.6.jar] for extension[kafka-emitter]
2019-08-01T14:20:36,145 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}]
2019-08-01T14:20:37,011 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,057 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,057 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,060 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,061 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,065 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.quantiles.DoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,086 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.tuple.ArrayOfDoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,093 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.hll.HllSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,093 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,117 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.server.lookup.namespace.NamespaceExtractionModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,117 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,119 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,119 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,125 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,125 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,127 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:37,127 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.initialization.DruidModule]
2019-08-01T14:20:37,129 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.emitter.kafka.KafkaEmitterModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension
2019-08-01T14:20:43,543 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-08-01T14:20:45,539 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.emitter.kafka.KafkaEmitterConfig] from props[druid.emitter.kafka.] as [KafkaEmitterConfig{bootstrap.servers='sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093', metric.topic='druid-metrics', alert.topic='druid-logs', request.topic='druid-requests', Producer.config={max.block.ms=10000, security.protocol=SSL, ssl.truststore.password=qwe123, ssl.truststore.location=/opt/cloudera/security/pki/server.truststore.jks}}]
2019-08-01T14:20:45,611 INFO [main] org.apache.kafka.clients.producer.ProducerConfig - ProducerConfig values:
acks = 1
batch.size = 16384
block.on.buffer.full = false
bootstrap.servers = [sbt-oaar-0811.delta.sbrf.ru:9093, sbt-oaar-0812.delta.sbrf.ru:9093, , sbt-oaar-0813.delta.sbrf.ru:9093, sbt-oaar-0814.delta.sbrf.ru:9093, sbt-oaar-0815.delta.sbrf.ru:9093]
buffer.memory = 33554432
client.id =
compression.type = none
connections.max.idle.ms = 540000
interceptor.classes = null
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 10000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.fetch.timeout.ms = 60000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.ms = 100
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = SSL
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks
ssl.truststore.password = [hidden]
ssl.truststore.type = JKS
timeout.ms = 30000
value.serializer = class org.apache.kafka.common.serialization.StringSerializer
2019-08-01T14:20:45,811 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.0
2019-08-01T14:20:45,811 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : 576d93a8dc0cf421
2019-08-01T14:20:45,865 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.security.Escalator] from props[druid.escalator.] as [NoopEscalator{}]
2019-08-01T14:20:45,913 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.CuratorConfig] from props[druid.zk.service.] as [org.apache.druid.curator.CuratorConfig@37348491]
2019-08-01T14:20:45,925 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [org.apache.druid.curator.ExhibitorConfig@10b687f2]
2019-08-01T14:20:46,176 INFO [main] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode
2019-08-01T14:20:46,183 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29
2019-08-01T14:20:46,282 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.metric.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T14:20:46,283 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.alert.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T14:20:46,283 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.bootstrap.servers property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T14:20:46,284 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.request.topic property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T14:20:46,284 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.producer.config property: one of it's prefixes is also used as a property key. Prefix: druid
2019-08-01T14:20:46,295 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8100, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}]
2019-08-01T14:20:46,315 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [org.apache.druid.server.initialization.ZkPathsConfig@22e2266d]
2019-08-01T14:20:46,324 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}]
2019-08-01T14:20:46,576 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [org.apache.druid.server.metrics.DruidMonitorSchedulerConfig@ee8e7ff]
2019-08-01T14:20:46,579 WARN [main] org.apache.druid.server.metrics.MonitorsConfig - Deprecated Monitor class name[io.druid.java.util.metrics.JvmMonitor] found, please use name[org.apache.druid.java.util.metrics.JvmMonitor] instead.
2019-08-01T14:20:46,589 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class org.apache.druid.java.util.metrics.JvmMonitor]}]
2019-08-01T14:20:46,590 INFO [main] org.apache.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: org.apache.druid.emitter.kafka.KafkaEmitter@49433c98
2019-08-01T14:20:46,590 INFO [main] org.apache.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.14.2-incubating}
2019-08-01T14:20:47,100 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [org.apache.druid.server.initialization.CuratorDiscoveryConfig@415d88de]
2019-08-01T14:20:47,144 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, queueSize=2147483647, enableRequestLimit=false, maxIdleTime=PT5M, defaultQueryTimeout=10000, maxScatterGatherBytes=9223372036854775807, maxQueryTimeout=9223372036854775807, maxRequestHeaderSize=8192, gracefulShutdownTimeout=PT0S, unannouncePropagationDelay=PT0S, inflateBufferSize=4096, compressionLevel=-1}]
2019-08-01T14:20:48,140 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.java.util.metrics.JvmMonitor@3b4ef59f]
2019-08-01T14:20:48,143 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.query.ExecutorServiceMonitor@5a7b309b]
2019-08-01T14:20:48,143 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@353c6da1]
2019-08-01T14:20:48,155 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [org.apache.druid.server.log.StartupLoggingConfig@75e80a97]
2019-08-01T14:20:48,160 INFO [main] org.apache.druid.cli.CliPeon - Starting up with processors[16], memory[2,111,832,064], maxMemory[3,221,225,472], directMemory[3,221,225,472].
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.enabled: true
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.evictOnClose: true
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.sizeInBytes: 536870912
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.type: caffeine
2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter: kafka
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.alert.topic: druid-logs
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.bootstrap.servers: sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.metric.topic: druid-metrics
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.producer.config: {"max.block.ms":10000, "security.protocol":"SSL","ssl.truststore.password":"qwe123","ssl.truststore.location":"/opt/cloudera/security/pki/server.truststore.jks" }
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.request.topic: druid-requests
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.directory: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions
2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies
2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-histogram","druid-datasketches","druid-lookups-cached-global","postgresql-metadata-storage", "druid-hdfs-storage", "druid-kafka-indexing-service","kafka-emitter"]
2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.host: sbt-oaar-0813.delta.sbrf.ru
2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.directory: /user/druid/logs
2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.durationToRetain: 86400000
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.enabled: true
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.runner.javaOptsArray: ["-server", "-Xmx3g","-XX:+ExitOnOutOfMemoryError", "-Duser.timezone=UTC", "-Dfile.encoding=UTF-8", "-XX:+UseG1GC", "-XX:MaxGCPauseMillis=200","-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager" ,"-Dlog4j.configurationFile=scripts/log4j2.xml"]
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.baseDir: /hdfs/druid_temp_segments/
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"]
2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: false
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.javascript.enabled: false
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:postgresql://sbt-oaar-0810.delta.sbrf.ru:5432/druid_db
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.password:
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.user: druid
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.type: postgresql
2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.dataSource: pprb_eventlog
2019-08-01T14:20:48,182 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskId: index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.metrics.emitter.dimension.taskType: index_kafka
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.monitoring.emissionPeriod: PT1m
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.monitoring.monitors: ["io.druid.java.util.metrics.JvmMonitor"]
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.plaintextPort: 8100
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.port: 18091
2019-08-01T14:20:48,183 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.buffer.sizeBytes: 134217728
2019-08-01T14:20:48,184 INFO [main] org.apache.druid.cli.CliPeon - * druid.processing.numThreads: 16
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.feed: druid_requests
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.requestLogEventBuilderFactory: {}
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.request.logging.type: emitter
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.coordinator.serviceName: druid/coordinator
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.selectors.indexing.serviceName: druid/overlord
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.http.defaultQueryTimeout: 10000
2019-08-01T14:20:48,188 INFO [main] org.apache.druid.cli.CliPeon - * druid.server.http.numThreads: 40
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.service: druid/middlemanager
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.sql.enable: true
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.startup.logging.logProperties: true
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.storageDirectory: /user/druid/segments
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.storage.type: hdfs
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.tlsPort: -1
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.worker.capacity: 4
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.paths.base: /druid
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * druid.zk.service.host: sbt-oaar-0815.delta.sbrf.ru:2181
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * file.encoding: UTF-8
2019-08-01T14:20:48,189 INFO [main] org.apache.druid.cli.CliPeon - * file.encoding.pkg: sun.io
2019-08-01T14:20:48,190 INFO [main] org.apache.druid.cli.CliPeon - * file.separator: /
2019-08-01T14:20:48,190 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.graphicsenv: sun.awt.X11GraphicsEnvironment
2019-08-01T14:20:48,190 INFO [main] org.apache.druid.cli.CliPeon - * java.awt.printerjob: sun.print.PSPrinterJob
2019-08-01T14:20:48,190 INFO [main] org.apache.druid.cli.CliPeon - * java.class.path: /var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/yarn-conf:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/_common:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/middleManager:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-aether-provider-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/ion-java-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/janino-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-unix-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-servlet-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/metrics-core-4.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jmespath-java-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-module-jaxb-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-core-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections4-4.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/tesla-aether-0.0.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-smile-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-core-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/hibernate-validator-5.1.3.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/disruptor-3.3.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/antlr4-runtime-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlet-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compress-1.16.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jvm-attach-api-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-guice-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-framework-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-1.2-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/slf4j-api-1.6.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-server-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/okhttp-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/shims-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-hll-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-smile-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/esri-geometry-api-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-okhttp-0.0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aggdesigner-algorithm-6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcl-over-slf4j-1.7.12.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-server-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/opencsv-4.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/validation-api-1.1.0.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/objenesis-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-codec-1.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-io-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-file-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-io-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-guava-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jq-0.0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/airline-0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-databind-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-security-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool-1.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-continuation-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpcore-4.4.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-api-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-servlet-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jline-0.9.94.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-util-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-service-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-http-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/reactive-streams-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guava-16.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-interpolation-1.19.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/icu4j-54.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zstd-jni-1.3.3-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-core-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-epoll-4.1.29.Final-linux-x86_64.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-jul-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-sql-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-path-2.3.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joda-time-2.9.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/extendedset-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/error_prone_annotations-2.3.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/RoaringBitmap-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbyclient-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool2-2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-kms-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-text-1.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/caffeine-2.5.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jdbi-2.63.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/sigar-1.6.5.132.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/fastutil-8.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-processing-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-server-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-core-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.activation-1.2.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-core-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-services-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/compress-lzf-1.0.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-recipes-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/wagon-provider-api-2.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-multibindings-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-math3-3.6.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-http-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/config-magic-0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zookeeper-3.4.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jboss-logging-3.1.3.GA.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr305-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derby-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-s3-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.inject-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-mapper-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-metrics-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlets-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-netty-utils-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-server-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-aws-common-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-x-discovery-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-joda-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-linq4j-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-base-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-hadoop-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbynet-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/lz4-java-1.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-reactive-streams-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-socks-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-core-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-proxy-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-tree-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-proxy-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/mapdb-1.0.8.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joni-2.1.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-commons-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-util-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-ec2-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-client-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/rhino-1.7R5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-slf4j-impl-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-api-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/classmate-1.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-smart-2.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/spymemcached-2.12.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-repository-metadata-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-client-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-impl-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-cbor-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-dbcp2-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-utils-3.0.15.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-all-4.1.30.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jna-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-json-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-artifact-3.6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcodings-1.0.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-buffer-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-spi-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/checker-qual-2.5.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-console-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/protobuf-java-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/xz-1.8.jar
2019-08-01T14:20:48,190 INFO [main] org.apache.druid.cli.CliPeon - * java.class.version: 52.0
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.endorsed.dirs: /usr/java/jdk1.8.0_161/jre/lib/endorsed
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.ext.dirs: /usr/java/jdk1.8.0_161/jre/lib/ext:/usr/java/packages/lib/ext
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.home: /usr/java/jdk1.8.0_161/jre
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.io.tmpdir: /var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/tmp
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.name: Java(TM) SE Runtime Environment
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.runtime.version: 1.8.0_161-b12
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.name: Java Platform API Specification
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.vendor: Oracle Corporation
2019-08-01T14:20:48,191 INFO [main] org.apache.druid.cli.CliPeon - * java.specification.version: 1.8
2019-08-01T14:20:48,192 INFO [main] org.apache.druid.cli.CliPeon - * java.util.logging.manager: org.apache.logging.log4j.jul.LogManager
2019-08-01T14:20:48,192 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor: Oracle Corporation
2019-08-01T14:20:48,192 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url: http://java.oracle.com/
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.vendor.url.bug: http://bugreport.sun.com/bugreport/
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.version: 1.8.0_161
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.info: mixed mode
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.name: Java HotSpot(TM) 64-Bit Server VM
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.name: Java Virtual Machine Specification
2019-08-01T14:20:48,197 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.vendor: Oracle Corporation
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.specification.version: 1.8
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.vendor: Oracle Corporation
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * java.vm.version: 25.161-b12
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * line.separator:
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * log4j.configurationFile: scripts/log4j2.xml
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownCallbackRegistry: org.apache.druid.common.config.Log4jShutdown
2019-08-01T14:20:48,198 INFO [main] org.apache.druid.cli.CliPeon - * log4j.shutdownHookEnabled: true
2019-08-01T14:20:48,201 INFO [main] org.apache.druid.cli.CliPeon - * os.arch: amd64
2019-08-01T14:20:48,201 INFO [main] org.apache.druid.cli.CliPeon - * os.name: Linux
2019-08-01T14:20:48,201 INFO [main] org.apache.druid.cli.CliPeon - * os.version: 3.10.0-957.21.3.el7.x86_64
2019-08-01T14:20:48,201 INFO [main] org.apache.druid.cli.CliPeon - * path.separator: :
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.arch.data.model: 64
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.boot.class.path: /usr/java/jdk1.8.0_161/jre/lib/resources.jar:/usr/java/jdk1.8.0_161/jre/lib/rt.jar:/usr/java/jdk1.8.0_161/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_161/jre/lib/jsse.jar:/usr/java/jdk1.8.0_161/jre/lib/jce.jar:/usr/java/jdk1.8.0_161/jre/lib/charsets.jar:/usr/java/jdk1.8.0_161/jre/lib/jfr.jar:/usr/java/jdk1.8.0_161/jre/classes
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.boot.library.path: /usr/java/jdk1.8.0_161/jre/lib/amd64
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.endian: little
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.cpu.isalist:
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.io.unicode.encoding: UnicodeLittle
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.command: org.apache.druid.cli.Main internal peon /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/task.json /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/c3530220-ac6b-4f9e-9955-ee73a5bf365f/status.json /hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/c3530220-ac6b-4f9e-9955-ee73a5bf365f/report.json
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.java.launcher: SUN_STANDARD
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.jnu.encoding: UTF-8
2019-08-01T14:20:48,202 INFO [main] org.apache.druid.cli.CliPeon - * sun.management.compiler: HotSpot 64-Bit Tiered Compilers
2019-08-01T14:20:48,207 INFO [main] org.apache.druid.cli.CliPeon - * sun.os.patch.level: unknown
2019-08-01T14:20:48,207 INFO [main] org.apache.druid.cli.CliPeon - * user.country: US
2019-08-01T14:20:48,207 INFO [main] org.apache.druid.cli.CliPeon - * user.dir: /run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER
2019-08-01T14:20:48,207 INFO [main] org.apache.druid.cli.CliPeon - * user.home: /opt/druid
2019-08-01T14:20:48,210 INFO [main] org.apache.druid.cli.CliPeon - * user.language: en
2019-08-01T14:20:48,210 INFO [main] org.apache.druid.cli.CliPeon - * user.name: druid
2019-08-01T14:20:48,210 INFO [main] org.apache.druid.cli.CliPeon - * user.timezone: UTC
2019-08-01T14:20:48,229 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.storage.hdfs.HdfsKerberosConfig] from props[druid.hadoop.security.kerberos.] as [org.apache.druid.storage.hdfs.HdfsKerberosConfig@0]
2019-08-01T14:20:48,257 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.indexing.common.config.TaskConfig] from props[druid.indexer.task.] as [org.apache.druid.indexing.common.config.TaskConfig@3a0b6a]
2019-08-01T14:20:48,284 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.http.DruidHttpClientConfig] from props[druid.global.http.] as [org.apache.druid.guice.http.DruidHttpClientConfig@29bbc63c]
2019-08-01T14:20:48,491 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.indexing.IndexingServiceSelectorConfig] from props[druid.selectors.indexing.] as [org.apache.druid.client.indexing.IndexingServiceSelectorConfig@73a845cb]
2019-08-01T14:20:48,594 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.indexing.common.RetryPolicyConfig] from props[druid.peon.taskActionClient.retry.] as [org.apache.druid.indexing.common.RetryPolicyConfig@684ce74c]
2019-08-01T14:20:48,600 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.storage.hdfs.HdfsDataSegmentPusherConfig] from props[druid.storage.] as [org.apache.druid.storage.hdfs.HdfsDataSegmentPusherConfig@4dd2ef54]
2019-08-01T14:20:48,607 INFO [main] org.apache.druid.storage.hdfs.HdfsDataSegmentPusher - Configured HDFS as deep storage
2019-08-01T14:20:48,611 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.segment.loading.LocalDataSegmentPusherConfig] from props[druid.storage.] as [org.apache.druid.segment.loading.LocalDataSegmentPusherConfig@1860a7a1]
2019-08-01T14:20:48,632 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.DruidServerConfig] from props[druid.server.] as [org.apache.druid.client.DruidServerConfig@448ade1]
2019-08-01T14:20:48,646 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.BatchDataSegmentAnnouncerConfig] from props[druid.announcer.] as [org.apache.druid.server.initialization.BatchDataSegmentAnnouncerConfig@4975dda1]
2019-08-01T14:20:48,662 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.coordination.DataSegmentAnnouncerProvider] from props[druid.announcer.] as [org.apache.druid.server.coordination.BatchDataSegmentAnnouncerProvider@10618775]
2019-08-01T14:20:48,669 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.coordinator.CoordinatorSelectorConfig] from props[druid.selectors.coordinator.] as [org.apache.druid.client.coordinator.CoordinatorSelectorConfig@59328218]
2019-08-01T14:20:48,675 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig] from props[druid.segment.handoff.] as [org.apache.druid.segment.realtime.plumber.CoordinatorBasedSegmentHandoffNotifierConfig@dada335]
2019-08-01T14:20:48,683 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [134217728] for [druid.processing.buffer.sizeBytes] on [org.apache.druid.query.DruidProcessingConfig#intermediateComputeSizeBytesConfigured()]
2019-08-01T14:20:48,690 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning value [16] for [druid.processing.numThreads] on [org.apache.druid.query.DruidProcessingConfig#getNumThreadsConfigured()]
2019-08-01T14:20:48,691 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.numMergeBuffers] on [org.apache.druid.query.DruidProcessingConfig#getNumMergeBuffersConfigured()]
2019-08-01T14:20:48,693 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.columnCache.sizeBytes] on [org.apache.druid.query.DruidProcessingConfig#columnCacheSizeBytes()]
2019-08-01T14:20:48,693 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.fifo] on [org.apache.druid.query.DruidProcessingConfig#isFifo()]
2019-08-01T14:20:48,693 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [${base_path}.tmpDir] on [org.apache.druid.query.DruidProcessingConfig#getTmpDir()]
2019-08-01T14:20:48,698 INFO [main] org.skife.config.ConfigurationObjectFactory - Using method itself for [druid.computation.buffer.poolCacheMaxCount, ${base_path}.buffer.poolCacheMaxCount] on [org.apache.druid.query.DruidProcessingConfig#poolCacheMaxCount()]
2019-08-01T14:20:48,698 INFO [main] org.skife.config.ConfigurationObjectFactory - Assigning default value [processing-%s] for [${base_path}.formatString] on [org.apache.druid.java.util.common.concurrent.ExecutorServiceConfig#getFormatString()]
2019-08-01T14:20:48,919 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.client.cache.CacheProvider] from props[druid.cache.] as [org.apache.druid.client.cache.CaffeineCacheProvider@7cc2c551]
2019-08-01T14:20:49,565 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.client.cache.CacheConfig] from props[druid.realtime.cache.] as [org.apache.druid.client.cache.CacheConfig@153cfd86]
2019-08-01T14:20:49,572 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.segment.writeout.SegmentWriteOutMediumFactory] from props[druid.peon.defaultSegmentWriteOutMediumFactory.] as [org.apache.druid.segment.writeout.TmpFileSegmentWriteOutMediumFactory@259195fe]
2019-08-01T14:20:49,587 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.lookup.LookupListeningAnnouncerConfig] from props[druid.lookup.] as [ListeningAnnouncerConfig{listenersPath='/druid/listeners'}]
2019-08-01T14:20:49,599 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.TLSServerConfig] from props[druid.server.https.] as [TLSServerConfig{keyStorePath='null', keyStoreType='null', certAlias='null', keyManagerFactoryAlgorithm='null', includeCipherSuites=null, excludeCipherSuites=null, includeProtocols=null, excludeProtocols=null, requireClientCertificate=false, trustStoreType='null', trustStorePath='null', trustStoreAlgorithm='null', validateHostnames='true', crlPath='null'}]
2019-08-01T14:20:49,629 INFO [main] org.eclipse.jetty.util.log - Logging initialized @17443ms to org.eclipse.jetty.util.log.Slf4jLog
2019-08-01T14:20:49,659 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Creating http connector with port [8100]
2019-08-01T14:20:50,023 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.search.SearchQueryConfig] from props[druid.query.search.] as [org.apache.druid.query.search.SearchQueryConfig@4f402027]
2019-08-01T14:20:50,028 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.metadata.SegmentMetadataQueryConfig] from props[druid.query.segmentMetadata.] as [org.apache.druid.query.metadata.SegmentMetadataQueryConfig@145a821d]
2019-08-01T14:20:50,037 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.groupby.GroupByQueryConfig] from props[druid.query.groupBy.] as [GroupByQueryConfig{defaultStrategy='v2', singleThreaded=false, maxIntermediateRows=50000, maxResults=500000, bufferGrouperMaxSize=2147483647, bufferGrouperMaxLoadFactor=0.0, bufferGrouperInitialBuckets=0, maxMergingDictionarySize=100000000, maxOnDiskStorage=0, forcePushDownLimit=false, forceHashAggregation=false, intermediateCombineDegree=8, numParallelCombineThreads=1, forcePushDownNestedQuery=false}]
2019-08-01T14:20:50,092 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[0] of size[134,217,728]
2019-08-01T14:20:50,586 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[1] of size[134,217,728]
2019-08-01T14:20:50,945 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[2] of size[134,217,728]
2019-08-01T14:20:51,252 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[3] of size[134,217,728]
2019-08-01T14:20:51,491 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[4] of size[134,217,728]
2019-08-01T14:20:51,906 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[5] of size[134,217,728]
2019-08-01T14:20:52,473 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[6] of size[134,217,728]
2019-08-01T14:20:52,714 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[7] of size[134,217,728]
2019-08-01T14:20:52,959 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[8] of size[134,217,728]
2019-08-01T14:20:53,267 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[9] of size[134,217,728]
2019-08-01T14:20:53,663 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[10] of size[134,217,728]
2019-08-01T14:20:54,070 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[11] of size[134,217,728]
2019-08-01T14:20:54,447 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[12] of size[134,217,728]
2019-08-01T14:20:54,923 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[13] of size[134,217,728]
2019-08-01T14:20:55,362 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[14] of size[134,217,728]
2019-08-01T14:20:55,776 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new intermediate processing buffer[15] of size[134,217,728]
2019-08-01T14:20:56,065 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[0] of size[134,217,728]
2019-08-01T14:20:56,324 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[1] of size[134,217,728]
2019-08-01T14:20:56,670 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[2] of size[134,217,728]
2019-08-01T14:20:56,995 INFO [main] org.apache.druid.offheap.OffheapBufferGenerator - Allocating new result merging buffer[3] of size[134,217,728]
2019-08-01T14:20:57,300 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.scan.ScanQueryConfig] from props[druid.query.scan.] as [ScanQueryConfig{legacy=false}]
2019-08-01T14:20:57,304 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.select.SelectQueryConfig] from props[druid.query.select.] as [org.apache.druid.query.select.SelectQueryConfig@25fa6889]
2019-08-01T14:20:57,311 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.topn.TopNQueryConfig] from props[druid.query.topN.] as [org.apache.druid.query.topn.TopNQueryConfig@7e31d53b]
2019-08-01T14:20:57,336 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.log.RequestLoggerProvider] from props[druid.request.logging.] as [org.apache.druid.server.log.EmittingRequestLoggerProvider@15f861ee]
2019-08-01T14:20:57,360 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.query.lookup.LookupConfig] from props[druid.lookup.] as [LookupConfig{snapshotWorkingDir='', enableLookupSyncOnStartup=true, numLookupLoadingThreads=8, coordinatorFetchRetries=3, lookupStartRetries=3, coordinatorRetryDelay=60000}]
2019-08-01T14:20:57,362 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [INIT]
2019-08-01T14:20:57,363 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner.start()] on object[org.apache.druid.initialization.Log4jShutterDownerModule$Log4jShutterDowner@3b65084e].
2019-08-01T14:20:57,363 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [NORMAL]
2019-08-01T14:20:57,364 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.emitter.kafka.KafkaEmitter.start()] on object[org.apache.druid.emitter.kafka.KafkaEmitter@49433c98].
2019-08-01T14:20:57,364 INFO [main] org.apache.druid.emitter.kafka.KafkaEmitter - Starting Kafka Emitter.
2019-08-01T14:20:57,377 INFO [main] org.apache.druid.curator.CuratorModule - Starting Curator
2019-08-01T14:20:57,380 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Starting
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:zookeeper.version=3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built on 11/01/2017 18:06 GMT
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:host.name=sbt-oaar-0813.delta.sbrf.ru
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.version=1.8.0_161
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.home=/usr/java/jdk1.8.0_161/jre
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.class.path=/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/yarn-conf:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/_common:/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/conf/middleManager:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-aether-provider-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/ion-java-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/janino-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-unix-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-servlet-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/metrics-core-4.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jmespath-java-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-module-jaxb-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-core-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections4-4.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/tesla-aether-0.0.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-smile-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-core-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/hibernate-validator-5.1.3.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/disruptor-3.3.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/antlr4-runtime-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlet-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compress-1.16.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jvm-attach-api-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-guice-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-framework-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-1.2-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-beanutils-1.9.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/slf4j-api-1.6.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-server-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/okhttp-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-logging-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/shims-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-hll-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-smile-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/esri-geometry-api-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-okhttp-0.0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aggdesigner-algorithm-6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcl-over-slf4j-1.7.12.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jersey-server-1.19.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/opencsv-4.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/validation-api-1.1.0.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/objenesis-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-codec-1.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-io-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-connector-file-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-io-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-guava-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jq-0.0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/airline-0.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-databind-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-security-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool-1.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-continuation-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpcore-4.4.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-api-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-servlet-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jline-0.9.94.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-compiler-2.7.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-util-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-service-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-http-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/accessors-smart-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/reactive-streams-1.0.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guava-16.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-interpolation-1.19.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/icu4j-54.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zstd-jni-1.3.3-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-core-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-native-epoll-4.1.29.Final-linux-x86_64.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-jul-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-sql-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-path-2.3.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joda-time-2.9.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/extendedset-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/error_prone_annotations-2.3.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/RoaringBitmap-0.7.36.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbyclient-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-pool2-2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-kms-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-text-1.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-api-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/caffeine-2.5.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jdbi-2.63.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/sigar-1.6.5.132.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/fastutil-8.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-processing-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-server-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-core-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.activation-1.2.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-3.10.6.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-core-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-services-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/compress-lzf-1.0.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-recipes-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/wagon-provider-api-2.4.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-multibindings-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-math3-3.6.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-http-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-core-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/config-magic-0.9.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/zookeeper-3.4.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jboss-logging-3.1.3.GA.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr305-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derby-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-s3-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.inject-1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-mapper-asl-1.9.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/avatica-metrics-1.10.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-servlets-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/async-http-client-netty-utils-2.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-builder-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-common-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-server-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jsr311-api-1.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-aws-common-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/audience-annotations-0.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-dns-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-x-discovery-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-datatype-joda-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-transport-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/calcite-linq4j-1.17.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-base-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-indexing-hadoop-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-collections-3.2.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/derbynet-10.11.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/lz4-java-1.5.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-reactive-streams-2.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-codec-socks-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-core-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-proxy-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-tree-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-handler-proxy-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/mapdb-1.0.8.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-settings-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/joni-2.1.11.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/asm-commons-5.2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-util-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aws-java-sdk-ec2-1.11.199.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jetty-client-9.4.10.v20180503.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/rhino-1.7R5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/log4j-slf4j-impl-2.5.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.el-api-3.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-annotations-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/guice-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/classmate-1.0.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/json-smart-2.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-model-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/spymemcached-2.12.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-repository-metadata-3.1.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/curator-client-4.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-impl-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-dataformat-cbor-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-dbcp2-2.0.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/plexus-utils-3.0.15.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-resolver-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-all-4.1.30.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/httpclient-4.5.3.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/javax.servlet-api-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jna-4.5.1.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/commons-lang3-3.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jackson-jaxrs-json-provider-2.6.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/maven-artifact-3.6.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/jcodings-1.0.13.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/netty-buffer-4.1.29.Final.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/aether-spi-0.9.0.M2.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/checker-qual-2.5.7.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/druid-console-0.14.2-incubating.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/protobuf-java-3.1.0.jar:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/lib/xz-1.8.jar
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.io.tmpdir=/var/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER/tmp
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:java.compiler=
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.name=Linux
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.arch=amd64
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:os.version=3.10.0-957.21.3.el7.x86_64
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.name=druid
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.home=/opt/druid
2019-08-01T14:20:57,413 INFO [main] org.apache.zookeeper.ZooKeeper - Client environment:user.dir=/run/cloudera-scm-agent/process/18146-druid-DRUID_MIDDLE_MANAGER
2019-08-01T14:20:57,414 INFO [main] org.apache.zookeeper.ZooKeeper - Initiating client connection, connectString=sbt-oaar-0815.delta.sbrf.ru:2181 sessionTimeout=30000 watcher=org.apache.curator.ConnectionState@621dc63d
2019-08-01T14:20:57,455 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Opening socket connection to server sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181. Will not attempt to authenticate using SASL (unknown error)
2019-08-01T14:20:57,459 INFO [main] org.apache.curator.framework.imps.CuratorFrameworkImpl - Default schema
2019-08-01T14:20:57,460 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.emitter.service.ServiceEmitter.start()] on object[ServiceEmitter{serviceDimensions={service=druid/middlemanager, host=sbt-oaar-0813.delta.sbrf.ru:8100, version=0.14.2-incubating}, emitter=org.apache.druid.emitter.kafka.KafkaEmitter@49433c98}].
2019-08-01T14:20:57,460 INFO [main] org.apache.druid.emitter.kafka.KafkaEmitter - Starting Kafka Emitter.
2019-08-01T14:20:57,464 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.metrics.MonitorScheduler.start()] on object[org.apache.druid.java.util.metrics.MonitorScheduler@4a122e68].
2019-08-01T14:20:57,467 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.storage.hdfs.HdfsStorageAuthentication.authenticate()] on object[org.apache.druid.storage.hdfs.HdfsStorageAuthentication@5cbe95b1].
2019-08-01T14:20:57,467 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [INIT]
2019-08-01T14:20:57,473 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [NORMAL]
2019-08-01T14:20:57,477 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Socket connection established to sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181, initiating session
2019-08-01T14:20:57,478 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.java.util.http.client.NettyHttpClient.start()] on object[org.apache.druid.java.util.http.client.NettyHttpClient@1dca62c2].
2019-08-01T14:20:57,478 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [http-client] stage [LAST]
2019-08-01T14:20:57,478 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [http-client]
2019-08-01T14:20:57,478 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider.start()] on object[org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider@43d3995f].
2019-08-01T14:20:57,479 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - starting
2019-08-01T14:20:57,479 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - started
2019-08-01T14:20:57,479 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@6c830ebd].
2019-08-01T14:20:57,489 INFO [main-SendThread(sbt-oaar-0815.delta.sbrf.ru:2181)] org.apache.zookeeper.ClientCnxn - Session establishment complete on server sbt-oaar-0815.delta.sbrf.ru/10.44.51.6:2181, sessionid = 0x56c4767ef6c2e84, negotiated timeout = 30000
2019-08-01T14:20:57,497 INFO [main-EventThread] org.apache.curator.framework.state.ConnectionStateManager - State change: CONNECTED
2019-08-01T14:20:57,765 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.discovery.DruidLeaderClient.start()] on object[org.apache.druid.discovery.DruidLeaderClient@71fb8301].
2019-08-01T14:20:57,766 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [OVERLORD].
2019-08-01T14:20:57,770 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [OVERLORD].
2019-08-01T14:20:57,770 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Started.
2019-08-01T14:20:57,770 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.announcement.Announcer.start()] on object[org.apache.druid.curator.announcement.Announcer@1224e1b6].
2019-08-01T14:20:57,770 INFO [main] org.apache.druid.curator.announcement.Announcer - Starting announcer
2019-08-01T14:20:57,770 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.curator.discovery.ServerDiscoverySelector.start() throws java.lang.Exception] on object[org.apache.druid.curator.discovery.ServerDiscoverySelector@72a3462f].
2019-08-01T14:20:57,813 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.discovery.DruidLeaderClient.start()] on object[org.apache.druid.discovery.DruidLeaderClient@22aefae0].
2019-08-01T14:20:57,814 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Creating NodeTypeWatcher for nodeType [COORDINATOR].
2019-08-01T14:20:57,815 INFO [main] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider - Created NodeTypeWatcher for nodeType [COORDINATOR].
2019-08-01T14:20:57,815 INFO [main] org.apache.druid.discovery.DruidLeaderClient - Started.
2019-08-01T14:20:57,818 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner.start()] on object[org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner@6c70b7c3].
2019-08-01T14:20:57,818 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.indexing.worker.executor.ExecutorLifecycle.start() throws java.lang.InterruptedException] on object[org.apache.druid.indexing.worker.executor.ExecutorLifecycle@16a09809].
2019-08-01T14:20:57,876 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0809.delta.sbrf.ru:18090:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/overlord', host='sbt-oaar-0809.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18090, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='OVERLORD', services={}}] appeared.
2019-08-01T14:20:57,878 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0810.delta.sbrf.ru:18090:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/overlord', host='sbt-oaar-0810.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18090, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='OVERLORD', services={}}] appeared.
2019-08-01T14:20:57,878 INFO [NodeTypeWatcher[OVERLORD]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher.
2019-08-01T14:20:57,878 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0809.delta.sbrf.ru:18081:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='sbt-oaar-0809.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18081, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='COORDINATOR', services={}}] appeared.
2019-08-01T14:20:57,883 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Node[sbt-oaar-0810.delta.sbrf.ru:18081:DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/coordinator', host='sbt-oaar-0810.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=18081, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='COORDINATOR', services={}}] appeared.
2019-08-01T14:20:57,883 INFO [NodeTypeWatcher[COORDINATOR]] org.apache.druid.curator.discovery.CuratorDruidNodeDiscoveryProvider$NodeTypeWatcher - Received INITIALIZED in node watcher.
2019-08-01T14:20:57,937 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Running with task: {
"type" : "index_kafka",
"id" : "index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo",
"resource" : {
"availabilityGroup" : "index_kafka_pprb_eventlog_c9e524a2db3c73b",
"requiredCapacity" : 1
},
"dataSchema" : {
"dataSource" : "pprb_eventlog",
"parser" : {
"type" : "string",
"parseSpec" : {
"format" : "json",
"timestampSpec" : {
"column" : "timestamp",
"format" : "auto"
},
"dimensionsSpec" : {
"dimensions" : [ "moduleId", "nodeId", "standId", "levelStr", "hostName", "callerClass", "callerMethod" ],
"dimensionExclusions" : [ ]
}
}
},
"metricsSpec" : [ {
"type" : "count",
"name" : "count"
} ],
"granularitySpec" : {
"type" : "uniform",
"segmentGranularity" : "HOUR",
"queryGranularity" : "MINUTE",
"rollup" : true,
"intervals" : null
},
"transformSpec" : {
"filter" : null,
"transforms" : [ ]
}
},
"tuningConfig" : {
"type" : "KafkaTuningConfig",
"maxRowsInMemory" : 50000,
"maxBytesInMemory" : 0,
"maxRowsPerSegment" : 1000000,
"maxTotalRows" : null,
"intermediatePersistPeriod" : "PT10M",
"basePersistDirectory" : "/var/run/cloudera-scm-agent/process/16149-druid-DRUID_OVERLORD/tmp/1558964010036-0",
"maxPendingPersists" : 0,
"indexSpec" : {
"bitmap" : {
"type" : "concise"
},
"dimensionCompression" : "lz4",
"metricCompression" : "lz4",
"longEncoding" : "longs"
},
"buildV9Directly" : true,
"reportParseExceptions" : false,
"handoffConditionTimeout" : 0,
"resetOffsetAutomatically" : true,
"segmentWriteOutMediumFactory" : null,
"intermediateHandoffPeriod" : "P2147483647D",
"logParseExceptions" : false,
"maxParseExceptions" : 2147483647,
"maxSavedParseExceptions" : 0,
"skipSequenceNumberAvailabilityCheck" : false
},
"ioConfig" : {
"type" : "kafka",
"taskGroupId" : 0,
"baseSequenceName" : "index_kafka_pprb_eventlog_c9e524a2db3c73b",
"startPartitions" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"partitionOffsetMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
}
},
"endPartitions" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
},
"partitionOffsetMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
}
},
"startSequenceNumbers" : {
"type" : "start",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"partitionOffsetMap" : {
"0" : 3171693501,
"1" : 3679159365,
"2" : 3565415885,
"3" : 3623048574,
"4" : 3716884056
},
"exclusivePartitions" : [ ]
},
"endSequenceNumbers" : {
"type" : "end",
"stream" : "pprb_eventlog",
"topic" : "pprb_eventlog",
"partitionSequenceNumberMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
},
"partitionOffsetMap" : {
"0" : 9223372036854775807,
"1" : 9223372036854775807,
"2" : 9223372036854775807,
"3" : 9223372036854775807,
"4" : 9223372036854775807
}
},
"consumerProperties" : {
"bootstrap.servers" : "sbt-oaar-0811.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0812.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0813.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0814.vm.mos.cloud.sbrf.ru:9093,sbt-oaar-0815.vm.mos.cloud.sbrf.ru:9093",
"ssl.truststore.location" : "/opt/cloudera/security/pki/server.truststore.jks",
"security.protocol" : "SSL",
"group.id" : "indexing-service3",
"ssl.truststore.password" : "qwe123",
"auto.offset.reset" : "latest"
},
"pollTimeout" : 100,
"useTransaction" : true,
"minimumMessageTime" : "2019-07-31T14:18:24.388Z",
"maximumMessageTime" : null,
"skipOffsetGaps" : true
},
"context" : {
"checkpoints" : "{\"0\":{\"0\":3171693501,\"1\":3679159365,\"2\":3565415885,\"3\":3623048574,\"4\":3716884056}}",
"IS_INCREMENTAL_HANDOFF_SUPPORTED" : true
},
"groupId" : "index_kafka_pprb_eventlog",
"dataSource" : "pprb_eventlog"
}
2019-08-01T14:20:57,939 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Attempting to lock file[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/lock].
2019-08-01T14:20:57,940 INFO [main] org.apache.druid.indexing.worker.executor.ExecutorLifecycle - Acquired lock file[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/lock] in 1ms.
2019-08-01T14:20:57,952 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.SingleTaskBackgroundRunner - Running task: index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo
2019-08-01T14:20:57,964 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo] location changed to [TaskLocation{host='sbt-oaar-0813.delta.sbrf.ru', port=8100, tlsPort=-1}].
2019-08-01T14:20:57,965 INFO [task-runner-0-priority-0] org.apache.druid.indexing.overlord.TaskRunnerUtils - Task [index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo] status changed to [RUNNING].
2019-08-01T14:20:57,965 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - SeekableStream indexing task starting up!
2019-08-01T14:20:57,966 INFO [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - Checkpoints [{"0":{"0":3171693501,"1":3679159365,"2":3565415885,"3":3623048574,"4":3716884056}}]
2019-08-01T14:20:57,969 INFO [main] org.apache.druid.server.initialization.jetty.JettyServerModule - Starting Jetty Server...
2019-08-01T14:20:57,971 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Starting with sequences: [SequenceMetadata{sequenceId=0, sequenceName='index_kafka_pprb_eventlog_c9e524a2db3c73b_0', assignments=[0, 1, 2, 3, 4], startOffsets={0=3171693501, 1=3679159365, 2=3565415885, 3=3623048574, 4=3716884056}, exclusiveStartPartitions=[], endOffsets={0=9223372036854775807, 1=9223372036854775807, 2=9223372036854775807, 3=9223372036854775807, 4=9223372036854775807}, sentinel=false, checkpointed=false}]
2019-08-01T14:20:57,971 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Found chat handler of class[org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider]
2019-08-01T14:20:57,971 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.firehose.ServiceAnnouncingChatHandlerProvider - Registering Eventhandler[index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo]
2019-08-01T14:20:57,974 INFO [main] org.eclipse.jetty.server.Server - jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 1.8.0_161-b12
2019-08-01T14:20:58,087 INFO [task-runner-0-priority-0] org.apache.kafka.clients.consumer.ConsumerConfig - ConsumerConfig values:
auto.commit.interval.ms = 5000
auto.offset.reset = none
bootstrap.servers = [sbt-oaar-0811.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0812.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0813.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0814.vm.mos.cloud.sbrf.ru:9093, sbt-oaar-0815.vm.mos.cloud.sbrf.ru:9093]
check.crcs = true
client.id =
connections.max.idle.ms = 540000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = indexing-service3
heartbeat.interval.ms = 3000
interceptor.classes = null
internal.leave.group.on.close = true
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 10000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 65536
reconnect.backoff.ms = 50
request.timeout.ms = 305000
retry.backoff.ms = 100
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism = GSSAPI
security.protocol = SSL
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks
ssl.truststore.password = [hidden]
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2019-08-01T14:20:59,095 INFO [main] org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0
2019-08-01T14:20:59,095 INFO [main] org.eclipse.jetty.server.session - No SessionScavenger set, using defaults
2019-08-01T14:20:59,098 INFO [main] org.eclipse.jetty.server.session - node0 Scavenging every 660000ms
2019-08-01T14:20:59,524 INFO [task-runner-0-priority-0] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.2
2019-08-01T14:20:59,524 INFO [task-runner-0-priority-0] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : cd80bc412b9b9701
2019-08-01T14:20:59,525 INFO [task-runner-0-priority-0] org.apache.druid.server.coordination.CuratorDataSegmentServerAnnouncer - Announcing self[DruidServerMetadata{name='sbt-oaar-0813.delta.sbrf.ru:8100', hostAndPort='sbt-oaar-0813.delta.sbrf.ru:8100', hostAndTlsPort='null', maxSize=0, tier='_default_tier', type=indexer-executor, priority=0}] at [/druid/announcements/sbt-oaar-0813.delta.sbrf.ru:8100]
2019-08-01T14:20:59,548 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.http.SegmentListerResource as a root resource class
2019-08-01T14:20:59,625 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announcing [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8100, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T14:20:59,652 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider as a provider class
2019-08-01T14:20:59,653 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider as a provider class
2019-08-01T14:20:59,653 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.CustomExceptionMapper as a provider class
2019-08-01T14:20:59,653 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.ForbiddenExceptionMapper as a provider class
2019-08-01T14:20:59,653 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.initialization.jetty.BadRequestExceptionMapper as a provider class
2019-08-01T14:20:59,653 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Registering org.apache.druid.server.StatusResource as a root resource class
2019-08-01T14:20:59,697 INFO [main] com.sun.jersey.server.impl.application.WebApplicationImpl - Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:43 PM'
2019-08-01T14:20:59,806 INFO [task-runner-0-priority-0] org.apache.druid.curator.discovery.CuratorDruidNodeAnnouncer - Announced [DiscoveryDruidNode{druidNode=DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8100, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}, nodeType='PEON', services={dataNodeService=DataNodeService{tier='_default_tier', maxSize=0, type=indexer-executor, priority=0}, lookupNodeService=LookupNodeService{lookupTier='__default'}}}].
2019-08-01T14:20:59,976 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Created Appenderator for dataSource[pprb_eventlog].
2019-08-01T14:20:59,994 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.AppenderatorImpl - Loading sinks from[/hdfs/druid_temp_segments/persistent/task/index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo/work/persist]: []
2019-08-01T14:20:59,998 INFO [task-runner-0-priority-0] org.apache.druid.segment.realtime.appenderator.StreamAppenderatorDriver - Restored metadata[null].
2019-08-01T14:21:00,006 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[0], start[3171693501] -> end[9223372036854775807] to assignment.
2019-08-01T14:21:00,007 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[1], start[3679159365] -> end[9223372036854775807] to assignment.
2019-08-01T14:21:00,007 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[2], start[3565415885] -> end[9223372036854775807] to assignment.
2019-08-01T14:21:00,007 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[3], start[3623048574] -> end[9223372036854775807] to assignment.
2019-08-01T14:21:00,007 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Adding partition[4], start[3716884056] -> end[9223372036854775807] to assignment.
2019-08-01T14:21:00,026 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[3] to sequenceNumber[3623048574].
2019-08-01T14:21:00,027 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[4] to sequenceNumber[3716884056].
2019-08-01T14:21:00,027 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[1] to sequenceNumber[3679159365].
2019-08-01T14:21:00,027 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[2] to sequenceNumber[3565415885].
2019-08-01T14:21:00,027 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Seeking partition[0] to sequenceNumber[3171693501].
2019-08-01T14:21:00,051 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.CustomExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T14:21:00,055 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.ForbiddenExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T14:21:00,055 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.initialization.jetty.BadRequestExceptionMapper to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T14:21:00,057 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.json.JacksonJsonProvider to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T14:21:00,076 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding com.fasterxml.jackson.jaxrs.smile.JacksonSmileProvider to GuiceManagedComponentProvider with the scope "Singleton"
2019-08-01T14:21:00,952 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.security.StateResourceFilter to GuiceInstantiatedComponentProvider
2019-08-01T14:21:00,956 WARN [task-runner-0-priority-0] org.apache.druid.indexing.kafka.IncrementalPublishingKafkaIndexTaskRunner - OffsetOutOfRangeException with message [Offsets out of range with no configured reset policy for partitions: {pprb_eventlog-1=3679159365}]
2019-08-01T14:21:01,277 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.actions.RemoteTaskActionClient - Performing action for task[index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo]: ResetDataSourceMetadataAction{dataSource='pprb_eventlog', resetMetadata=KafkaDataSourceMetadata{SeekableStreamStartSequenceNumbers=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={1=3679159365}, exclusivePartitions=[]}}}
2019-08-01T14:21:01,288 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.SegmentListerResource to GuiceManagedComponentProvider with the scope "PerRequest"
2019-08-01T14:21:01,295 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.QueryResource to GuiceInstantiatedComponentProvider
2019-08-01T14:21:01,306 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.segment.realtime.firehose.ChatHandlerResource to GuiceInstantiatedComponentProvider
2019-08-01T14:21:01,309 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.http.security.ConfigResourceFilter to GuiceInstantiatedComponentProvider
2019-08-01T14:21:01,313 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.query.lookup.LookupListeningResource to GuiceInstantiatedComponentProvider
2019-08-01T14:21:01,316 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.query.lookup.LookupIntrospectionResource to GuiceInstantiatedComponentProvider
2019-08-01T14:21:01,325 INFO [main] com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory - Binding org.apache.druid.server.StatusResource to GuiceManagedComponentProvider with the scope "Undefined"
2019-08-01T14:21:01,327 INFO [task-runner-0-priority-0] org.apache.druid.indexing.common.actions.RemoteTaskActionClient - Submitting action for task[index_kafka_pprb_eventlog_c9e524a2db3c73b_phfbmpeo] to overlord: [ResetDataSourceMetadataAction{dataSource='pprb_eventlog', resetMetadata=KafkaDataSourceMetadata{SeekableStreamStartSequenceNumbers=SeekableStreamStartSequenceNumbers{stream='pprb_eventlog', partitionSequenceNumberMap={1=3679159365}, exclusivePartitions=[]}}}].
2019-08-01T14:21:01,349 WARN [main] com.sun.jersey.spi.inject.Errors - The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.druid.server.http.SegmentListerResource.getSegments(long,long,long,javax.servlet.http.HttpServletRequest) throws java.io.IOException, MUST return a non-void type.
2019-08-01T14:21:01,379 INFO [main] org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.s.ServletContextHandler@5178345d{/,null,AVAILABLE}
2019-08-01T14:21:01,391 INFO [main] org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@103e7c7c{HTTP/1.1,[http/1.1]}{0.0.0.0:8100}
2019-08-01T14:21:01,391 INFO [main] org.eclipse.jetty.server.Server - Started @29207ms
2019-08-01T14:21:01,392 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.query.lookup.LookupReferencesManager.start()] on object[org.apache.druid.query.lookup.LookupReferencesManager@8b1202a].
2019-08-01T14:21:01,393 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is starting.
2019-08-01T14:21:01,514 WARN [main] org.apache.druid.query.lookup.LookupReferencesManager - No lookups found for tier [__default], response [org.apache.druid.java.util.http.client.response.FullResponseHolder@18692e80]
2019-08-01T14:21:01,515 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - Coordinator is unavailable. Loading saved snapshot instead
2019-08-01T14:21:01,515 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - No lookups to be loaded at this point
2019-08-01T14:21:01,525 INFO [main] org.apache.druid.query.lookup.LookupReferencesManager - LookupReferencesManager is started.
2019-08-01T14:21:01,525 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle$AnnotationBasedHandler - Invoking start method[public void org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer.start()] on object[org.apache.druid.query.lookup.LookupResourceListenerAnnouncer@31fe0ce5].
2019-08-01T14:21:01,530 INFO [main] org.apache.druid.server.listener.announcer.ListenerResourceAnnouncer - Announcing start time on [/druid/listeners/lookups/__default/http:sbt-oaar-0813.delta.sbrf.ru:8100]
2019-08-01T14:21:01,530 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Starting lifecycle [module] stage [LAST]
2019-08-01T14:21:01,530 INFO [main] org.apache.druid.java.util.common.lifecycle.Lifecycle - Successfully started lifecycle [module]
2019-08-01T14:21:01,579 ERROR [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Resetting sequences for datasource [pprb_eventlog]: {class=org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner, partitions=[1]}
2019-08-01T14:21:01,617 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
```
This issue has been marked as stale due to 280 days of inactivity. It will be closed in 4 weeks if no further activity occurs. If this issue is still relevant, please simply write any comment. Even if closed, you can still revive the issue at any time or discuss it on the dev@druid.apache.org list. Thank you for your contributions.
This issue has been closed due to lack of activity. If you think that is incorrect, or the issue requires additional review, you can revive the issue at any time.
Hi! lately we found our tasks are being paused forever while resetting kafka offsets for example there is the log of first task :
First log
``` 2019-08-01T13:17:58,059 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2019-08-01T13:17:58,080 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from runtime.properties 2019-08-01T13:17:58,261 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final 2019-08-01T13:17:59,717 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [org.apache.druid.common.config.NullValueHandlingConfig@56f0cc85] 2019-08-01T13:17:59,878 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions', useExtensionClassloaderFirst=false, hadoopDependenciesDir='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-histogram, druid-datasketches, druid-lookups-cached-global, postgresql-metadata-storage, druid-hdfs-storage, druid-kafka-indexing-service, kafka-emitter]}] 2019-08-01T13:17:59,891 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:17:59,989 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-histogram/druid-histogram-0.14.2-incubating.jar] for extension[druid-histogram] 2019-08-01T13:17:59,995 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:17:59,997 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/memory-0.12.2.jar] for extension[druid-datasketches] 2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/slf4j-api-1.6.4.jar] for extension[druid-datasketches] 2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/commons-math3-3.6.1.jar] for extension[druid-datasketches] 2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/sketches-core-0.13.3.jar] for extension[druid-datasketches] 2019-08-01T13:17:59,998 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/druid-datasketches-0.14.2-incubating.jar] for extension[druid-datasketches] 2019-08-01T13:18:00,001 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:18:00,012 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.14.2-incubating.jar] for extension[druid-lookups-cached-global] 2019-08-01T13:18:00,013 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:18:00,016 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar] for extension[postgresql-metadata-storage] 2019-08-01T13:18:00,017 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.14.2-incubating.jar] for extension[postgresql-metadata-storage] 2019-08-01T13:18:00,023 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-configuration-1.6.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-compress-1.16.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,031 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-framework-4.1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/objenesis-2.6.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/druid-hdfs-storage-0.14.2-incubating.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/xmlenc-0.52.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,032 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jersey-client-1.9.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-api-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/servlet-api-2.5.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-auth-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-net-3.1.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,033 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-hdfs-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okio-1.4.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,038 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-digester-1.8.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,039 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-recipes-4.1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jsp-api-2.1.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,040 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,043 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okhttp-2.4.0.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,044 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,045 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/stax-api-1.0-2.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/json-smart-1.1.1.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,046 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/gson-2.2.4.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,047 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/htrace-core4-4.0.1-incubating.jar] for extension[druid-hdfs-storage] 2019-08-01T13:18:00,164 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.14.2-incubating.jar] for extension[druid-kafka-indexing-service] 2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.2.jar] for extension[druid-kafka-indexing-service] 2019-08-01T13:18:00,165 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar] for extension[druid-kafka-indexing-service] 2019-08-01T13:18:00,170 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T13:18:00,171 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/slf4j-api-1.6.4.jar] for extension[kafka-emitter] 2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-clients-0.10.2.0.jar] for extension[kafka-emitter] 2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/lz4-1.3.0.jar] for extension[kafka-emitter] 2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-emitter-0.14.0-incubating.jar] for extension[kafka-emitter] 2019-08-01T13:18:00,172 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/snappy-java-1.1.2.6.jar] for extension[kafka-emitter] 2019-08-01T13:18:00,359 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}] 2019-08-01T13:18:01,004 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,026 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,027 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,038 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,040 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,042 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.quantiles.DoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,044 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.tuple.ArrayOfDoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,046 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.hll.HllSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,047 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,049 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.server.lookup.namespace.NamespaceExtractionModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,049 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,051 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,052 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,054 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,054 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,056 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:01,056 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T13:18:01,058 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.emitter.kafka.KafkaEmitterModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T13:18:04,968 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-08-01T13:18:06,481 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.emitter.kafka.KafkaEmitterConfig] from props[druid.emitter.kafka.] as [KafkaEmitterConfig{bootstrap.servers='sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093', metric.topic='druid-metrics', alert.topic='druid-logs', request.topic='druid-requests', Producer.config={max.block.ms=10000, security.protocol=SSL, ssl.truststore.password=qwe123, ssl.truststore.location=/opt/cloudera/security/pki/server.truststore.jks}}] 2019-08-01T13:18:06,517 INFO [main] org.apache.kafka.clients.producer.ProducerConfig - ProducerConfig values: acks = 1 batch.size = 16384 block.on.buffer.full = false bootstrap.servers = [sbt-oaar-0811.delta.sbrf.ru:9093, sbt-oaar-0812.delta.sbrf.ru:9093, , sbt-oaar-0813.delta.sbrf.ru:9093, sbt-oaar-0814.delta.sbrf.ru:9093, sbt-oaar-0815.delta.sbrf.ru:9093] buffer.memory = 33554432 client.id = compression.type = none connections.max.idle.ms = 540000 interceptor.classes = null key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 10000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.fetch.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 3 retry.backoff.ms = 100 sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism = GSSAPI security.protocol = SSL send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks ssl.truststore.password = [hidden] ssl.truststore.type = JKS timeout.ms = 30000 value.serializer = class org.apache.kafka.common.serialization.StringSerializer 2019-08-01T13:18:06,627 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.0 2019-08-01T13:18:06,627 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : 576d93a8dc0cf421 2019-08-01T13:18:06,662 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.security.Escalator] from props[druid.escalator.] as [NoopEscalator{}] 2019-08-01T13:18:06,687 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.CuratorConfig] from props[druid.zk.service.] as [org.apache.druid.curator.CuratorConfig@37348491] 2019-08-01T13:18:06,694 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [org.apache.druid.curator.ExhibitorConfig@10b687f2] 2019-08-01T13:18:06,814 INFO [main] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode 2019-08-01T13:18:06,819 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29 2019-08-01T13:18:06,880 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.metric.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T13:18:06,880 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.alert.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.bootstrap.servers property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.request.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T13:18:06,881 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.producer.config property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T13:18:06,894 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8102, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}] 2019-08-01T13:18:06,898 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [org.apache.druid.server.initialization.ZkPathsConfig@22e2266d] 2019-08-01T13:18:06,913 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}] 2019-08-01T13:18:06,985 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [org.apache.druid.server.metrics.DruidMonitorSchedulerConfig@ee8e7ff] 2019-08-01T13:18:06,990 WARN [main] org.apache.druid.server.metrics.MonitorsConfig - Deprecated Monitor class name[io.druid.java.util.metrics.JvmMonitor] found, please use name[org.apache.druid.java.util.metrics.JvmMonitor] instead. 2019-08-01T13:18:06,993 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class org.apache.druid.java.util.metrics.JvmMonitor]}] 2019-08-01T13:18:06,994 INFO [main] org.apache.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: org.apache.druid.emitter.kafka.KafkaEmitter@49433c98 2019-08-01T13:18:06,994 INFO [main] org.apache.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.14.2-incubating} 2019-08-01T13:18:07,789 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [org.apache.druid.server.initialization.CuratorDiscoveryConfig@415d88de] 2019-08-01T13:18:07,860 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, queueSize=2147483647, enableRequestLimit=false, maxIdleTime=PT5M, defaultQueryTimeout=10000, maxScatterGatherBytes=9223372036854775807, maxQueryTimeout=9223372036854775807, maxRequestHeaderSize=8192, gracefulShutdownTimeout=PT0S, unannouncePropagationDelay=PT0S, inflateBufferSize=4096, compressionLevel=-1}] 2019-08-01T13:18:08,393 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.java.util.metrics.JvmMonitor@3b4ef59f] 2019-08-01T13:18:08,395 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.query.ExecutorServiceMonitor@5a7b309b] 2019-08-01T13:18:08,395 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@353c6da1] 2019-08-01T13:18:08,400 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [org.apache.druid.server.log.StartupLoggingConfig@75e80a97] 2019-08-01T13:18:08,400 INFO [main] org.apache.druid.cli.CliPeon - Starting up with processors[16], memory[2,111,832,064], maxMemory[3,221,225,472], directMemory[3,221,225,472]. 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.enabled: true 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.evictOnClose: true 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.sizeInBytes: 536870912 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.type: caffeine 2019-08-01T13:18:08,402 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter: kafka 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.alert.topic: druid-logs 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.bootstrap.servers: sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.metric.topic: druid-metrics 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.producer.config: {"max.block.ms":10000, "security.protocol":"SSL","ssl.truststore.password":"qwe123","ssl.truststore.location":"/opt/cloudera/security/pki/server.truststore.jks" } 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.request.topic: druid-requests 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.directory: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies 2019-08-01T13:18:08,417 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-histogram","druid-datasketches","druid-lookups-cached-global","postgresql-metadata-storage", "druid-hdfs-storage", "druid-kafka-indexing-service","kafka-emitter"] 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.host: sbt-oaar-0813.delta.sbrf.ru 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.directory: /user/druid/logs 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.durationToRetain: 86400000 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.enabled: true 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.runner.javaOptsArray: ["-server", "-Xmx3g","-XX:+ExitOnOutOfMemoryError", "-Duser.timezone=UTC", "-Dfile.encoding=UTF-8", "-XX:+UseG1GC", "-XX:MaxGCPauseMillis=200","-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager" ,"-Dlog4j.configurationFile=scripts/log4j2.xml"] 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.baseDir: /hdfs/druid_temp_segments/ 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"] 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: false 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.javascript.enabled: false 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:postgresql://sbt-oaar-0810.delta.sbrf.ru:5432/druid_db 2019-08-01T13:18:08,418 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.password:and there are a hour interval between messages 2019-08-01T13:18:32,175 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed 2019-08-01T14:18:24,273 INFO [task-runner-0-priority-0] org.apache.druid.indexing.seekablestream.SeekableStreamIndexTaskRunner - Pausing ingestion until resumed
after that task got stopped ( 1 hour interval) and new task being scheduled, which is also stuck for another 1 hour :(
task 2
``` 2019-08-01T14:20:34,343 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from common.runtime.properties 2019-08-01T14:20:34,346 INFO [main] org.apache.druid.guice.PropertiesModule - Loading properties from runtime.properties 2019-08-01T14:20:34,416 INFO [main] org.hibernate.validator.internal.util.Version - HV000001: Hibernate Validator 5.1.3.Final 2019-08-01T14:20:35,403 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.common.config.NullValueHandlingConfig] from props[druid.generic.] as [org.apache.druid.common.config.NullValueHandlingConfig@56f0cc85] 2019-08-01T14:20:35,522 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ExtensionsConfig] from props[druid.extensions.] as [ExtensionsConfig{searchCurrentClassloader=true, directory='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions', useExtensionClassloaderFirst=false, hadoopDependenciesDir='/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies', hadoopContainerDruidClasspath='null', addExtensionsToHadoopContainer=false, loadList=[druid-histogram, druid-datasketches, druid-lookups-cached-global, postgresql-metadata-storage, druid-hdfs-storage, druid-kafka-indexing-service, kafka-emitter]}] 2019-08-01T14:20:35,529 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,558 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-histogram/druid-histogram-0.14.2-incubating.jar] for extension[druid-histogram] 2019-08-01T14:20:35,562 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,562 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/memory-0.12.2.jar] for extension[druid-datasketches] 2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/slf4j-api-1.6.4.jar] for extension[druid-datasketches] 2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/commons-math3-3.6.1.jar] for extension[druid-datasketches] 2019-08-01T14:20:35,563 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/sketches-core-0.13.3.jar] for extension[druid-datasketches] 2019-08-01T14:20:35,564 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-datasketches/druid-datasketches-0.14.2-incubating.jar] for extension[druid-datasketches] 2019-08-01T14:20:35,575 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,575 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-lookups-cached-global/druid-lookups-cached-global-0.14.2-incubating.jar] for extension[druid-lookups-cached-global] 2019-08-01T14:20:35,576 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,581 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-9.4.1208.jre7.jar] for extension[postgresql-metadata-storage] 2019-08-01T14:20:35,582 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/postgresql-metadata-storage/postgresql-metadata-storage-0.14.2-incubating.jar] for extension[postgresql-metadata-storage] 2019-08-01T14:20:35,606 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-i18n-2.0.0-M15.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-configuration-1.6.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-compress-1.16.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-framework-4.1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-jaxrs-1.9.13.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,607 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/objenesis-2.6.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/druid-hdfs-storage-0.14.2-incubating.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/xmlenc-0.52.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jersey-client-1.9.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-api-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,608 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-core-1.8.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/servlet-api-2.5.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-auth-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-net-3.1.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jcip-annotations-1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-hdfs-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,609 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jackson-xc-1.9.13.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okio-1.4.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-shuffle-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-util-1.0.0-M20.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-digester-1.8.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/api-asn1-api-1.0.0-M20.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,610 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/curator-recipes-4.1.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-jobclient-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/leveldbjni-all-1.8.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jsp-api-2.1.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-client-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-server-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-beanutils-1.7.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,611 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/okhttp-2.4.0.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/commons-collections-3.2.2.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-app-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/apacheds-kerberos-codec-2.0.0-M15.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jetty-sslengine-6.1.26.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,612 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/jaxb-api-2.2.2.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,613 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-yarn-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,613 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/stax-api-1.0-2.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/json-smart-1.1.1.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-mapreduce-client-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,649 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/nimbus-jose-jwt-3.9.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/hadoop-common-2.8.3.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/gson-2.2.4.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,650 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-hdfs-storage/htrace-core4-4.0.1-incubating.jar] for extension[druid-hdfs-storage] 2019-08-01T14:20:35,799 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/druid-kafka-indexing-service-0.14.2-incubating.jar] for extension[druid-kafka-indexing-service] 2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/kafka-clients-0.10.2.2.jar] for extension[druid-kafka-indexing-service] 2019-08-01T14:20:35,803 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/druid-kafka-indexing-service/snappy-java-1.1.2.6.jar] for extension[druid-kafka-indexing-service] 2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.cli.CliCommandCreator] 2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/slf4j-api-1.6.4.jar] for extension[kafka-emitter] 2019-08-01T14:20:35,825 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-clients-0.10.2.0.jar] for extension[kafka-emitter] 2019-08-01T14:20:35,826 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/lz4-1.3.0.jar] for extension[kafka-emitter] 2019-08-01T14:20:35,826 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/kafka-emitter-0.14.0-incubating.jar] for extension[kafka-emitter] 2019-08-01T14:20:35,830 INFO [main] org.apache.druid.initialization.Initialization - added URL[file:/opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions/kafka-emitter/snappy-java-1.1.2.6.jar] for extension[kafka-emitter] 2019-08-01T14:20:36,145 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.guice.ModulesConfig] from props[druid.modules.] as [ModulesConfig{excludeList=[]}] 2019-08-01T14:20:37,011 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-histogram] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,057 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.histogram.ApproximateHistogramDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,057 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-datasketches] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,060 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.SketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,061 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.theta.oldapi.OldApiSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,065 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.quantiles.DoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,086 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.tuple.ArrayOfDoublesSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,093 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.query.aggregation.datasketches.hll.HllSketchModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,093 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-lookups-cached-global] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,117 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.server.lookup.namespace.NamespaceExtractionModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,117 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [postgresql-metadata-storage] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,119 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.metadata.storage.postgresql.PostgreSQLMetadataStorageModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,119 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-hdfs-storage] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,125 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.storage.hdfs.HdfsStorageDruidModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,125 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [druid-kafka-indexing-service] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,127 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.indexing.kafka.KafkaIndexTaskModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:37,127 INFO [main] org.apache.druid.initialization.Initialization - Loading extension [kafka-emitter] for class [interface org.apache.druid.initialization.DruidModule] 2019-08-01T14:20:37,129 INFO [main] org.apache.druid.initialization.Initialization - Adding implementation [org.apache.druid.emitter.kafka.KafkaEmitterModule] for class [interface org.apache.druid.initialization.DruidModule] from local file system extension 2019-08-01T14:20:43,543 WARN [main] org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2019-08-01T14:20:45,539 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.emitter.kafka.KafkaEmitterConfig] from props[druid.emitter.kafka.] as [KafkaEmitterConfig{bootstrap.servers='sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093', metric.topic='druid-metrics', alert.topic='druid-logs', request.topic='druid-requests', Producer.config={max.block.ms=10000, security.protocol=SSL, ssl.truststore.password=qwe123, ssl.truststore.location=/opt/cloudera/security/pki/server.truststore.jks}}] 2019-08-01T14:20:45,611 INFO [main] org.apache.kafka.clients.producer.ProducerConfig - ProducerConfig values: acks = 1 batch.size = 16384 block.on.buffer.full = false bootstrap.servers = [sbt-oaar-0811.delta.sbrf.ru:9093, sbt-oaar-0812.delta.sbrf.ru:9093, , sbt-oaar-0813.delta.sbrf.ru:9093, sbt-oaar-0814.delta.sbrf.ru:9093, sbt-oaar-0815.delta.sbrf.ru:9093] buffer.memory = 33554432 client.id = compression.type = none connections.max.idle.ms = 540000 interceptor.classes = null key.serializer = class org.apache.kafka.common.serialization.StringSerializer linger.ms = 0 max.block.ms = 10000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.fetch.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 3 retry.backoff.ms = 100 sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism = GSSAPI security.protocol = SSL send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = /opt/cloudera/security/pki/server.truststore.jks ssl.truststore.password = [hidden] ssl.truststore.type = JKS timeout.ms = 30000 value.serializer = class org.apache.kafka.common.serialization.StringSerializer 2019-08-01T14:20:45,811 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka version : 0.10.2.0 2019-08-01T14:20:45,811 INFO [main] org.apache.kafka.common.utils.AppInfoParser - Kafka commitId : 576d93a8dc0cf421 2019-08-01T14:20:45,865 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[interface org.apache.druid.server.security.Escalator] from props[druid.escalator.] as [NoopEscalator{}] 2019-08-01T14:20:45,913 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.CuratorConfig] from props[druid.zk.service.] as [org.apache.druid.curator.CuratorConfig@37348491] 2019-08-01T14:20:45,925 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.curator.ExhibitorConfig] from props[druid.exhibitor.service.] as [org.apache.druid.curator.ExhibitorConfig@10b687f2] 2019-08-01T14:20:46,176 INFO [main] org.apache.curator.utils.Compatibility - Running in ZooKeeper 3.4.x compatibility mode 2019-08-01T14:20:46,183 WARN [main] org.apache.curator.retry.ExponentialBackoffRetry - maxRetries too large (30). Pinning to 29 2019-08-01T14:20:46,282 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.metric.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T14:20:46,283 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.alert.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T14:20:46,283 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.bootstrap.servers property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T14:20:46,284 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.request.topic property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T14:20:46,284 INFO [main] org.apache.druid.guice.JsonConfigurator - Skipping druid.emitter.kafka.producer.config property: one of it's prefixes is also used as a property key. Prefix: druid 2019-08-01T14:20:46,295 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.DruidNode] from props[druid.] as [DruidNode{serviceName='druid/middlemanager', host='sbt-oaar-0813.delta.sbrf.ru', bindOnHost=false, port=-1, plaintextPort=8100, enablePlaintextPort=true, tlsPort=-1, enableTlsPort=false}] 2019-08-01T14:20:46,315 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ZkPathsConfig] from props[druid.zk.paths.] as [org.apache.druid.server.initialization.ZkPathsConfig@22e2266d] 2019-08-01T14:20:46,324 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.security.AuthConfig] from props[druid.auth.] as [AuthConfig{authenticatorChain=null, authorizers=null, unsecuredPaths=[], allowUnauthenticatedHttpOptions=false}] 2019-08-01T14:20:46,576 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.DruidMonitorSchedulerConfig] from props[druid.monitoring.] as [org.apache.druid.server.metrics.DruidMonitorSchedulerConfig@ee8e7ff] 2019-08-01T14:20:46,579 WARN [main] org.apache.druid.server.metrics.MonitorsConfig - Deprecated Monitor class name[io.druid.java.util.metrics.JvmMonitor] found, please use name[org.apache.druid.java.util.metrics.JvmMonitor] instead. 2019-08-01T14:20:46,589 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.metrics.MonitorsConfig] from props[druid.monitoring.] as [MonitorsConfig{monitors=[class org.apache.druid.java.util.metrics.JvmMonitor]}] 2019-08-01T14:20:46,590 INFO [main] org.apache.druid.server.emitter.EmitterModule - Underlying emitter for ServiceEmitter: org.apache.druid.emitter.kafka.KafkaEmitter@49433c98 2019-08-01T14:20:46,590 INFO [main] org.apache.druid.server.emitter.EmitterModule - Extra service dimensions: {version=0.14.2-incubating} 2019-08-01T14:20:47,100 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.CuratorDiscoveryConfig] from props[druid.discovery.curator.] as [org.apache.druid.server.initialization.CuratorDiscoveryConfig@415d88de] 2019-08-01T14:20:47,144 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.initialization.ServerConfig] from props[druid.server.http.] as [ServerConfig{numThreads=40, queueSize=2147483647, enableRequestLimit=false, maxIdleTime=PT5M, defaultQueryTimeout=10000, maxScatterGatherBytes=9223372036854775807, maxQueryTimeout=9223372036854775807, maxRequestHeaderSize=8192, gracefulShutdownTimeout=PT0S, unannouncePropagationDelay=PT0S, inflateBufferSize=4096, compressionLevel=-1}] 2019-08-01T14:20:48,140 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.java.util.metrics.JvmMonitor@3b4ef59f] 2019-08-01T14:20:48,143 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.query.ExecutorServiceMonitor@5a7b309b] 2019-08-01T14:20:48,143 INFO [main] org.apache.druid.server.metrics.MetricsModule - Adding monitor[org.apache.druid.server.initialization.jetty.JettyServerModule$JettyMonitor@353c6da1] 2019-08-01T14:20:48,155 INFO [main] org.apache.druid.guice.JsonConfigurator - Loaded class[class org.apache.druid.server.log.StartupLoggingConfig] from props[druid.startup.logging.] as [org.apache.druid.server.log.StartupLoggingConfig@75e80a97] 2019-08-01T14:20:48,160 INFO [main] org.apache.druid.cli.CliPeon - Starting up with processors[16], memory[2,111,832,064], maxMemory[3,221,225,472], directMemory[3,221,225,472]. 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * awt.toolkit: sun.awt.X11.XToolkit 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.enabled: true 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.evictOnClose: true 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.sizeInBytes: 536870912 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.cache.type: caffeine 2019-08-01T14:20:48,168 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter: kafka 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.alert.topic: druid-logs 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.bootstrap.servers: sbt-oaar-0811.delta.sbrf.ru:9093,sbt-oaar-0812.delta.sbrf.ru:9093,,sbt-oaar-0813.delta.sbrf.ru:9093,sbt-oaar-0814.delta.sbrf.ru:9093,sbt-oaar-0815.delta.sbrf.ru:9093 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.metric.topic: druid-metrics 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.producer.config: {"max.block.ms":10000, "security.protocol":"SSL","ssl.truststore.password":"qwe123","ssl.truststore.location":"/opt/cloudera/security/pki/server.truststore.jks" } 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.kafka.request.topic: druid-requests 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.emitter.logging.logLevel: info 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.directory: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/extensions 2019-08-01T14:20:48,169 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.hadoopDependenciesDir: /opt/cloudera/parcels/DRUID-0.14.2-0.2.3/hadoop-dependencies 2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.extensions.loadList: ["druid-histogram","druid-datasketches","druid-lookups-cached-global","postgresql-metadata-storage", "druid-hdfs-storage", "druid-kafka-indexing-service","kafka-emitter"] 2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.host: sbt-oaar-0813.delta.sbrf.ru 2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.directory: /user/druid/logs 2019-08-01T14:20:48,170 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.durationToRetain: 86400000 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.kill.enabled: true 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.logs.type: hdfs 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.runner.javaOptsArray: ["-server", "-Xmx3g","-XX:+ExitOnOutOfMemoryError", "-Duser.timezone=UTC", "-Dfile.encoding=UTF-8", "-XX:+UseG1GC", "-XX:MaxGCPauseMillis=200","-Djava.util.logging.manager=org.apache.logging.log4j.jul.LogManager" ,"-Dlog4j.configurationFile=scripts/log4j2.xml"] 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.baseDir: /hdfs/druid_temp_segments/ 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.defaultHadoopCoordinates: ["org.apache.hadoop:hadoop-client:2.3.0"] 2019-08-01T14:20:48,174 INFO [main] org.apache.druid.cli.CliPeon - * druid.indexer.task.restoreTasksOnRestart: false 2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.javascript.enabled: false 2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.connectURI: jdbc:postgresql://sbt-oaar-0810.delta.sbrf.ru:5432/druid_db 2019-08-01T14:20:48,175 INFO [main] org.apache.druid.cli.CliPeon - * druid.metadata.storage.connector.password:druid version is 0.14.2
This issue has been marked as stale due to 280 days of inactivity. It will be closed in 4 weeks if no further activity occurs. If this issue is still relevant, please simply write any comment. Even if closed, you can still revive the issue at any time or discuss it on the dev@druid.apache.org list. Thank you for your contributions.
This issue has been closed due to lack of activity. If you think that is incorrect, or the issue requires additional review, you can revive the issue at any time.