search

Graylog2 / fpm-recipes

Graylog package build recipes
http://docs.graylog.org/en/latest/pages/installation/operating_system_packages.html
18 stars 19 forks source link

graylog web and server not working port 9000 is not running #67

Closed nithiya123 closed 8 years ago

nithiya123 commented 8 years ago 
2016-05-20T12:23:49.022Z INFO  [CmdLineTool] Loaded plugins: [Anonymous Usage Statistics 1.2.1 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]]
2016-05-20T12:23:49.069Z INFO  [CmdLineTool] Running with JVM arguments: -Xms1g -Xmx1g -XX:NewRatio=1 -XX:PermSize=128m -XX:MaxPermSize=256m -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -Dlog4j.configuration=file:///etc/graylog/server/log4j.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar -Dgraylog2.installation_source=deb
2016-05-20T12:23:50.614Z INFO  [InputBufferImpl] Message journal is enabled.
2016-05-20T12:23:50.749Z INFO  [LogManager] Loading logs.
2016-05-20T12:23:50.850Z INFO  [LogManager] Logs loading complete.
2016-05-20T12:23:50.905Z INFO  [LogManager] Created log for partition [messagejournal,0] in /var/lib/graylog-server/journal with properties {segment.index.bytes -> 1048576, file.delete.delay.ms -> 60000, segment.bytes -> 104857600, flush.ms -> 60000, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> 5368709120, min.insync.replicas -> 0, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 3600000, max.message.bytes -> 2147483647, flush.messages -> 1000000, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 43200000, segment.jitter.ms -> 0}.
2016-05-20T12:23:50.905Z INFO  [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal
2016-05-20T12:23:50.916Z INFO  [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers.
2016-05-20T12:23:51.093Z INFO  [NodeId] Node ID: 7068c1f6-e9b7-4685-887f-43a45bfb39dc
2016-05-20T12:23:51.191Z INFO  [node] [graylog2-server] version[1.7.5], pid[4975], build[00f95f4/2016-02-02T09:55:30Z]
2016-05-20T12:23:51.192Z INFO  [node] [graylog2-server] initializing ...
2016-05-20T12:23:51.247Z INFO  [plugins] [graylog2-server] loaded [graylog-monitor], sites []
2016-05-20T12:23:52.937Z INFO  [node] [graylog2-server] initialized
2016-05-20T12:23:52.998Z INFO  [Version] HV000001: Hibernate Validator 5.2.2.Final
2016-05-20T12:23:53.457Z INFO  [RoleServiceImpl] Admin role is missing or invalid, re-adding it as a built-in role.
2016-05-20T12:23:53.531Z INFO  [RoleServiceImpl] Reader role is missing or invalid, re-adding it as a built-in role.
2016-05-20T12:23:53.554Z INFO  [ProcessBuffer] Initialized ProcessBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-20T12:23:54.992Z INFO  [RulesEngineProvider] No static rules file loaded.
2016-05-20T12:23:55.019Z INFO  [OutputBuffer] Initialized OutputBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-20T12:23:55.986Z INFO  [ServerBootstrap] Graylog server 1.3.4 (0d67a80) starting up
2016-05-20T12:23:55.987Z INFO  [ServerBootstrap] JRE: Oracle Corporation 1.8.0_91 on Linux 3.13.0-74-generic
2016-05-20T12:23:55.987Z INFO  [ServerBootstrap] Deployment: deb
2016-05-20T12:23:55.987Z INFO  [ServerBootstrap] OS: Ubuntu 14.04.3 LTS (trusty)
2016-05-20T12:23:55.987Z INFO  [ServerBootstrap] Arch: amd64
2016-05-20T12:23:56.028Z INFO  [PeriodicalsService] Starting 24 periodicals ...
2016-05-20T12:23:56.033Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling every [1s].
2016-05-20T12:23:56.032Z INFO  [node] [graylog2-server] starting ...
2016-05-20T12:23:56.035Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every [60s].
2016-05-20T12:23:56.036Z INFO  [Periodicals] Starting [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in [0s], polling every [1s].
2016-05-20T12:23:56.036Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterHealthCheckThread] periodical in [0s], polling every [20s].
2016-05-20T12:23:56.037Z INFO  [Periodicals] Starting [org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running forever.
2016-05-20T12:23:56.037Z INFO  [Periodicals] Starting [org.graylog2.periodical.DeadLetterThread] periodical, running forever.
2016-05-20T12:23:56.038Z INFO  [Periodicals] Starting [org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running forever.
2016-05-20T12:23:56.041Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s], polling every [30s].
2016-05-20T12:23:56.051Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling every [300s].
2016-05-20T12:23:56.051Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every [10s].
2016-05-20T12:23:56.052Z INFO  [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks.
2016-05-20T12:23:56.052Z INFO  [Periodicals] Starting [org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s].
2016-05-20T12:23:56.052Z INFO  [Periodicals] Starting [org.graylog2.periodical.StreamThroughputCounterManagerThread] periodical in [0s], polling every [1s].
2016-05-20T12:23:56.052Z INFO  [Periodicals] Starting [org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling every [1800s].
2016-05-20T12:23:56.053Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s], polling every [1s].
2016-05-20T12:23:56.053Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every [1s].
2016-05-20T12:23:56.053Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling every [300s].
2016-05-20T12:23:56.053Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running forever.
2016-05-20T12:23:56.054Z INFO  [Periodicals] Starting [org.graylog2.periodical.PurgeExpiredCollectorsThread] periodical in [0s], polling every [3600s].
2016-05-20T12:23:56.054Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running forever.
2016-05-20T12:23:56.066Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s], polling every [3600s].
2016-05-20T12:23:56.075Z INFO  [Periodicals] Starting [org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical, running forever.
2016-05-20T12:23:56.126Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T12:23:56.127Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running forever.
2016-05-20T12:23:56.128Z INFO  [UserPermissionMigrationPeriodical] Marking user permission migration as done.
2016-05-20T12:23:56.134Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in [300s], polling every [21600s].
2016-05-20T12:23:56.134Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in [300s], polling every [21600s].
2016-05-20T12:23:56.369Z INFO  [transport] [graylog2-server] bound_address {inet[/0:0:0:0:0:0:0:0:9350]}, publish_address {inet[/172.31.48.216:9350]}
2016-05-20T12:23:56.388Z INFO  [discovery] [graylog2-server] graylog-developement/7owXNSXvRleYx9extkj3kQ
2016-05-20T12:23:59.389Z WARN  [discovery] [graylog2-server] waited for 3s and no initial state was set by the discovery
2016-05-20T12:23:59.389Z INFO  [node] [graylog2-server] started
2016-05-20T12:23:59.460Z INFO  [service] [graylog2-server] detected_master [Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]], added {[Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-receive(from master [[Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]]])
2016-05-20T12:24:01.210Z INFO  [RestApiService] Adding security context factory: <org.graylog2.security.ShiroSecurityContextFactory@60134fda>
2016-05-20T12:24:01.228Z INFO  [RestApiService] Started REST API at <http://127.0.0.1:12900/>
2016-05-20T12:24:01.229Z INFO  [ServiceManagerListener] Services are healthy
2016-05-20T12:24:01.229Z INFO  [InputSetupService] Triggering launching persisted inputs, node transitioned from Uninitialized?[LB:DEAD] to Running?[LB:ALIVE]
2016-05-20T12:24:01.230Z INFO  [ServerBootstrap] Services started, startup times in ms: {InputSetupService [RUNNING]=28, DashboardRegistryService [RUNNING]=37, MetricsReporterService [RUNNING]=37, BufferSynchronizerService [RUNNING]=49, KafkaJournal [RUNNING]=55, OutputSetupService [RUNNING]=105, PeriodicalsService [RUNNING]=136, JournalReader [RUNNING]=169, IndexerSetupService [RUNNING]=3449, RestApiService [RUNNING]=5213}
2016-05-20T12:24:01.235Z INFO  [ServerBootstrap] Graylog server up and running.
2016-05-20T12:24:06.056Z INFO  [Deflector] Did not find an deflector alias. Setting one up now.
2016-05-20T12:24:06.058Z INFO  [Deflector] There is no index target to point to. Creating one now.
2016-05-20T12:24:06.060Z INFO  [Deflector] Cycling deflector to next index now.
2016-05-20T12:24:06.060Z INFO  [Deflector] Cycling from <none> to <graylog2_0>
2016-05-20T12:24:06.098Z INFO  [Deflector] Creating index target <graylog2_0>...
2016-05-20T12:24:06.223Z INFO  [Indices] Created Graylog index template "graylog-internal" in Elasticsearch.
2016-05-20T12:24:06.507Z INFO  [Deflector] Waiting for index allocation of <graylog2_0>
2016-05-20T12:24:06.588Z INFO  [Deflector] Done!
2016-05-20T12:24:06.588Z INFO  [Deflector] Pointing deflector to new target index....
2016-05-20T12:24:06.620Z INFO  [SystemJobManager] Submitted SystemJob <bf0d6ab0-1e85-11e6-9218-124d119c25e5> [org.graylog2.indexer.ranges.CreateNewSingleIndexRangeJob]
2016-05-20T12:24:06.620Z INFO  [Deflector] Done!
2016-05-20T12:24:06.634Z INFO  [CreateNewSingleIndexRangeJob] Calculating ranges for index graylog2_0.
2016-05-20T12:24:06.738Z INFO  [MongoIndexRangeService] Calculated range of [graylog2_0] in [103ms].
2016-05-20T12:24:06.743Z INFO  [CreateNewSingleIndexRangeJob] Created ranges for index graylog2_0.
2016-05-20T12:24:06.743Z INFO  [SystemJobManager] SystemJob <bf0d6ab0-1e85-11e6-9218-124d119c25e5> [org.graylog2.indexer.ranges.CreateNewSingleIndexRangeJob] finished in 109ms.
2016-05-20T13:36:21.017Z INFO  [zen] [graylog2-server] master_left [[Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]]], reason [transport disconnected]
2016-05-20T13:36:21.035Z WARN  [zen] [graylog2-server] master left (reason = transport disconnected), current nodes: {[graylog2-server][7owXNSXvRleYx9extkj3kQ][ip-172-31-48-216][inet[/172.31.48.216:9350]]{client=true, data=false, master=false},}
2016-05-20T13:36:21.035Z INFO  [service] [graylog2-server] removed {[Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-master_failed ([Eson the Searcher][ZMVwgF-OQNGCclVbIraSig][ip-172-31-48-216][inet[/127.0.0.1:9300]])
2016-05-20T13:36:21.035Z WARN  [ClusterStateMonitor] No Elasticsearch data nodes in cluster, cluster is completely offline.
2016-05-20T13:36:27.394Z INFO  [zen] [graylog2-server] failed to send join request to master [[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]]], reason [RemoteTransportException[[Valkin][inet[/127.0.0.1:9300]][internal:discovery/zen/join]]; nested: ElasticsearchIllegalStateException[Node [[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[localhost/127.0.0.1:9300]]] not master for join request from [[graylog2-server][7owXNSXvRleYx9extkj3kQ][ip-172-31-48-216][inet[/172.31.48.216:9350]]{client=true, data=false, master=false}]]; ], tried [3] times
2016-05-20T13:36:30.411Z INFO  [service] [graylog2-server] detected_master [Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]], added {[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-receive(from master [[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]]])
2016-05-20T14:45:49.759Z INFO  [zen] [graylog2-server] master_left [[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]]], reason [transport disconnected]
2016-05-20T14:45:49.760Z WARN  [zen] [graylog2-server] master left (reason = transport disconnected), current nodes: {[graylog2-server][7owXNSXvRleYx9extkj3kQ][ip-172-31-48-216][inet[/172.31.48.216:9350]]{client=true, data=false, master=false},}
2016-05-20T14:45:49.760Z INFO  [service] [graylog2-server] removed {[Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-master_failed ([Valkin][u1U1zbGGS7qZkgRB_Kys2g][ip-172-31-48-216][inet[/127.0.0.1:9300]])
2016-05-20T14:45:49.760Z WARN  [ClusterStateMonitor] No Elasticsearch data nodes in cluster, cluster is completely offline.
2016-05-20T14:46:26.042Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:46:56.043Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:47:26.044Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:47:56.044Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:48:26.045Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:48:56.045Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:48:56.051Z INFO  [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks.
2016-05-20T14:49:26.046Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-20T14:49:32.401Z INFO  [zen] [graylog2-server] failed to send join request to master [[Grim Hunter][i2GLTbNpQrK-4YFO5PLT3A][ip-172-31-48-216][inet[/127.0.0.1:9300]]], reason [RemoteTransportException[[Grim Hunter][inet[/127.0.0.1:9300]][internal:discovery/zen/join]]; nested: ElasticsearchIllegalStateException[Node [[Grim Hunter][i2GLTbNpQrK-4YFO5PLT3A][ip-172-31-48-216][inet[localhost/127.0.0.1:9300]]] not master for join request from [[graylog2-server][7owXNSXvRleYx9extkj3kQ][ip-172-31-48-216][inet[/172.31.48.216:9350]]{client=true, data=false, master=false}]]; ], tried [3] times
2016-05-20T14:49:35.666Z INFO  [service] [graylog2-server] detected_master [Grim Hunter][i2GLTbNpQrK-4YFO5PLT3A][ip-172-31-48-216][inet[/127.0.0.1:9300]], added {[Grim Hunter][i2GLTbNpQrK-4YFO5PLT3A][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-receive(from master [[Grim Hunter][i2GLTbNpQrK-4YFO5PLT3A][ip-172-31-48-216][inet[/127.0.0.1:9300]]])
2016-05-20T14:49:36.131Z WARN  [IndexRotationThread] Deflector is not up. Not trying to point to another index.
2016-05-20T14:49:36.146Z ERROR [IndexRotationThread] Could not find current deflector target. Aborting.
org.graylog2.indexer.NoTargetIndexException
    at org.graylog2.indexer.Deflector.getNewestTargetNumber(Deflector.java:180)
    at org.graylog2.indexer.Deflector.getNewestTargetName(Deflector.java:228)
    at org.graylog2.periodical.IndexRotationThread.checkForRotation(IndexRotationThread.java:86)
    at org.graylog2.periodical.IndexRotationThread.doRun(IndexRotationThread.java:67)
    at org.graylog2.plugin.periodical.Periodical.run(Periodical.java:83)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
2016-05-21T06:54:51.199Z INFO  [Server] SIGNAL received. Shutting down.
2016-05-21T06:55:41.840Z INFO  [CmdLineTool] Loaded plugins: [Anonymous Usage Statistics 1.2.1 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]]
2016-05-21T06:55:42.023Z INFO  [CmdLineTool] Running with JVM arguments: -Xms1g -Xmx1g -XX:NewRatio=1 -XX:PermSize=128m -XX:MaxPermSize=256m -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -Dlog4j.configuration=file:///etc/graylog/server/log4j.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar -Dgraylog2.installation_source=deb
2016-05-21T06:55:46.984Z INFO  [InputBufferImpl] Message journal is enabled.
2016-05-21T06:55:47.703Z INFO  [LogManager] Loading logs.
2016-05-21T06:55:47.894Z INFO  [LogManager] Logs loading complete.
2016-05-21T06:55:47.894Z INFO  [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal
2016-05-21T06:55:47.941Z INFO  [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers.
2016-05-21T06:55:48.367Z INFO  [NodeId] Node ID: 7068c1f6-e9b7-4685-887f-43a45bfb39dc
2016-05-21T06:55:48.645Z INFO  [node] [graylog2-server] version[1.7.5], pid[926], build[00f95f4/2016-02-02T09:55:30Z]
2016-05-21T06:55:48.645Z INFO  [node] [graylog2-server] initializing ...
2016-05-21T06:55:48.811Z INFO  [plugins] [graylog2-server] loaded [graylog-monitor], sites []
2016-05-21T06:55:52.366Z INFO  [node] [graylog2-server] initialized
2016-05-21T06:55:52.779Z INFO  [Version] HV000001: Hibernate Validator 5.2.2.Final
2016-05-21T06:55:52.996Z INFO  [ProcessBuffer] Initialized ProcessBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-21T06:55:55.342Z INFO  [RulesEngineProvider] No static rules file loaded.
2016-05-21T06:55:55.366Z INFO  [OutputBuffer] Initialized OutputBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-21T06:55:56.321Z INFO  [ServerBootstrap] Graylog server 1.3.4 (0d67a80) starting up
2016-05-21T06:55:56.322Z INFO  [ServerBootstrap] JRE: Oracle Corporation 1.8.0_91 on Linux 3.13.0-74-generic
2016-05-21T06:55:56.322Z INFO  [ServerBootstrap] Deployment: deb
2016-05-21T06:55:56.322Z INFO  [ServerBootstrap] OS: Ubuntu 14.04.3 LTS (trusty)
2016-05-21T06:55:56.322Z INFO  [ServerBootstrap] Arch: amd64
2016-05-21T06:55:56.399Z INFO  [PeriodicalsService] Starting 24 periodicals ...
2016-05-21T06:55:56.414Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling every [1s].
2016-05-21T06:55:56.403Z INFO  [node] [graylog2-server] starting ...
2016-05-21T06:55:56.426Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every [60s].
2016-05-21T06:55:56.433Z INFO  [Periodicals] Starting [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in [0s], polling every [1s].
2016-05-21T06:55:56.433Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterHealthCheckThread] periodical in [0s], polling every [20s].
2016-05-21T06:55:56.433Z INFO  [Periodicals] Starting [org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running forever.
2016-05-21T06:55:56.467Z INFO  [Periodicals] Starting [org.graylog2.periodical.DeadLetterThread] periodical, running forever.
2016-05-21T06:55:56.485Z INFO  [Periodicals] Starting [org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running forever.
2016-05-21T06:55:56.492Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s], polling every [30s].
2016-05-21T06:55:56.495Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling every [300s].
2016-05-21T06:55:56.504Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every [10s].
2016-05-21T06:55:56.511Z INFO  [Periodicals] Starting [org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s].
2016-05-21T06:55:56.512Z INFO  [Periodicals] Starting [org.graylog2.periodical.StreamThroughputCounterManagerThread] periodical in [0s], polling every [1s].
2016-05-21T06:55:56.516Z INFO  [Periodicals] Starting [org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling every [1800s].
2016-05-21T06:55:56.524Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s], polling every [1s].
2016-05-21T06:55:56.533Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every [1s].
2016-05-21T06:55:56.534Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling every [300s].
2016-05-21T06:55:56.534Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running forever.
2016-05-21T06:55:56.544Z INFO  [Periodicals] Starting [org.graylog2.periodical.PurgeExpiredCollectorsThread] periodical in [0s], polling every [3600s].
2016-05-21T06:55:56.544Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running forever.
2016-05-21T06:55:56.574Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s], polling every [3600s].
2016-05-21T06:55:56.575Z INFO  [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks.
2016-05-21T06:55:56.632Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-21T06:55:56.635Z INFO  [PeriodicalsService] Not starting [org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical. Not configured to run on this node.
2016-05-21T06:55:56.635Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running forever.
2016-05-21T06:55:56.669Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in [300s], polling every [21600s].
2016-05-21T06:55:56.669Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in [300s], polling every [21600s].
2016-05-21T06:55:56.813Z INFO  [transport] [graylog2-server] bound_address {inet[/0:0:0:0:0:0:0:0:9350]}, publish_address {inet[/172.31.48.216:9350]}
2016-05-21T06:55:56.843Z INFO  [discovery] [graylog2-server] graylog-developement/u3XcsxQHTZyIEo64DT79Ow
2016-05-21T06:55:59.844Z WARN  [discovery] [graylog2-server] waited for 3s and no initial state was set by the discovery
2016-05-21T06:55:59.844Z INFO  [node] [graylog2-server] started
2016-05-21T06:55:59.962Z INFO  [service] [graylog2-server] detected_master [Dragon of the Moon][1WuHceRRTvyZNkUAvZZelw][ip-172-31-48-216][inet[/127.0.0.1:9300]], added {[Dragon of the Moon][1WuHceRRTvyZNkUAvZZelw][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-receive(from master [[Dragon of the Moon][1WuHceRRTvyZNkUAvZZelw][ip-172-31-48-216][inet[/127.0.0.1:9300]]])
2016-05-21T06:56:03.645Z INFO  [RestApiService] Adding security context factory: <org.graylog2.security.ShiroSecurityContextFactory@5433023d>
2016-05-21T06:56:03.684Z INFO  [RestApiService] Started REST API at <http://127.0.0.1:12900/>
2016-05-21T06:56:03.686Z INFO  [ServerBootstrap] Services started, startup times in ms: {BufferSynchronizerService [RUNNING]=28, OutputSetupService [RUNNING]=30, DashboardRegistryService [RUNNING]=38, MetricsReporterService [RUNNING]=41, KafkaJournal [RUNNING]=41, JournalReader [RUNNING]=47, InputSetupService [RUNNING]=65, PeriodicalsService [RUNNING]=308, IndexerSetupService [RUNNING]=3617, RestApiService [RUNNING]=7317}
2016-05-21T06:56:03.688Z INFO  [ServiceManagerListener] Services are healthy
2016-05-21T06:56:03.689Z INFO  [InputSetupService] Triggering launching persisted inputs, node transitioned from Uninitialized?[LB:DEAD] to Running?[LB:ALIVE]
2016-05-21T06:56:03.705Z INFO  [ServerBootstrap] Graylog server up and running.
2016-05-21T07:08:45.529Z ERROR [NodePingThread] Uncaught exception in periodical
com.mongodb.MongoException$Network: Read operation to server localhost:27017 failed on database graylog2
    at com.mongodb.DBTCPConnector.innerCall(DBTCPConnector.java:302)
    at com.mongodb.DBTCPConnector.call(DBTCPConnector.java:273)
    at com.mongodb.DBCollectionImpl.find(DBCollectionImpl.java:84)
    at com.mongodb.DBCollectionImpl.find(DBCollectionImpl.java:66)
    at com.mongodb.DBCollection.findOne(DBCollection.java:940)
    at com.mongodb.DBCollection.findOne(DBCollection.java:914)
    at com.mongodb.DBCollection.findOne(DBCollection.java:858)
    at org.graylog2.database.PersistedServiceImpl.findOne(PersistedServiceImpl.java:135)
    at org.graylog2.cluster.NodeServiceImpl.byNodeId(NodeServiceImpl.java:78)
    at org.graylog2.cluster.NodeServiceImpl.byNodeId(NodeServiceImpl.java:89)
    at org.graylog2.periodical.NodePingThread.doRun(NodePingThread.java:63)
    at org.graylog2.plugin.periodical.Periodical.run(Periodical.java:83)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.EOFException
    at org.bson.io.Bits.readFully(Bits.java:75)
    at org.bson.io.Bits.readFully(Bits.java:50)
    at org.bson.io.Bits.readFully(Bits.java:37)
    at com.mongodb.Response.<init>(Response.java:42)
    at com.mongodb.DBPort$1.execute(DBPort.java:164)
    at com.mongodb.DBPort$1.execute(DBPort.java:158)
    at com.mongodb.DBPort.doOperation(DBPort.java:187)
    at com.mongodb.DBPort.call(DBPort.java:158)
    at com.mongodb.DBTCPConnector.innerCall(DBTCPConnector.java:294)
    ... 18 more
2016-05-21T07:32:52.197Z INFO  [Server] SIGNAL received. Shutting down.
2016-05-21T07:33:59.612Z INFO  [CmdLineTool] Loaded plugins: [Anonymous Usage Statistics 1.2.1 [org.graylog.plugins.usagestatistics.UsageStatsPlugin]]
2016-05-21T07:34:00.485Z INFO  [CmdLineTool] Running with JVM arguments: -Xms1g -Xmx1g -XX:NewRatio=1 -XX:PermSize=128m -XX:MaxPermSize=256m -XX:+ResizeTLAB -XX:+UseConcMarkSweepGC -XX:+CMSConcurrentMTEnabled -XX:+CMSClassUnloadingEnabled -XX:+UseParNewGC -XX:-OmitStackTraceInFastThrow -Dlog4j.configuration=file:///etc/graylog/server/log4j.xml -Djava.library.path=/usr/share/graylog-server/lib/sigar -Dgraylog2.installation_source=deb
2016-05-21T07:34:44.634Z INFO  [InputBufferImpl] Message journal is enabled.
2016-05-21T07:34:45.074Z INFO  [LogManager] Loading logs.
2016-05-21T07:34:45.468Z INFO  [LogManager] Logs loading complete.
2016-05-21T07:34:45.468Z INFO  [KafkaJournal] Initialized Kafka based journal at /var/lib/graylog-server/journal
2016-05-21T07:34:45.508Z INFO  [InputBufferImpl] Initialized InputBufferImpl with ring size <65536> and wait strategy <BlockingWaitStrategy>, running 2 parallel message handlers.
2016-05-21T07:34:46.087Z INFO  [NodeId] Node ID: 7068c1f6-e9b7-4685-887f-43a45bfb39dc
2016-05-21T07:34:46.386Z INFO  [node] [graylog2-server] version[1.7.5], pid[916], build[00f95f4/2016-02-02T09:55:30Z]
2016-05-21T07:34:46.386Z INFO  [node] [graylog2-server] initializing ...
2016-05-21T07:34:46.522Z INFO  [plugins] [graylog2-server] loaded [graylog-monitor], sites []
2016-05-21T07:34:50.103Z INFO  [node] [graylog2-server] initialized
2016-05-21T07:34:50.210Z INFO  [Version] HV000001: Hibernate Validator 5.2.2.Final
2016-05-21T07:34:50.951Z INFO  [ProcessBuffer] Initialized ProcessBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-21T07:34:53.577Z INFO  [RulesEngineProvider] No static rules file loaded.
2016-05-21T07:34:53.753Z INFO  [OutputBuffer] Initialized OutputBuffer with ring size <65536> and wait strategy <BlockingWaitStrategy>.
2016-05-21T07:34:54.607Z INFO  [ServerBootstrap] Graylog server 1.3.4 (0d67a80) starting up
2016-05-21T07:34:54.608Z INFO  [ServerBootstrap] JRE: Oracle Corporation 1.8.0_91 on Linux 3.13.0-74-generic
2016-05-21T07:34:54.608Z INFO  [ServerBootstrap] Deployment: deb
2016-05-21T07:34:54.608Z INFO  [ServerBootstrap] OS: Ubuntu 14.04.3 LTS (trusty)
2016-05-21T07:34:54.608Z INFO  [ServerBootstrap] Arch: amd64
2016-05-21T07:34:54.684Z INFO  [PeriodicalsService] Starting 24 periodicals ...
2016-05-21T07:34:54.724Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThroughputCalculator] periodical in [0s], polling every [1s].
2016-05-21T07:34:54.738Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlertScannerThread] periodical in [10s], polling every [60s].
2016-05-21T07:34:54.738Z INFO  [Periodicals] Starting [org.graylog2.periodical.BatchedElasticSearchOutputFlushThread] periodical in [0s], polling every [1s].
2016-05-21T07:34:54.739Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterHealthCheckThread] periodical in [0s], polling every [20s].
2016-05-21T07:34:54.739Z INFO  [Periodicals] Starting [org.graylog2.periodical.ContentPackLoaderPeriodical] periodical, running forever.
2016-05-21T07:34:54.782Z INFO  [Periodicals] Starting [org.graylog2.periodical.DeadLetterThread] periodical, running forever.
2016-05-21T07:34:54.803Z INFO  [Periodicals] Starting [org.graylog2.periodical.GarbageCollectionWarningThread] periodical, running forever.
2016-05-21T07:34:54.811Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexerClusterCheckerThread] periodical in [0s], polling every [30s].
2016-05-21T07:34:54.813Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRetentionThread] periodical in [0s], polling every [300s].
2016-05-21T07:34:54.816Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRotationThread] periodical in [0s], polling every [10s].
2016-05-21T07:34:54.829Z INFO  [Periodicals] Starting [org.graylog2.periodical.NodePingThread] periodical in [0s], polling every [1s].
2016-05-21T07:34:54.839Z INFO  [Periodicals] Starting [org.graylog2.periodical.StreamThroughputCounterManagerThread] periodical in [0s], polling every [1s].
2016-05-21T07:34:54.841Z INFO  [Periodicals] Starting [org.graylog2.periodical.VersionCheckThread] periodical in [300s], polling every [1800s].
2016-05-21T07:34:54.844Z INFO  [Periodicals] Starting [org.graylog2.periodical.ThrottleStateUpdaterThread] periodical in [1s], polling every [1s].
2016-05-21T07:34:54.845Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventPeriodical] periodical in [0s], polling every [1s].
2016-05-21T07:34:54.846Z INFO  [Periodicals] Starting [org.graylog2.events.ClusterEventCleanupPeriodical] periodical in [0s], polling every [300s].
2016-05-21T07:34:54.846Z INFO  [Periodicals] Starting [org.graylog2.periodical.ClusterIdGeneratorPeriodical] periodical, running forever.
2016-05-21T07:34:54.846Z INFO  [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks.
2016-05-21T07:34:54.780Z INFO  [node] [graylog2-server] starting ...
2016-05-21T07:34:54.913Z INFO  [Periodicals] Starting [org.graylog2.periodical.PurgeExpiredCollectorsThread] periodical in [0s], polling every [3600s].
2016-05-21T07:34:54.913Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesMigrationPeriodical] periodical, running forever.
2016-05-21T07:34:54.913Z INFO  [Periodicals] Starting [org.graylog2.periodical.IndexRangesCleanupPeriodical] periodical in [15s], polling every [3600s].
2016-05-21T07:34:55.005Z INFO  [PeriodicalsService] Not starting [org.graylog2.periodical.UserPermissionMigrationPeriodical] periodical. Not configured to run on this node.
2016-05-21T07:34:55.005Z INFO  [Periodicals] Starting [org.graylog2.periodical.AlarmCallbacksMigrationPeriodical] periodical, running forever.
2016-05-21T07:34:55.008Z INFO  [IndexerClusterCheckerThread] Indexer not fully initialized yet. Skipping periodic cluster check.
2016-05-21T07:34:55.017Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsNodePeriodical] periodical in [300s], polling every [21600s].
2016-05-21T07:34:55.017Z INFO  [Periodicals] Starting [org.graylog.plugins.usagestatistics.UsageStatsClusterPeriodical] periodical in [300s], polling every [21600s].
2016-05-21T07:34:55.143Z INFO  [transport] [graylog2-server] bound_address {inet[/0:0:0:0:0:0:0:0:9350]}, publish_address {inet[/172.31.48.216:9350]}
2016-05-21T07:34:55.163Z INFO  [discovery] [graylog2-server] graylog-developement/w5sqyiUvSWO9lapL4mIENA
2016-05-21T07:34:58.170Z WARN  [discovery] [graylog2-server] waited for 3s and no initial state was set by the discovery
2016-05-21T07:34:58.170Z INFO  [node] [graylog2-server] started
2016-05-21T07:34:58.329Z INFO  [service] [graylog2-server] detected_master [Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]], added {[Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-receive(from master [[Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]]])
2016-05-21T07:35:02.622Z INFO  [RestApiService] Adding security context factory: <org.graylog2.security.ShiroSecurityContextFactory@272e8c58>
2016-05-21T07:35:02.660Z INFO  [RestApiService] Started REST API at <http://127.0.0.1:12900/>
2016-05-21T07:35:02.661Z INFO  [ServerBootstrap] Services started, startup times in ms: {OutputSetupService [RUNNING]=36, MetricsReporterService [RUNNING]=50, BufferSynchronizerService [RUNNING]=50, KafkaJournal [RUNNING]=51, InputSetupService [RUNNING]=69, JournalReader [RUNNING]=87, DashboardRegistryService [RUNNING]=115, PeriodicalsService [RUNNING]=359, IndexerSetupService [RUNNING]=3697, RestApiService [RUNNING]=8000}
2016-05-21T07:35:02.664Z INFO  [ServiceManagerListener] Services are healthy
2016-05-21T07:35:02.666Z INFO  [InputSetupService] Triggering launching persisted inputs, node transitioned from Uninitialized?[LB:DEAD] to Running?[LB:ALIVE]
2016-05-21T07:35:02.667Z INFO  [ServerBootstrap] Graylog server up and running.
2016-05-21T09:34:48.587Z INFO  [zen] [graylog2-server] master_left [[Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]]], reason [transport disconnected]
2016-05-21T09:34:48.605Z WARN  [zen] [graylog2-server] master left (reason = transport disconnected), current nodes: {[graylog2-server][w5sqyiUvSWO9lapL4mIENA][ip-172-31-48-216][inet[/172.31.48.216:9350]]{client=true, data=false, master=false},}
2016-05-21T09:34:48.605Z INFO  [service] [graylog2-server] removed {[Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]],}, reason: zen-disco-master_failed ([Lupo][68__DyLFQ-WlgDSLZZH_PQ][ip-172-31-48-216][inet[/127.0.0.1:9300]])
2016-05-21T09:34:48.605Z WARN  [ClusterStateMonitor] No Elasticsearch data nodes in cluster, cluster is completely offline.
2016-05-21T09:34:54.814Z INFO  [IndexRetentionThread] Elasticsearch cluster not available, skipping index retention checks.
2016-05-21T09:34:59.923Z ERROR [StreamRouter] Stream router engine update failed!
com.mongodb.MongoException$Network: Read operation to server localhost:27017 failed on database graylog2
    at com.mongodb.DBTCPConnector.innerCall(DBTCPConnector.java:302)
    at com.mongodb.DBTCPConnector.call(DBTCPConnector.java:273)
    at com.mongodb.DBCollectionImpl.find(DBCollectionImpl.java:84)
    at com.mongodb.DBCollectionImpl.find(DBCollectionImpl.java:66)
    at com.mongodb.DBCursor._check(DBCursor.java:498)
    at com.mongodb.DBCursor._hasNext(DBCursor.java:621)
joschi commented 8 years ago

@nithiya123 There are lots of error messages in those logs (MongoDB not reachable, Elasticsearch not reachable) which need to be addressed for Graylog to work.

Since it seems to be a fresh setup, I'd recommend using the official virtual machine image instead of setting everything up yourself.

We are using GitHub issues for tracking bugs in Graylog itself, but this doesn't look like one. Please post this issue to our public mailing list or join the #graylog channel on freenode IRC.

Thank you!

nithiya123 commented 8 years ago

Hey Joschi,

Pls suggest some link to configure properly bcoz am installing this in aws. pls

joschi commented 8 years ago

@nithiya123 Graylog also offers official AMIs: https://github.com/Graylog2/graylog2-images/tree/2.0/aws

nithiya123 commented 8 years ago

Hey thanks for you instant reply, AMI is fine but i need to configure GLog in in ec2 bcoz price . can you pls help me to install glog in ubuntu manually