cityindex-attic / logsearch

[unmaintained] A development environment for ELK
Apache License 2.0
24 stars 8 forks source link

Parse csv_caret format #348

Closed mrdavidlaing closed 10 years ago

mrdavidlaing commented 10 years ago

The new ActiveMQStatsLoggerConsole service ships logs encoded as CSVs, but using ^ as the separator.

eg:

Active^AverageEnqueueTime^Blocked^BlockedProducerWarningInterval^BlockedProducerWarningstringerval^BrokerId^BrokerName^BrokerVersion^ClientId^Connected^Connection^ConnectionId^ConnectorName^ConsumerCount^ConsumerId^CursorFull^CursorMemoryUsage^CursorPercentUsage^DataDirectory^DateTimeCaptured^DequeueCount^DequeueCounter^Destination^DestinationName^DestinationQueue^DestinationTemporary^DestinationTopic^DestinationType^DiscardedCount^DispachedCounter^DispatchCount^DispatchedQueueSize^Durable^DurableTopicSubscribers^EnqueueCount^EnqueueCounter^Exclusive^ExpiredCount^InFlightCount^InactiveDurableTopicSubscribers^MaxAuditDepth^MaxEnqueueTime^MaxPageSize^MaxProducersToAudit^MaximumPendingMessageLimit^MaximumPendingQueueSize^MemoryLimit^MemoryPercentUsage^MemoryUsagePortion^MessageCountAwaitingAcknowledge^MinEnqueueTime^Name^NoLocal^OpenWireURL^PendingQueueSize^Persistent^PersistentMode^PrefetchSize^PrioritizedMessages^Priority^ProducerCount^ProducerFlowControl^QueueSize^QueueSubscribers^Queues^RemoteAddress^Retroactive^SessionId^Slave^Slow^SslURL^StatisticsEnabled^StompSslURL^StompURL^StoreLimit^StorePercentUsage^SubcriptionId^Subscriptions^TempLimit^TempPercentUsage^TemporaryQueueSubscribers^TemporaryQueues^TemporaryTopicSubscribers^TemporaryTopics^TopicSubscribers^Topics^TotalConsumerCount^TotalDequeueCount^TotalEnqueueCount^TotalMessageCount^Type^UseCache^VMURL^ViewType^clientId^consumerId^destinationName^destinationType^persistentMode
^0.0^^30000^^^localhost^^^^^^^0^^^^^^2014-02-24T15:40:16.6959475+00:00^0^^ActiveMQ.Advisory.Consumer.Queue.ID_RDB-SRV-WEBL26-58703-1393147733882-0_27_1^^^^^^^^0^^^^1^^^0^0^^2048^0^200^32^^^1048576^0^0.0^^0^ActiveMQ.Advisory.Consumer.Queue.ID:RDB-SRV-WEBL26-58703-1393147733882-0:27:1^^^^^^^false^^0^true^0^^^^^^^^^^^^^^^[]^^^^^^^^^^^^^Topic^true
true^^^^^^localhost^^[Auth Check]Pooled LightStreamer Authentication Connection RDB-SRV-WEBL26(aa0ef222-f790-425a-8b66-19806d17d70b)^^^ID:RDB-SRV-WEBL26-58703-1393147733882-0:31^^^^^^^^2014-02-24T15:40:16.6959475+00:00^^306^^ID:RDB-SRV-WEBL26-58703-1393147733882-0:31:1^true^true^false^^^306^^0^false^^^306^false^^^^^^^^0^^0^^0^0^^^false^^0^^^1000^^0^^^^^^^false^1^^^^^^^^^1^^^^^^^^^^^^^^Subscription^^^^[Auth Check]Pooled LightStreamer Authentication Connection RDB-SRV-WEBL26(aa0ef222-f790-425a-8b66-19806d17d70b)^ID_RDB-SRV-WEBL26-58703-1393147733882-0_31_1_1^ID_RDB-SRV-WEBL26-58703-1393147733882-0_31_1^TempQueue^Non-Durable
true^^^^^^localhost^^ID:RDB-SRV-APPL38-60108-635286806735260097-0:0^^^ID:RDB-SRV-APPL38-60108-635286806735260097-1:0^^^^^^^^2014-02-24T15:40:16.6959475+00:00^^14797^^logEds^true^false^false^^^14797^^0^false^^^14797^false^^^^^^^^0^^0^^0^0^^^false^^0^^^1000^^0^^^^^^^false^1^^^^^^^^^1^^^^^^^^^^^^^^Subscription^^^^ID_RDB-SRV-APPL38-60108-635286806735260097-0_0^ID_RDB-SRV-APPL38-60108-635286806735260097-1_0_1_1^logEds^Queue^Non-Durable
mrdavidlaing commented 10 years ago

It wasn't possible to write a generic CSV with caret separator; so the type required is actually ci_activemq_stats_logger