search

cloudfoundry-community / firehose-to-syslog

Send firehose events from Cloud Foundry to syslog.
MIT License
44 stars 58 forks source link

Firehose Nozzle app experiences following issue sometimes #194

Open filidav opened 6 years ago

filidav commented 6 years ago

[2018-08-13 11:17:27.157303153 +0000 UTC] Exception occurred! Message: Error while getting summary for space %s: %v Details: Error requesting space summary: cfclient: error (10011): CF-DatabaseError

2018-08-13T07:17:27.157-04:00 [APP/PROC/WEB/0] [ERR] [2018-08-13 11:17:27.157803953 +0000 UTC] Exception occurred! Message: Error gettings Org Details: Error requesting space summary: cfclient: error (10011): CF-DatabaseError 2018-08-13T07:17:45.520-04:00 [APP/PROC/WEB/0] [ERR] [2018-08-13 11:17:45.520567053 +0000 UTC] Exception occurred! Message: Error while reading from the Firehose: Details: read tcp 10.255.252.19:52608->10.237.248.165:443: i/o timeout 2018-08-13T07:17:45.520-04:00 [APP/PROC/WEB/0] [ERR] [2018-08-13 11:17:45.520620753 +0000 UTC] Exception occurred! Message: Error while reading from the Firehose: Details: read tcp 10.255.252.19:52608->10.237.248.165:443: i/o timeout 2018-08-13T07:17:45.727-04:00 [APP/PROC/WEB/1] [ERR] [2018-08-13 11:17:45.727629091 +0000 UTC] Exception occurred! Message: Error while reading from the Firehose: Details: read tcp 10.255.34.62:56466->10.237.248.165:443: i/o timeout 2018-08-13T07:17:45.727-04:00 [APP/PROC/WEB/1] [ERR] [2018-08-13 11:17:45.727685391 +0000 UTC] Exception occurred! Message: Error while reading from the Firehose: Details: read tcp 10.255.34.62:56466->10.237.248.165:443: i/o timeout 2018-08-13T07:33:58.349-04:00 [APP/PROC/WEB/0] [ERR] [2018-08-13 11:33:58.348988303 +0000 UTC] Exception occurred! Message: Missed Logs Details: 600000 2018-08-13T07:49:30.772-04:00 [APP/PROC/WEB/1] [ERR] [2018-08-13 11:49:30.772696694 +0000 UTC] Exception occurred! Message: Missed Logs Details: 1400000 2018-08-13T07:49:33.251-04:00 [APP/PROC/WEB/0] [ERR] [2018-08-13 11:49:33.251027866 +0000 UTC] Exception occurred! Message: Missed

Stop/Start of app resolves it but then the issue comes back.

shinji62 commented 6 years ago

Are you sure your CF instances are healthy ? Do you have enough routers ? enough TC ? Doppler?

filidav commented 6 years ago

We have 4 routers Tc I believe 2 Doppler I believe 2

Need to confirm the last 2.

How can we tell if we need to scale the last two? If we scale should we double or just go up by one?

David Filippelli

On Aug 19, 2018, at 11:15 PM, Etourneau Gwenn notifications@github.com<mailto:notifications@github.com> wrote:

Are you sure your CF instances are healthy ? Do you have enough routers ? enough TC ? Doppler?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/cloudfoundry-community/firehose-to-syslog/issues/194#issuecomment-414186320, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AWJsOjNYNrulVFIjBvrK9paZmHFHqcIiks5uSinhgaJpZM4V7JGN.

STATEMENT OF CONFIDENTIALITY The information contained in this email message and any attachments may be confidential and legally privileged and is intended for the use of the addressee(s) only. If you are not an intended recipient, please: (1) notify me immediately by replying to this message; (2) do not use, disseminate, distribute or reproduce any part of the message or any attachment; and (3) destroy all copies of this message and any attachments.