cloudfoundry-community / stackdriver-tools

Stackdriver Nozzle for Cloud Foundry Loggregator, Host Monitoring Agents BOSH Release
Apache License 2.0
21 stars 13 forks source link

Tile upgrade to 2.1.0 in PCF foundation results in new warnings in logs. #251

Open richardg0510 opened 5 years ago

richardg0510 commented 5 years ago

After upgrading the Stackdriver Nozzle for PCF tile to version 2.1.0 in our PCF foundations, we are getting warnings in our logs every 20 - 30 milliseconds. The remote ip in the logs indicate they are originating from the stackdriver-nozzle job vm. After discussion with Pivotal support, they believe it is originating from a call to retrieve app metadata by the nozzle.

Here is a sample log:

35.239.40.104 - "GET https://api.system.sandbox.example.com/v2/apps/00000000-0000-0000-0000-000000000000?inline-relations-depth=2" 404 446 "Go-CF-client/1.1"
{
 httpRequest: {
  remoteIp:  "35.239.40.104"   
  requestMethod:  "GET"   
  requestSize:  "1540"   
  requestUrl:  "https://api.system.sandbox.example.com/v2/apps/00000000-0000-0000-0000-000000000000?inline-relations-depth=2"   
  responseSize:  "446"   
  serverIp:  "10.153.4.25"   
  status:  404   
  userAgent:  "Go-CF-client/1.1"   
 }
 insertId:  "ld53y7ffjcl5b"  
 jsonPayload: {
  @type:  "type.googleapis.com/google.cloud.loadbalancing.type.LoadBalancerLogEntry"   
  statusDetails:  "response_sent_by_backend"   
 }
 logName:  "projects/sandbox/logs/requests"  
 receiveTimestamp:  "2019-03-25T17:09:16.784391478Z"  
 resource: {
  labels: {
   backend_service_name:  ""    
   forwarding_rule_name:  "frontend-https"    
   project_id:  "sandbox"    
   target_proxy_name:  "pcf-router-target-proxy-2"    
   url_map_name:  "pcf-router"    
   zone:  "global"    
  }
  type:  "http_load_balancer"   
 }
 severity:  "WARNING"  
 spanId:  "9d5988d85b812386"  
 timestamp:  "2019-03-25T17:09:15.906622829Z"  
 trace:  "projects/sandbox/traces/98b0110b3875ad666dd58255791f7450"  
}

I have not been able to determine where the app guid that is used in the call is coming from.