varnish / varnish-modules

Collection of Varnish Cache modules (vmods) by Varnish Software
Other
182 stars 86 forks source link

Panic in vmod-saintmode with Varnish 6 #104

Closed dridi closed 6 years ago

dridi commented 6 years ago

Unfortunately the test suite doesn't trigger often, and the panic string is missing:

**** top   0.0 extmacro def pwd=/home/dridi/varnish/src/varnish-modules/src
**** top   0.0 extmacro def vmod_builddir=/home/dridi/varnish/src/varnish-modules/src
**** top   0.0 extmacro def vmod_directors=directors from "/opt/varnish/lib/varnish/vmods/libvmod_directors.so"
**** top   0.0 extmacro def localhost=127.0.0.1
**** top   0.0 extmacro def bad_backend=127.0.0.1 40461
**** top   0.0 extmacro def bad_ip=192.0.2.255
**** top   0.0 macro def tmpdir=/tmp/vtc.24107.5365ec3b
*    top   0.0 TEST ./tests/saintmode/test05.vtc starting
**   top   0.0 === varnishtest "varnish-modules issue #27"
*    top   0.0 TEST varnish-modules issue #27
**   top   0.0 === server s1 {
**   s1    0.0 Starting server
**** s1    0.0 macro def s1_addr=127.0.0.1
**** s1    0.0 macro def s1_port=42587
**** s1    0.0 macro def s1_sock=127.0.0.1 42587
*    s1    0.0 Listen on 127.0.0.1 42587
**   top   0.0 === varnish v1 -vcl+backend {
**   s1    0.0 Started on 127.0.0.1 42587
**   v1    0.0 Launch
***  v1    0.0 CMD: cd ${pwd} && exec varnishd  -d -n /tmp/vtc.24107.5365ec3b/v1 -l 2m -p auto_restart=off -p syslog_cli_traffic=off -p sigsegv_handler=on -p thread_pool_min=10 -p debug=+vtc_mode -a '127.0.0.1:0' -M '127.0.0.1 39797' -P /tmp/vtc.24107.5365ec3b/v1/varnishd.pid 
***  v1    0.0 CMD: cd /home/dridi/varnish/src/varnish-modules/src && exec varnishd  -d -n /tmp/vtc.24107.5365ec3b/v1 -l 2m -p auto_restart=off -p syslog_cli_traffic=off -p sigsegv_handler=on -p thread_pool_min=10 -p debug=+vtc_mode -a '127.0.0.1:0' -M '127.0.0.1 39797' -P /tmp/vtc.24107.5365ec3b/v1/varnishd.pid 
***  v1    0.0 PID: 24213
**** v1    0.0 macro def v1_pid=24213
**** v1    0.0 macro def v1_name=/tmp/vtc.24107.5365ec3b/v1
***  v1    0.1 debug|Debug: Platform: Linux,4.15.4-300.fc27.x86_64,x86_64,-jnone,-sdefault,-sdefault,-hcritbit
***  v1    0.1 debug|200 323     
***  v1    0.1 debug|-----------------------------
***  v1    0.1 debug|Varnish Cache CLI 1.0
***  v1    0.1 debug|-----------------------------
***  v1    0.1 debug|Linux,4.15.4-300.fc27.x86_64,x86_64,-jnone,-sdefault,-sdefault,-hcritbit
***  v1    0.1 debug|varnish-trunk revision b358d56bec6575ba3bd5407fad869883f1d958d8
***  v1    0.1 debug|
***  v1    0.1 debug|Type 'help' for command list.
***  v1    0.1 debug|Type 'quit' to close CLI session.
***  v1    0.1 debug|Type 'start' to launch worker process.
***  v1    0.1 debug|
**** v1    0.2 CLIPOLL 1 0x1 0x0
***  v1    0.2 CLI connection fd = 7
***  v1    0.2 CLI RX  107
**** v1    0.2 CLI RX|dqpzvyrewavqnuqzuhcjrnzistwhobtv
**** v1    0.2 CLI RX|
**** v1    0.2 CLI RX|Authentication required.
**** v1    0.2 CLI TX|auth d9d2d5138b1cba2da7fd151712d3d708b3f775a85d2a3d02c1538daf6a7576ab
***  v1    0.2 CLI RX  200
**** v1    0.2 CLI RX|-----------------------------
**** v1    0.2 CLI RX|Varnish Cache CLI 1.0
**** v1    0.2 CLI RX|-----------------------------
**** v1    0.2 CLI RX|Linux,4.15.4-300.fc27.x86_64,x86_64,-jnone,-sdefault,-sdefault,-hcritbit
**** v1    0.2 CLI RX|varnish-trunk revision b358d56bec6575ba3bd5407fad869883f1d958d8
**** v1    0.2 CLI RX|
**** v1    0.2 CLI RX|Type 'help' for command list.
**** v1    0.2 CLI RX|Type 'quit' to close CLI session.
**** v1    0.2 CLI RX|Type 'start' to launch worker process.
**** v1    0.2 CLI TX|vcl.inline vcl1 << %XJEIFLH|)Xspa8P
**** v1    0.2 CLI TX|vcl 4.1;
**** v1    0.2 CLI TX|backend s1 { .host = "127.0.0.1"; .port = "42587"; }
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\timport saintmode from "/home/dridi/varnish/src/varnish-modules/src/.libs/libvmod_saintmode.so";
**** v1    0.2 CLI TX|\timport directors;
**** v1    0.2 CLI TX|\timport std;
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\tsub vcl_init {
**** v1    0.2 CLI TX|\t\tnew sm = saintmode.saintmode(s1, 3);
**** v1    0.2 CLI TX|\t}
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\tsub vcl_backend_fetch {
**** v1    0.2 CLI TX|\t\tset bereq.backend = sm.backend();
**** v1    0.2 CLI TX|\t}
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\tsub vcl_backend_response {
**** v1    0.2 CLI TX|\t\tif (beresp.http.Saint == "yes") {
**** v1    0.2 CLI TX|\t\t\tsaintmode.blacklist(5s);
**** v1    0.2 CLI TX|\t\t\treturn (retry); # -> 503
**** v1    0.2 CLI TX|\t\t}
**** v1    0.2 CLI TX|\t}
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\tsub vcl_deliver {
**** v1    0.2 CLI TX|\t\tset resp.http.foo = std.healthy(sm.backend());
**** v1    0.2 CLI TX|\t\tset resp.http.foo2 = sm.is_healthy();
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|\t}
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|
**** v1    0.2 CLI TX|%XJEIFLH|)Xspa8P
***  v1    0.3 vsl|No VSL chunk found (child not started ?)
***  v1    0.4 vsl|No VSL chunk found (child not started ?)
***  v1    0.5 vsl|No VSL chunk found (child not started ?)
***  v1    0.6 vsl|No VSL chunk found (child not started ?)
***  v1    0.7 vsl|No VSL chunk found (child not started ?)
***  v1    0.8 vsl|No VSL chunk found (child not started ?)
***  v1    0.9 vsl|No VSL chunk found (child not started ?)
***  v1    1.0 vsl|No VSL chunk found (child not started ?)
***  v1    1.1 vsl|No VSL chunk found (child not started ?)
***  v1    1.2 vsl|No VSL chunk found (child not started ?)
***  v1    1.3 vsl|No VSL chunk found (child not started ?)
***  v1    1.4 vsl|No VSL chunk found (child not started ?)
***  v1    1.5 vsl|No VSL chunk found (child not started ?)
***  v1    1.6 vsl|No VSL chunk found (child not started ?)
***  v1    1.7 vsl|No VSL chunk found (child not started ?)
***  v1    1.8 vsl|No VSL chunk found (child not started ?)
***  v1    1.8 CLI RX  200
**** v1    1.8 CLI RX|VCL compiled.
**** v1    1.8 CLI TX|vcl.use vcl1
***  v1    1.8 CLI RX  200
**   v1    1.8 Start
**** v1    1.8 CLI TX|start
***  v1    1.9 debug|Debug: Child (25466) Started
***  v1    1.9 CLI RX  200
***  v1    1.9 wait-running
**** v1    1.9 CLI TX|status
***  v1    1.9 debug|Info: Child (25466) said Child starts
***  v1    1.9 CLI RX  200
**** v1    1.9 CLI RX|Child in state running
**** v1    1.9 CLI TX|debug.listen_address
***  v1    2.0 CLI RX  200
**** v1    2.0 CLI RX|127.0.0.1 43673
**** v1    2.0 CLI TX|debug.xid 999
**** v1    2.0 vsl|          0 CLI             - Rd vcl.load "vcl1" vcl_vcl1.1519919092.915862560/vgc.so 1auto
**** v1    2.0 vsl|          0 CLI             - Wr 200 55 Loaded "vcl_vcl1.1519919092.915862560/vgc.so" as "vcl1"
**** v1    2.0 vsl|          0 CLI             - Rd vcl.use "vcl1"
**** v1    2.0 vsl|          0 CLI             - Wr 200 0 
**** v1    2.0 vsl|          0 CLI             - Rd start
**** v1    2.0 vsl|          0 CLI             - Wr 200 0 
**** v1    2.0 vsl|          0 CLI             - Rd debug.listen_address 
**** v1    2.0 vsl|          0 CLI             - Wr 200 16 127.0.0.1 43673

***  v1    2.0 CLI RX  200
**** v1    2.0 CLI RX|XID is 999
**** v1    2.0 CLI TX|debug.listen_address
***  v1    2.0 CLI RX  200
**** v1    2.0 CLI RX|127.0.0.1 43673
**   v1    2.0 Listen on 127.0.0.1 43673
**** v1    2.0 macro def v1_addr=127.0.0.1
**** v1    2.0 macro def v1_port=43673
**** v1    2.0 macro def v1_sock=127.0.0.1 43673
**   top   2.0 === client c1 {
**   top   2.0 === client c1 -run
**   c1    2.0 Starting client
**   c1    2.0 Waiting for client
***  c1    2.0 Connect to 127.0.0.1 43673
***  c1    2.0 connected fd 17 from 127.0.0.1 42710 to 127.0.0.1 43673
**   c1    2.0 === txreq -url "/a"
**** c1    2.0 txreq|GET /a HTTP/1.1\r
**** c1    2.0 txreq|\r
**   c1    2.0 === rxresp
***  s1    2.0 accepted fd 5 127.0.0.1 46420
**   s1    2.0 === rxreq
**** s1    2.0 rxhdr|GET /a HTTP/1.1\r
**** s1    2.0 rxhdr|X-Forwarded-For: 127.0.0.1\r
**** s1    2.0 rxhdr|Accept-Encoding: gzip\r
**** s1    2.0 rxhdr|X-Varnish: 1002\r
**** s1    2.0 rxhdr|Host: 127.0.0.1\r
**** s1    2.0 rxhdr|\r
**** s1    2.0 rxhdrlen = 104
**** s1    2.0 http[ 0] |GET
**** s1    2.0 http[ 1] |/a
**** s1    2.0 http[ 2] |HTTP/1.1
**** s1    2.0 http[ 3] |X-Forwarded-For: 127.0.0.1
**** s1    2.0 http[ 4] |Accept-Encoding: gzip
**** s1    2.0 http[ 5] |X-Varnish: 1002
**** s1    2.0 http[ 6] |Host: 127.0.0.1
**** s1    2.0 bodylen = 0
**   s1    2.0 === expect req.url == "/a"
**** s1    2.0 EXPECT req.url (/a) == "/a" match
**   s1    2.0 === txresp -hdr "Saint: yes"
**** s1    2.0 txresp|HTTP/1.1 200 OK\r
**** s1    2.0 txresp|Saint: yes\r
**** s1    2.0 txresp|Content-Length: 0\r
**** s1    2.0 txresp|\r
**   s1    2.0 === rxreq
**** v1    2.1 vsl|          0 CLI             - Rd debug.xid 999 
**** v1    2.1 vsl|          0 CLI             - Wr 200 10 XID is 999
**** v1    2.1 vsl|          0 CLI             - Rd debug.listen_address 
**** v1    2.1 vsl|          0 CLI             - Wr 200 16 127.0.0.1 43673

**** v1    2.1 vsl|       1000 Begin           c sess 0 HTTP/1
**** v1    2.1 vsl|       1000 SessOpen        c 127.0.0.1 42710 a0 127.0.0.1 43673 1519919094.794819 26
**** v1    2.1 vsl|       1000 Link            c req 1001 rxreq
**** v1    2.1 vsl|       1002 Begin           b bereq 1001 fetch
**** v1    2.1 vsl|       1002 Timestamp       b Start: 1519919094.794946 0.000000 0.000000
**** v1    2.1 vsl|       1002 BereqMethod     b GET
**** v1    2.1 vsl|       1002 BereqURL        b /a
**** v1    2.1 vsl|       1002 BereqProtocol   b HTTP/1.1
**** v1    2.1 vsl|       1002 BereqHeader     b X-Forwarded-For: 127.0.0.1
**** v1    2.1 vsl|       1002 BereqHeader     b Accept-Encoding: gzip
**** v1    2.1 vsl|       1002 BereqHeader     b X-Varnish: 1002
**** v1    2.1 vsl|       1002 VCL_call        b BACKEND_FETCH
**** v1    2.1 vsl|       1002 VCL_return      b fetch
**** v1    2.1 vsl|       1002 BereqHeader     b Host: 127.0.0.1
**** v1    2.1 vsl|       1002 BackendOpen     b 29 vcl1.s1 127.0.0.1 42587 127.0.0.1 46420
**** v1    2.1 vsl|       1002 BackendStart    b 127.0.0.1 42587
**** v1    2.1 vsl|       1002 Timestamp       b Bereq: 1519919094.795177 0.000231 0.000231
**** v1    2.1 vsl|       1002 Timestamp       b Beresp: 1519919094.795595 0.000649 0.000418
**** v1    2.1 vsl|       1002 BerespProtocol  b HTTP/1.1
**** v1    2.1 vsl|       1002 BerespStatus    b 200
**** v1    2.1 vsl|       1002 BerespReason    b OK
**** v1    2.1 vsl|       1002 BerespHeader    b Saint: yes
**** v1    2.1 vsl|       1002 BerespHeader    b Content-Length: 0
**** v1    2.1 vsl|       1002 BerespHeader    b Date: Thu, 01 Mar 2018 15:44:54 GMT
**** v1    2.1 vsl|       1002 TTL             b RFC 120 10 0 1519919095 1519919095 1519919094 0 0
**** v1    2.1 vsl|       1002 VCL_call        b BACKEND_RESPONSE
**** v1    2.1 vsl|       1002 VCL_Log         b saintmode: object put on blacklist for backend s1 for 5.00 seconds
**** v1    2.1 vsl|       1002 VCL_return      b retry
**** v1    2.1 vsl|       1002 BackendReuse    b 29 vcl1.s1
**** v1    2.1 vsl|       1002 Timestamp       b Retry: 1519919094.805789 0.010843 0.010194
**** v1    2.1 vsl|       1002 Link            b bereq 1003 retry
**** v1    2.1 vsl|       1002 End             b 
**** v1    2.1 vsl|       1003 Begin           b bereq 1002 retry
**** v1    2.1 vsl|       1003 Timestamp       b Start: 1519919094.805789 0.010843 0.000000
**** v1    2.1 vsl|       1003 BereqMethod     b GET
**** v1    2.1 vsl|       1003 BereqURL        b /a
**** v1    2.1 vsl|       1003 BereqProtocol   b HTTP/1.1
**** v1    2.1 vsl|       1003 BereqHeader     b X-Forwarded-For: 127.0.0.1
**** v1    2.1 vsl|       1003 BereqHeader     b Accept-Encoding: gzip
**** v1    2.1 vsl|       1003 BereqHeader     b X-Varnish: 1002
**** v1    2.1 vsl|       1003 BereqHeader     b Host: 127.0.0.1
**** v1    2.1 vsl|       1003 BereqUnset      b X-Varnish: 1002
**** v1    2.1 vsl|       1003 BereqHeader     b X-Varnish: 1003
**** v1    2.1 vsl|       1003 VCL_call        b BACKEND_FETCH
**** v1    2.1 vsl|       1003 VCL_return      b fetch
**** v1    2.1 vsl|       1003 VCL_Log         b saintmode: unhealthy: object blacklisted for backend s1
**** v1    2.1 vsl|       1003 FetchError      b Director sm returned no backend
**** v1    2.1 vsl|       1003 FetchError      b No backend
**** v1    2.1 vsl|       1003 Timestamp       b Beresp: 1519919094.805806 0.010860 0.000017
**** v1    2.1 vsl|       1003 Timestamp       b Error: 1519919094.805809 0.010863 0.000003
**** v1    2.1 vsl|       1003 BerespProtocol  b HTTP/1.1
**** v1    2.1 vsl|       1003 BerespStatus    b 503
**** v1    2.1 vsl|       1003 BerespReason    b Service Unavailable
**** v1    2.1 vsl|       1003 BerespReason    b Backend fetch failed
**** v1    2.1 vsl|       1003 BerespHeader    b Date: Thu, 01 Mar 2018 15:44:54 GMT
**** v1    2.1 vsl|       1003 BerespHeader    b Server: Varnish
**** v1    2.1 vsl|       1003 VCL_call        b BACKEND_ERROR
**** v1    2.1 vsl|       1003 BerespHeader    b Content-Type: text/html; charset=utf-8
**** v1    2.1 vsl|       1003 BerespHeader    b Retry-After: 5
**** v1    2.1 vsl|       1003 VCL_return      b deliver
**** v1    2.1 vsl|       1003 Storage         b malloc Transient
**** v1    2.1 vsl|       1003 ObjProtocol     b HTTP/1.1
**** v1    2.1 vsl|       1003 ObjStatus       b 503
**** v1    2.1 vsl|       1003 ObjReason       b Backend fetch failed
**** v1    2.1 vsl|       1003 ObjHeader       b Date: Thu, 01 Mar 2018 15:44:54 GMT
**** v1    2.1 vsl|       1003 ObjHeader       b Server: Varnish
**** v1    2.1 vsl|       1003 ObjHeader       b Content-Type: text/html; charset=utf-8
**** v1    2.1 vsl|       1003 ObjHeader       b Retry-After: 5
**** v1    2.1 vsl|       1003 Length          b 281
**** v1    2.1 vsl|       1003 BereqAcct       b 104 0 104 50 0 50
**** v1    2.1 vsl|       1003 End             b 
**** v1    2.1 vsl|          0 ExpKill         - EXP_Inbox flg=1e p=0x7f6d7be14000 e=0.000000000 f=0x0
**** v1    2.1 vsl|          0 ExpKill         - EXP_When p=0x7f6d7be14000 e=1519919094.805808544 f=0x1e
**** v1    2.1 vsl|          0 ExpKill         - EXP_expire p=0x7f6d7be14000 e=-0.000073433 f=0x0
**** v1    2.1 vsl|          0 ExpKill         - EXP_Expired x=1003 t=-0
**** v1    2.1 vsl|       1001 Begin           c req 1000 rxreq
**** v1    2.1 vsl|       1001 Timestamp       c Start: 1519919094.794872 0.000000 0.000000
**** v1    2.1 vsl|       1001 Timestamp       c Req: 1519919094.794872 0.000000 0.000000
**** v1    2.1 vsl|       1001 ReqStart        c 127.0.0.1 42710 a0
**** v1    2.1 vsl|       1001 ReqMethod       c GET
**** v1    2.1 vsl|       1001 ReqURL          c /a
**** v1    2.1 vsl|       1001 ReqProtocol     c HTTP/1.1
**** v1    2.1 vsl|       1001 ReqHeader       c X-Forwarded-For: 127.0.0.1
**** v1    2.1 vsl|       1001 VCL_call        c RECV
**** v1    2.1 vsl|       1001 VCL_return      c hash
**** v1    2.1 vsl|       1001 VCL_call        c HASH
**** v1    2.1 vsl|       1001 VCL_return      c lookup
**** v1    2.1 vsl|       1001 VCL_call        c MISS
**** v1    2.1 vsl|       1001 VCL_return      c fetch
**** v1    2.1 vsl|       1001 Link            c bereq 1002 fetch
**** v1    2.1 vsl|       1001 Timestamp       c Fetch: 1519919094.805865 0.010993 0.010993
**** v1    2.1 vsl|       1001 RespProtocol    c HTTP/1.1
**** v1    2.1 vsl|       1001 RespStatus      c 503
**** v1    2.1 vsl|       1001 RespReason      c Backend fetch failed
**** v1    2.1 vsl|       1001 RespHeader      c Date: Thu, 01 Mar 2018 15:44:54 GMT
**** v1    2.1 vsl|       1001 RespHeader      c Server: Varnish
**** v1    2.1 vsl|       1001 RespHeader      c Content-Type: text/html; charset=utf-8
**** v1    2.1 vsl|       1001 RespHeader      c Retry-After: 5
**** v1    2.1 vsl|       1001 RespHeader      c X-Varnish: 1001
**** v1    2.1 vsl|       1001 RespHeader      c Age: 0
**** v1    2.1 vsl|       1001 RespHeader      c Via: 1.1 varnish (Varnish/5.2)
**** v1    2.1 vsl|       1001 VCL_call        c DELIVER
---- s1    2.4 HTTP rx EOF (fd:5 read: Success) 1
---- c1    2.4 HTTP rx EOF (fd:17 read: Success) 1
*    top   2.4 RESETTING after ./tests/saintmode/test05.vtc
**   s1    2.4 Waiting for server (4/-1)
**   v1    2.4 Wait
**** v1    2.4 CLI TX|panic.clear
***  v1    3.4 debug|Error: Child (25466) died signal=6 (core dumped)
***  v1    3.4 CLI RX  200
---- v1    3.4 Unexpected panic
*    top   3.4 failure during reset
#    top  TEST ./tests/saintmode/test05.vtc FAILED (3.375) exit=2
FAIL tests/saintmode/test05.vtc (exit status: 2)

This is a reminder for before the next release.

dridi commented 6 years ago

This time I have the panic message:

***  v1    2.3 debug|Error: Child (601) Panic at: Thu, 01 Mar 2018 15:51:08 GMT
***  v1    2.3 debug|Wrong turn at cache/cache_director.c:281:
***  v1    2.3 debug|Wrong admin health
***  v1    2.3 debug|version = varnish-trunk revision b358d56bec6575ba3bd5407fad869883f1d958d8, vrt api = 6.2
***  v1    2.3 debug|ident = Linux,4.15.4-300.fc27.x86_64,x86_64,-jnone,-sdefault,-sdefault,-hcritbit,epoll
***  v1    2.3 debug|now = 283003.931908 (mono), 1519919467.974179 (real)
***  v1    2.3 debug|Backtrace:
***  v1    2.3 debug|  0x437c9b: varnishd() [0x437c9b]
***  v1    2.3 debug|  0x494b80: varnishd(VAS_Fail+0x40) [0x494b80]
***  v1    2.3 debug|  0x4202b5: varnishd() [0x4202b5]
***  v1    2.3 debug|  0x4202f0: varnishd(VRT_Healthy+0x30) [0x4202f0]
***  v1    2.3 debug|  0x7fc9335fb07b: vcl_vcl1.1519919466.123938084/vgc.so(VGC_function_vcl_deliver+0x3b) [0x7fc9335fb07b]
***  v1    2.3 debug|  0x446c1c: varnishd() [0x446c1c]
***  v1    2.3 debug|  0x448bdd: varnishd(VCL_deliver_method+0x5d) [0x448bdd]
***  v1    2.3 debug|  0x43bfa6: varnishd(CNT_Request+0xc46) [0x43bfa6]
***  v1    2.3 debug|  0x45c487: varnishd() [0x45c487]
***  v1    2.3 debug|  0x4529d7: varnishd() [0x4529d7]
***  v1    2.3 debug|thread = (cache-worker)
***  v1    2.3 debug|thr.req = 0x7fc930e2f3e0 {
***  v1    2.3 debug|  vxid = 1001, transport = HTTP/1 {
***  v1    2.3 debug|    state = HTTP1::Proc
***  v1    2.3 debug|  }
***  v1    2.3 debug|  step = R_STP_DELIVER,
***  v1    2.3 debug|  req_body = R_BODY_NONE,
***  v1    2.3 debug|  restarts = 0, esi_level = 0,
***  v1    2.3 debug|  sp = 0x7fc930c0d420 {
***  v1    2.3 debug|    fd = 26, vxid = 1000,
***  v1    2.3 debug|    t_open = 1519919467.962919,
***  v1    2.3 debug|    t_idle = 1519919467.962919,
***  v1    2.3 debug|    ws = 0x7fc930c0d460 {
***  v1    2.3 debug|      id = \"ses\",
***  v1    2.3 debug|      {s, f, r, e} = {0x7fc930c0d498, +96, (nil), +352},
***  v1    2.3 debug|    },
***  v1    2.3 debug|    transport = HTTP/1 {
***  v1    2.3 debug|      state = HTTP1::Proc
***  v1    2.3 debug|    }
***  v1    2.3 debug|    client = 127.0.0.1 48772 127.0.0.1:43663,
***  v1    2.3 debug|  },
***  v1    2.3 debug|  worker = 0x7fc93ca24980 {
***  v1    2.3 debug|    ws = 0x7fc93ca24a28 {
***  v1    2.3 debug|      id = \"wrk\",
***  v1    2.3 debug|      {s, f, r, e} = {0x7fc93ca24140, +0, (nil), +2040},
***  v1    2.3 debug|    },
***  v1    2.3 debug|    VCL::method = inside DELIVER,
***  v1    2.3 debug|    VCL::return = 0x0,
***  v1    2.3 debug|    VCL::methods = {RECV, HASH, MISS, DELIVER},
***  v1    2.3 debug|  },
***  v1    2.3 debug|  ws = 0x7fc930e2f580 {
***  v1    2.3 debug|    id = \"req\",
***  v1    2.3 debug|    {s, f, r, e} = {0x7fc930e313f0, +96, (nil), +57288},
***  v1    2.3 debug|  },
***  v1    2.3 debug|  http_conn = 0x7fc930e2f4f0 {
***  v1    2.3 debug|    fd = 26 (@0x7fc930c0d444),
***  v1    2.3 debug|    doclose = NULL,
***  v1    2.3 debug|    ws = 0x7fc930e2f580 {
***  v1    2.3 debug|      [Already dumped, see above]
***  v1    2.3 debug|    },
***  v1    2.3 debug|    {rxbuf_b, rxbuf_e} = {0x7fc930e313f0, 0x7fc930e31403},
***  v1    2.3 debug|    {pipeline_b, pipeline_e} = {(nil), (nil)},
***  v1    2.3 debug|    content_length = -1,
***  v1    2.3 debug|    body_status = none,
***  v1    2.3 debug|    first_byte_timeout = 0.000000,
***  v1    2.3 debug|    between_bytes_timeout = 0.000000,
***  v1    2.3 debug|  },
***  v1    2.3 debug|  http[req] = 0x7fc930e2f620 {
***  v1    2.3 debug|    ws = 0x7fc930e2f580 {
***  v1    2.3 debug|      [Already dumped, see above]
***  v1    2.3 debug|    },
***  v1    2.3 debug|    hdrs {
***  v1    2.3 debug|      \"GET\",
***  v1    2.3 debug|      \"/a\",
***  v1    2.3 debug|      \"HTTP/1.1\",
***  v1    2.3 debug|      \"X-Forwarded-For: 127.0.0.1\",
***  v1    2.3 debug|    },
***  v1    2.3 debug|  },
***  v1    2.3 debug|  http[resp] = 0x7fc930e2ff10 {
***  v1    2.3 debug|    ws = 0x7fc930e2f580 {
***  v1    2.3 debug|      [Already dumped, see above]
***  v1    2.3 debug|    },
***  v1    2.3 debug|    hdrs {
***  v1    2.3 debug|      \"HTTP/1.1\",
***  v1    2.3 debug|      \"503\",
***  v1    2.3 debug|      \"Backend fetch failed\",
***  v1    2.3 debug|      \"Date: Thu, 01 Mar 2018 15:51:07 GMT\",
***  v1    2.3 debug|      \"Server: Varnish\",
***  v1    2.3 debug|      \"Content-Type: text/html; charset=utf-8\",
***  v1    2.3 debug|      \"Retry-After: 5\",
***  v1    2.3 debug|      \"X-Varnish: 1001\",
***  v1    2.3 debug|      \"Age: 0\",
***  v1    2.3 debug|      \"Via: 1.1 varnish (Varnish/5.2)\",
***  v1    2.3 debug|    },
***  v1    2.3 debug|  },
***  v1    2.3 debug|  vcl = {
***  v1    2.3 debug|    name = \"vcl1\",
***  v1    2.3 debug|    busy = 1,
***  v1    2.3 debug|    discard = 0,
***  v1    2.3 debug|    state = auto,
***  v1    2.3 debug|    temp = warm,
***  v1    2.3 debug|    conf = {
***  v1    2.3 debug|      srcname = {
***  v1    2.3 debug|        \"<vcl.inline>\",
***  v1    2.3 debug|        \"Builtin\",
***  v1    2.3 debug|      },
***  v1    2.3 debug|    },
***  v1    2.3 debug|  },
***  v1    2.3 debug|  vmods = {
***  v1    2.3 debug|    saintmode = {Varnish trunk b358d56bec6575ba3bd5407fad869883f1d958d8, 6.2},
***  v1    2.3 debug|    directors = {Varnish trunk b358d56bec6575ba3bd5407fad869883f1d958d8, 0.0},
***  v1    2.3 debug|    std = {Varnish trunk b358d56bec6575ba3bd5407fad869883f1d958d8, 0.0},
***  v1    2.3 debug|  },
***  v1    2.3 debug|  objcore[REQ] = 0x7fc930414000 {
***  v1    2.3 debug|    refcnt = 1,
***  v1    2.3 debug|    flags = {dying},
***  v1    2.3 debug|    exp_flags = {},
***  v1    2.3 debug|    exp = {1519919467.974055, 0.000000, 0.000000, 0.000000},
***  v1    2.3 debug|    objhead = 0x7fc93041a000,
***  v1    2.3 debug|    stevedore = 0x7fc93b0c40c0 (malloc Transient) {
***  v1    2.3 debug|      Simple = 0x7fc930232000,
***  v1    2.3 debug|      Obj = 0x7fc930237008 {priv=0x7fc930237000, ptr=0x7fc930232000, len=272, space=272},
***  v1    2.3 debug|      LEN = 0x0000000000000119,
***  v1    2.3 debug|      VXID = 0x000003eb,
***  v1    2.3 debug|      FLAGS = 0x00,
***  v1    2.3 debug|      GZIPBITS = 0x0...0,
***  v1    2.3 debug|      LASTMODIFIED = 0x41d6a6085ac00000,
***  v1    2.3 debug|      VARY = {len=0, ptr=(nil)},
***  v1    2.3 debug|      HEADERS = {len=152, ptr=0x7fc930232078},
***  v1    2.3 debug|      Body = 0x7fc930237058 {priv=0x7fc930237050, ptr=0x7fc930232140, len=281, space=281},
***  v1    2.3 debug|    },
***  v1    2.3 debug|  },
***  v1    2.3 debug|  flags = {
***  v1    2.3 debug|  },
***  v1    2.3 debug|  privs = 0x7fc930e2f608 {
***  v1    2.3 debug|  },
***  v1    2.3 debug|},
***  v1    2.3 debug|thr.busyobj = (nil) {
***  v1    2.3 debug|},

This is related to admin health being at the director level instead of the backend level.