stress: failed test in cockroach/sql/distsql/distsql.test: TestClusterFlow

Binary: cockroach/static-tests.tar.gz sha: https://github.com/cockroachdb/cockroach/commits/4a0d487e07434360add95e2a33341c930d442a94

Stress build found a failed test:

=== RUN   TestClusterFlow
I160807 05:16:22.909094 storage/engine/rocksdb.go:353  opening in memory rocksdb instance
W160807 05:16:22.920043 gossip/gossip.go:1015  not connected to cluster; use --join to specify a connected node
I160807 05:16:22.920996 server/node.go:403  store store=0:0 not bootstrapped
I160807 05:16:22.925296 storage/replica_trigger.go:308  store=1:1 range=1 [/Min-/Max): new range lease replica {1 1 1} 1970-01-01 00:00:00 +0000 UTC 408485h16m27.424369669s following replica {0 0 0} 1970-01-01 00:00:00 +0000 UTC 0s [physicalTime=2016-08-07 05:16:22.925163191 +0000 UTC]
I160807 05:16:22.926887 server/node.go:333  **** cluster {90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44} has been created
I160807 05:16:22.926938 server/node.go:334  **** add additional nodes by specifying --join=127.0.0.1:33302
I160807 05:16:22.952169 storage/store.go:2696  system config not yet available
I160807 05:16:22.952241 server/node.go:416  initialized store store=1:1: {Capacity:536870912 Available:536870912 RangeCount:0}
I160807 05:16:22.952264 server/node.go:306  node ID 1 initialized
I160807 05:16:22.952323 storage/stores.go:302  read 0 node addresses from persistent storage
I160807 05:16:22.952429 server/node.go:541  connecting to gossip network to verify cluster ID...
I160807 05:16:22.953116 server/node.go:562  node connected via gossip and verified as part of cluster {"90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44"}
I160807 05:16:22.953171 server/node.go:355  node=1: started with [[]=] engine(s) and attributes []
I160807 05:16:22.953215 server/server.go:432  starting https server at 127.0.0.1:38259
I160807 05:16:22.953242 server/server.go:433  starting grpc/postgres server at 127.0.0.1:33302
I160807 05:16:22.954123 sql/event_log.go:109  Event: "node_join", target: 1, info: {Descriptor:{NodeID:1 Address:{NetworkField:tcp AddressField:127.0.0.1:33302} Attrs:} ClusterID:{UUID:90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44} StartedAt:1470546982953130863}
I160807 05:16:22.971044 storage/engine/rocksdb.go:353  opening in memory rocksdb instance
W160807 05:16:23.002739 gossip/gossip.go:1015  not connected to cluster; use --join to specify a connected node
I160807 05:16:23.003993 sql/event_log.go:109  Event: "node_join", target: 1, info: {Descriptor:{NodeID:1 Address:{NetworkField:tcp AddressField:127.0.0.1:33302} Attrs:} ClusterID:{UUID:90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44} StartedAt:1470546982953130863}
I160807 05:16:23.037514 server/node.go:403  store store=0:0 not bootstrapped
I160807 05:16:23.037546 storage/stores.go:302  read 0 node addresses from persistent storage
I160807 05:16:23.037579 server/node.go:541  connecting to gossip network to verify cluster ID...
I160807 05:16:23.037819 gossip/client.go:75  starting client to 127.0.0.1:33302
I160807 05:16:23.069568 storage/stores.go:317  wrote 1 node addresses to persistent storage
I160807 05:16:23.070033 server/node.go:562  node connected via gossip and verified as part of cluster {"90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44"}
I160807 05:16:23.071660 kv/dist_sender.go:329  unable to determine this node's attributes for replica selection; node is most likely bootstrapping
I160807 05:16:23.072707 server/node.go:300  new node allocated ID 2
I160807 05:16:23.072780 server/node.go:355  node=2: started with [[]=] engine(s) and attributes []
I160807 05:16:23.072942 sql/event_log.go:109  Event: "node_join", target: 2, info: {Descriptor:{NodeID:2 Address:{NetworkField:tcp AddressField:127.0.0.1:35558} Attrs:} ClusterID:{UUID:90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44} StartedAt:1470546983072757657}
I160807 05:16:23.074650 storage/stores.go:317  wrote 1 node addresses to persistent storage
I160807 05:16:23.076435 server/node.go:522  bootstrapped store store=2:2
I160807 05:16:23.077439 server/server.go:432  starting https server at 127.0.0.1:44155
I160807 05:16:23.077651 server/server.go:433  starting grpc/postgres server at 127.0.0.1:35558
I160807 05:16:23.095183 storage/engine/rocksdb.go:353  opening in memory rocksdb instance
W160807 05:16:23.098271 gossip/gossip.go:1015  not connected to cluster; use --join to specify a connected node
I160807 05:16:23.099271 server/node.go:403  store store=0:0 not bootstrapped
I160807 05:16:23.099298 storage/stores.go:302  read 0 node addresses from persistent storage
I160807 05:16:23.099335 server/node.go:541  connecting to gossip network to verify cluster ID...
I160807 05:16:23.099513 gossip/client.go:75  starting client to 127.0.0.1:33302
I160807 05:16:23.119505 storage/stores.go:317  wrote 1 node addresses to persistent storage
I160807 05:16:23.119561 storage/stores.go:317  wrote 2 node addresses to persistent storage
I160807 05:16:23.119734 server/node.go:562  node connected via gossip and verified as part of cluster {"90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44"}
I160807 05:16:23.121788 kv/dist_sender.go:329  unable to determine this node's attributes for replica selection; node is most likely bootstrapping
I160807 05:16:23.122580 server/node.go:300  new node allocated ID 3
I160807 05:16:23.122656 server/node.go:355  node=3: started with [[]=] engine(s) and attributes []
I160807 05:16:23.122685 server/server.go:432  starting https server at 127.0.0.1:34616
I160807 05:16:23.122700 server/server.go:433  starting grpc/postgres server at 127.0.0.1:37297
I160807 05:16:23.123073 storage/stores.go:317  wrote 2 node addresses to persistent storage
I160807 05:16:23.123296 storage/stores.go:317  wrote 2 node addresses to persistent storage
I160807 05:16:23.123387 sql/event_log.go:109  Event: "node_join", target: 3, info: {Descriptor:{NodeID:3 Address:{NetworkField:tcp AddressField:127.0.0.1:37297} Attrs:} ClusterID:{UUID:90269ea5-e4e3-4f39-9ecd-8af9f7ae2c44} StartedAt:1470546983122637230}
I160807 05:16:23.124665 server/node.go:522  bootstrapped store store=3:3
panic: close of closed channel [recovered]
    panic: close of closed channel

goroutine 243 [running]:
panic(0x14ac720, 0xc420c1a7d0)
    /usr/local/go/src/runtime/panic.go:500 +0x1a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).Recover(0xc420232090)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:176 +0x6e
panic(0x14ac720, 0xc420c1a7d0)
    /usr/local/go/src/runtime/panic.go:458 +0x243
github.com/cockroachdb/cockroach/testutils/testcluster.(*TestCluster).waitForStores.func1(0xc420808170, 0x7, 0xc4200f4880, 0x37, 0x40, 0x14686eb09aab4d55, 0x0)
    /go/src/github.com/cockroachdb/cockroach/testutils/testcluster/testcluster.go:180 +0x16c
github.com/cockroachdb/cockroach/gossip.(*infoStore).runCallbacks.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:266 +0xa5
github.com/cockroachdb/cockroach/gossip.(*infoStore).runCallbacks.func2()
    /go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:288 +0xdf
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask.func1(0xc420232090, 0x1bbf7fb, 0x13, 0x122, 0xc4208080a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:231 +0x95
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:232 +0xbc

goroutine 1 [chan receive]:
testing.(*T).Run(0xc4201ac180, 0x15df0eb, 0xf, 0x17014e8, 0xc4202a5ce0)
    /usr/local/go/src/testing/testing.go:647 +0x316
testing.RunTests.func1(0xc4201ac180)
    /usr/local/go/src/testing/testing.go:793 +0x6d
testing.tRunner(0xc4201ac180, 0xc42072fe00)
    /usr/local/go/src/testing/testing.go:610 +0x81
testing.RunTests(0x1702fc0, 0x1ecbd00, 0x8, 0x8, 0x2257890)
    /usr/local/go/src/testing/testing.go:799 +0x2f5
testing.(*M).Run(0xc42072fef8, 0x2257480)
    /usr/local/go/src/testing/testing.go:743 +0x85
github.com/cockroachdb/cockroach/sql/distsql_test.TestMain(0xc42072fef8)
    /go/src/github.com/cockroachdb/cockroach/sql/distsql/main_test.go:36 +0xbd
main.main()
    github.com/cockroachdb/cockroach/sql/distsql/_test/_testmain.go:68 +0xc6

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
    /usr/local/go/src/runtime/asm_amd64.s:2086 +0x1

goroutine 5 [chan receive]:
github.com/cockroachdb/cockroach/util/log.(*loggingT).flushDaemon(0x220a040)
    /go/src/github.com/cockroachdb/cockroach/util/log/clog.go:1015 +0x77
created by github.com/cockroachdb/cockroach/util/log.init.1
    /go/src/github.com/cockroachdb/cockroach/util/log/clog.go:598 +0x95

goroutine 36 [runnable]:
github.com/cockroachdb/pq.ParseURL(0xc4206fe240, 0xba, 0x15dbd00, 0xb, 0xc420217501, 0x0)
    /go/src/github.com/cockroachdb/pq/url.go:32
github.com/cockroachdb/pq.DialOpen(0x1ee1080, 0x2257890, 0xc4206fe240, 0xba, 0x0, 0x0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/pq/conn.go:273 +0x353
github.com/cockroachdb/pq.Open(0xc4206fe240, 0xba, 0xc4206c9200, 0x643aa0, 0xc420058a50, 0x15)
    /go/src/github.com/cockroachdb/pq/conn.go:246 +0x70
github.com/cockroachdb/pq.(*drv).Open(0x2257890, 0xc4206fe240, 0xba, 0x0, 0x0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/pq/conn.go:45 +0x35
database/sql.(*DB).conn(0xc4204b20b0, 0xb0000006e5301, 0x40, 0x9, 0x7f6270bb7a00)
    /usr/local/go/src/database/sql/sql.go:824 +0x24e
database/sql.(*DB).exec(0xc4204b20b0, 0xc4206fa000, 0x7e, 0x0, 0x0, 0x0, 0x1, 0x0, 0x0, 0x0, ...)
    /usr/local/go/src/database/sql/sql.go:1022 +0x97
database/sql.(*DB).Exec(0xc4204b20b0, 0xc4206fa000, 0x7e, 0x0, 0x0, 0x0, 0xc4203b4e00, 0x0, 0x0, 0xc4203b4dc8)
    /usr/local/go/src/database/sql/sql.go:1010 +0xa2
github.com/cockroachdb/cockroach/testutils/sqlutils.(*SQLRunner).Exec(0xc4203b4e80, 0xc4206fa000, 0x7e, 0x0, 0x0, 0x0, 0x7e, 0xc4206e2200)
    /go/src/github.com/cockroachdb/cockroach/testutils/sqlutils/sql_runner.go:38 +0x85
github.com/cockroachdb/cockroach/testutils/sqlutils.CreateTable(0xc4201ac240, 0xc4204b20b0, 0x15d2e9b, 0x1, 0x16151b9, 0x44, 0x64, 0xc4206e2200)
    /go/src/github.com/cockroachdb/cockroach/testutils/sqlutils/table_gen.go:59 +0x21c
github.com/cockroachdb/cockroach/sql/distsql.TestClusterFlow(0xc4201ac240)
    /go/src/github.com/cockroachdb/cockroach/sql/distsql/cluster_test.go:60 +0x2a4
testing.tRunner(0xc4201ac240, 0x17014e8)
    /usr/local/go/src/testing/testing.go:610 +0x81
created by testing.(*T).Run
    /usr/local/go/src/testing/testing.go:646 +0x2ec

goroutine 53 [chan receive]:
github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open.func1(0xc42018e480)
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:384 +0x44
created by github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:385 +0x6eb

goroutine 54 [chan receive]:
github.com/cockroachdb/cockroach/rpc.NewContext.func1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:115 +0x66
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4200a9ba0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 55 [select]:
github.com/cockroachdb/cockroach/storage.(*StorePool).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store_pool.go:308 +0x3da
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286300)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 56 [select]:
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).startStats(0xc42018fa40)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:203 +0xaa3
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).(github.com/cockroachdb/cockroach/kv.startStats)-fm()
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:188 +0x2a
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc42027f240)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 57 [select]:
github.com/cockroachdb/cockroach/sql.(*LeaseManager).RefreshLeases.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/lease.go:1146 +0xcc1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420216120)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 58 [select]:
github.com/cockroachdb/cockroach/sql.NewExecutor.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/executor.go:255 +0x175
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4200f0240)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 59 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286600)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 60 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286660)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 61 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func2()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:336 +0x5f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4202867c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 62 [IO wait]:
net.runtime_pollWait(0x7f6270ccd940, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420065bf0, 0x72, 0xc420672608, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420065bf0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc420065b90, 0x0, 0x1edb140, 0xc4204d6000)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc42017a218, 0xc4206726f0, 0xc420672700, 0x645340)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc42017a218, 0x1700a90, 0xc4202346c0, 0xc42016e000, 0x0)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc4202346c0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func3()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:348 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286820)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 63 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4202867e0, 0xc420214000, 0x14961a0, 0x1ec28c0, 0x1514960)
    <autogenerated>:9 +0x7f
net/http.(*Server).Serve(0xc42017e900, 0x1ee7700, 0xc4202867e0, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:352 +0x3c
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286840)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 64 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc420286800, 0xc42017a218, 0xc4202140c0, 0x14961a0, 0x1ec28c0)
    <autogenerated>:9 +0x7f
crypto/tls.(*listener).Accept(0xc420286860, 0xc420214090, 0x14961a0, 0x1ec28c0, 0x1514960)
    /usr/local/go/src/crypto/tls/tls.go:52 +0x37
net/http.(*Server).Serve(0xc42017e880, 0x1ee1ec0, 0xc420286860, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func5()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:359 +0x42
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286880)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 65 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func6()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:363 +0x6d
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4202868a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 66 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc420286720, 0x1702d50, 0xc4200aa140, 0x1eeef40, 0xc4200c1550)
    <autogenerated>:9 +0x7f
google.golang.org/grpc.(*Server).Serve(0xc4200aa140, 0x1ee7700, 0xc420286720, 0x0, 0x0)
    /go/src/google.golang.org/grpc/server.go:348 +0x15a
github.com/cockroachdb/cockroach/server.(*Server).Start.func7()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:370 +0x43
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4202868c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 67 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc420286700, 0xc420180010, 0x0, 0xc4204c6000, 0x0)
    <autogenerated>:9 +0x7f
github.com/cockroachdb/cockroach/util/netutil.(*Server).ServeWith(0xc42017a1f8, 0xc420232090, 0x1ee7700, 0xc420286700, 0xc420180010, 0xc420031798, 0x645340)
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:117 +0x5d
github.com/cockroachdb/cockroach/server.(*Server).Start.func8()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:378 +0xb5
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420216de0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 68 [chan receive]:
github.com/cockroachdb/cockroach/gossip.(*server).start.func3()
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:323 +0x65
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286920)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 69 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).bootstrap.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:863 +0x2af
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc42027f980)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 70 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).manage.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:898 +0x2fa
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc42027f990)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 71 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286b80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 82 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:2554 +0x8a6
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c43a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 102 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:578 +0x465
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420230cf0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 19 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206e22a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 311 [runnable]:
sync.(*Mutex).Unlock(0xc4200f5700)
    /usr/local/go/src/sync/mutex.go:102
github.com/cockroachdb/cockroach/util/metric.(*Rate).Add(0xc4200f5700, 0x0)
    /go/src/github.com/cockroachdb/cockroach/util/metric/metric.go:346 +0x69
github.com/cockroachdb/cockroach/util/metric.Rates.Add(0xc4206b90e0, 0xc420312150, 0x0)
    /go/src/github.com/cockroachdb/cockroach/util/metric/metric.go:379 +0xbe
github.com/cockroachdb/cockroach/gossip.(*client).handleResponse(0xc420bdd450, 0xc42029bce0, 0xc4206ae280, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:177 +0x1b6
github.com/cockroachdb/cockroach/gossip.(*client).gossip.func2.1(0x1eeefa0, 0xc420ab3120, 0xc420bdd450, 0xc42029bce0, 0xc420afa788, 0xc420afa790)
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:270 +0x66
github.com/cockroachdb/cockroach/gossip.(*client).gossip.func2()
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:274 +0x52
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b98c30)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 84 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1134 +0x165
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4400)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 85 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1208 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4420)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 86 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func2()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1227 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4440)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 97 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4d60)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 116 [select]:
google.golang.org/grpc/transport.(*http2Client).controller(0xc42029dd00)
    /go/src/google.golang.org/grpc/transport/http2_client.go:968 +0x59d
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:202 +0xe5d

goroutine 90 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4c60)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 101 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startComputePeriodicMetrics.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:618 +0x256
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286740)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 23 [select]:
github.com/cockroachdb/cockroach/storage.(*StorePool).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store_pool.go:308 +0x3da
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bb940)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 136 [select]:
github.com/cockroachdb/cockroach/gossip.(*client).gossip(0xc42018dd40, 0x7f6270bbb140, 0xc4206c7e80, 0xc4206d0dc0, 0x1ed6d40, 0xc42017a358, 0xc4202333b0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:278 +0x57d
github.com/cockroachdb/cockroach/gossip.(*client).start.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:93 +0x25b
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206c7c80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 91 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4c80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 92 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4ca0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 93 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4cc0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 94 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4ce0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 95 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4d00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 96 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc4206fc0e0, 0xecf38bb26, 0xc438cb40e0, 0x2208f40, 0xc420173240, 0xc420232090, 0xc420704240, 0xc4204e1ec0)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1.1(0xc420704240, 0xc4201a8c90)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:224 +0x7c
github.com/cockroachdb/cockroach/storage.(*storeRangeSet).Visit(0xc4201a8db0, 0xc4206c6540)
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:274 +0x23e
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:226 +0x1e3
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4d20)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 114 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc4206fc380, 0xecf38bb26, 0xc438cb5755, 0x2208f40, 0xc420173240, 0xc420232090, 0xc420704240, 0xc4204e26c0)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1.1(0xc420704240, 0xc4201a8c90)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:224 +0x7c
github.com/cockroachdb/cockroach/storage.(*storeRangeSet).Visit(0xc4201a9110, 0xc4206c6580)
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:274 +0x23e
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:226 +0x1e3
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206c4d80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 104 [select]:
github.com/cockroachdb/cockroach/server.(*Server).startSampleEnvironment.func1()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:565 +0x16b
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286b20)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 105 [select]:
github.com/cockroachdb/cockroach/ts.(*poller).start.func1()
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:81 +0x16f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc42025c6c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 106 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startWriteSummaries.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:652 +0x2bb
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286b40)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 107 [select]:
github.com/cockroachdb/cockroach/sql.(*SchemaChangeManager).Start.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/schema_changer.go:682 +0x12b7
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286ba0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 108 [IO wait]:
net.runtime_pollWait(0x7f6270ccda00, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420065b10, 0x72, 0xc420735df8, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420065b10, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc420065ab0, 0x0, 0x1edb140, 0xc4200f2f80)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc42017a200, 0x624bce, 0xc420735ea8, 0xe4a3cb)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc42017a200, 0x1700a98, 0xc4202345c0, 0x1eef180, 0xc420bc8180)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc4202345c0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func11()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:439 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420286d00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 111 [select]:
github.com/cockroachdb/cockroach/rpc.(*Context).runHeartbeat(0xc42018ed80, 0xc42029d100, 0xc4202330e0, 0xc42027f8e0, 0xf, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:293 +0x54e
github.com/cockroachdb/cockroach/rpc.(*Context).GRPCDial.func1.1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:189 +0x7f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420231b00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 110 [select]:
google.golang.org/grpc.(*addrConn).transportMonitor(0xc420718140)
    /go/src/google.golang.org/grpc/clientconn.go:700 +0x63e
google.golang.org/grpc.(*ClientConn).resetAddrConn.func1(0xc420718140)
    /go/src/google.golang.org/grpc/clientconn.go:461 +0x1de
created by google.golang.org/grpc.(*ClientConn).resetAddrConn
    /go/src/google.golang.org/grpc/clientconn.go:462 +0x3c7

goroutine 147 [IO wait]:
net.runtime_pollWait(0x7f6270ccd7c0, 0x72, 0x6)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42024c060, 0x72, 0xc420b31598, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42024c060, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42024c000, 0xc420070800, 0x400, 0x400, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc4207aa000, 0xc420070800, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
github.com/cockroachdb/cmux.(*MuxConn).Read(0xc42013cb00, 0xc420070800, 0x400, 0x400, 0x1552320, 0x0, 0x7f6270018028)
    /go/src/github.com/cockroachdb/cmux/cmux.go:218 +0x113
crypto/tls.(*block).readFromUntil(0xc4200fe720, 0x7f6270018028, 0xc42013cb00, 0x5, 0xc42013cb00, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207be000, 0x1703917, 0xc4207be100, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207be000, 0xc420bbe000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc420ba2120)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420ba2120, 0xc420bf2038, 0x9, 0x9, 0x9, 0x18, 0x28)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc420ba2120, 0xc420bf2038, 0x9, 0x9, 0x9, 0x600ee8, 0x30, 0xc420b31ae8)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc420ba2120, 0xc420bf2038, 0x9, 0x9, 0x3c2fe50c8d5f6e01, 0x3c00000000000000, 0x2)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc420bf2038, 0x9, 0x9, 0x1ed6680, 0xc420ba2120, 0x0, 0xc400000000, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc420bf2000, 0x1edfc80, 0xc4204b6c30, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420b98180, 0xc4204b6c30, 0xc4204b6c30, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Server).HandleStreams(0xc420c02000, 0xc420b98210)
    /go/src/google.golang.org/grpc/transport/http2_server.go:260 +0x200
google.golang.org/grpc.(*Server).serveStreams(0xc4200aa140, 0x1eeed00, 0xc420c02000)
    /go/src/google.golang.org/grpc/server.go:421 +0x160
google.golang.org/grpc.(*Server).serveNewHTTP2Transport(0xc4200aa140, 0x1eeeee0, 0xc4207be000, 0x1edcec0, 0xc420bac2c0)
    /go/src/google.golang.org/grpc/server.go:408 +0x3da
google.golang.org/grpc.(*Server).handleRawConn(0xc4200aa140, 0x1eeef40, 0xc42013cb00)
    /go/src/google.golang.org/grpc/server.go:385 +0x422
created by google.golang.org/grpc.(*Server).Serve
    /go/src/google.golang.org/grpc/server.go:357 +0x1a9

goroutine 22 [chan receive]:
github.com/cockroachdb/cockroach/rpc.NewContext.func1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:115 +0x66
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bb200)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 112 [chan receive]:
database/sql.(*DB).connectionOpener(0xc4204b20b0)
    /usr/local/go/src/database/sql/sql.go:730 +0x4a
created by database/sql.Open
    /usr/local/go/src/database/sql/sql.go:493 +0x1e9

goroutine 113 [chan receive]:
github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open.func1(0xc42018f7a0)
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:384 +0x44
created by github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:385 +0x6eb

goroutine 24 [select]:
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).startStats(0xc4206c8c60)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:203 +0xaa3
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).(github.com/cockroachdb/cockroach/kv.startStats)-fm()
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:188 +0x2a
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42016ee10)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 25 [select]:
github.com/cockroachdb/cockroach/sql.(*LeaseManager).RefreshLeases.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/lease.go:1146 +0xcc1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42031c150)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 26 [select]:
github.com/cockroachdb/cockroach/sql.NewExecutor.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/executor.go:255 +0x175
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206c96e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 135 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420918c80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 139 [select]:
github.com/cockroachdb/cockroach/rpc.(*Context).runHeartbeat(0xc4204dbbc0, 0xc42029d300, 0xc420233950, 0xc42025d020, 0xf, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:293 +0x54e
github.com/cockroachdb/cockroach/rpc.(*Context).GRPCDial.func1.1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:189 +0x7f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4204b64b0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 27 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbc40)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 28 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbca0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 29 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func2()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:336 +0x5f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbe00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 30 [IO wait]:
net.runtime_pollWait(0x7f6270ccd640, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42024daa0, 0x72, 0xc42090fe08, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42024daa0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc42024da40, 0x0, 0x1edb140, 0xc420918d00)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc4207aa158, 0xc42090fef0, 0xc42090ff00, 0x645340)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc4207aa158, 0x1700a90, 0xc420161540, 0xc4206b99b0, 0x0)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc420161540, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func3()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:348 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbe60)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 31 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4206bbe20, 0xc4204b6240, 0x14961a0, 0x1ec28c0, 0x1514960)
    <autogenerated>:9 +0x7f
net/http.(*Server).Serve(0xc4204b4600, 0x1ee7700, 0xc4206bbe20, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:352 +0x3c
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbe80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 32 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4206bbe40, 0xc4207aa158, 0xc4204b6210, 0x14961a0, 0x1ec28c0)
    <autogenerated>:9 +0x7f
crypto/tls.(*listener).Accept(0xc4206bbea0, 0xc4204b61e0, 0x14961a0, 0x1ec28c0, 0x1514960)
    /usr/local/go/src/crypto/tls/tls.go:52 +0x37
net/http.(*Server).Serve(0xc4204b4580, 0x1ee1ec0, 0xc4206bbea0, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func5()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:359 +0x42
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbec0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 33 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func6()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:363 +0x6d
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbee0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 162 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4206bbd60, 0x1702d50, 0xc4201d9c20, 0x1eeef40, 0xc420adc000)
    <autogenerated>:9 +0x7f
google.golang.org/grpc.(*Server).Serve(0xc4201d9c20, 0x1ee7700, 0xc4206bbd60, 0x0, 0x0)
    /go/src/google.golang.org/grpc/server.go:348 +0x15a
github.com/cockroachdb/cockroach/server.(*Server).Start.func7()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:370 +0x43
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbf00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 163 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4206bbd40, 0xc4206b99c0, 0x0, 0x6017c6, 0xc4209126b0)
    <autogenerated>:9 +0x7f
github.com/cockroachdb/cockroach/util/netutil.(*Server).ServeWith(0xc4207aa138, 0xc4202333b0, 0x1ee7700, 0xc4206bbd40, 0xc4206b99c0, 0xc420912798, 0x645340)
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:117 +0x5d
github.com/cockroachdb/cockroach/server.(*Server).Start.func8()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:378 +0xb5
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42031ce70)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 164 [chan receive]:
github.com/cockroachdb/cockroach/gossip.(*server).start.func3()
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:323 +0x65
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4206bbf60)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 165 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).bootstrap.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:863 +0x2af
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42016f550)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 166 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).manage.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:898 +0x2fa
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42016f560)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 138 [select]:
google.golang.org/grpc.(*addrConn).transportMonitor(0xc420719040)
    /go/src/google.golang.org/grpc/clientconn.go:700 +0x63e
google.golang.org/grpc.(*ClientConn).resetAddrConn.func1(0xc420719040)
    /go/src/google.golang.org/grpc/clientconn.go:461 +0x1de
created by google.golang.org/grpc.(*ClientConn).resetAddrConn
    /go/src/google.golang.org/grpc/clientconn.go:462 +0x3c7

goroutine 115 [IO wait]:
net.runtime_pollWait(0x7f6270ccd580, 0x72, 0xa)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42047c1b0, 0x72, 0xc4207ca828, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42047c1b0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42047c150, 0xc420496000, 0x1000, 0x1000, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420480010, 0xc420496000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc42031a390, 0x7f6270018000, 0xc420480010, 0x5, 0xc420480010, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207a8380, 0x1703917, 0xc4207a8480, 0xc4203cc820)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207a8380, 0xc420696000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc42033e720)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc42033e720, 0xc42032a1b8, 0x9, 0x9, 0x645440, 0xc420105900, 0xc4207cad08)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc42033e720, 0xc42032a1b8, 0x9, 0x9, 0x9, 0xc420312cf8, 0x1eda380, 0xc420b6e2a0)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc42033e720, 0xc42032a1b8, 0x9, 0x9, 0xa39988, 0xc4200eaa50, 0xc4200a59e0)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc42032a1b8, 0x9, 0x9, 0x1ed6680, 0xc42033e720, 0x0, 0xc400000000, 0x0, 0x90)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc42032a180, 0x1edfa40, 0xc420b6e270, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420312c30, 0xc420b6e270, 0xc420b6e270, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Client).reader(0xc42029dd00)
    /go/src/google.golang.org/grpc/transport/http2_client.go:890 +0xb6
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:172 +0x89c

goroutine 179 [IO wait]:
net.runtime_pollWait(0x7f6270ccd4c0, 0x72, 0xb)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42047c220, 0x72, 0xc420057598, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42047c220, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42047c1c0, 0xc42044c000, 0x2000, 0x2000, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc42017a368, 0xc42044c000, 0x2000, 0x2000, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
github.com/cockroachdb/cmux.(*MuxConn).Read(0xc42013ce70, 0xc42044c000, 0x2000, 0x2000, 0x1552320, 0x0, 0x7f6270018028)
    /go/src/github.com/cockroachdb/cmux/cmux.go:218 +0x113
crypto/tls.(*block).readFromUntil(0xc4203c6270, 0x7f6270018028, 0xc42013ce70, 0x5, 0xc42013ce70, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207a8700, 0x1703917, 0xc4207a8800, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207a8700, 0xc420482000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc4206e4660)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4206e4660, 0xc4201701b8, 0x9, 0x9, 0x631270, 0xc4206f79d0, 0x0)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc4206e4660, 0xc4201701b8, 0x9, 0x9, 0x9, 0xc420057ae8, 0x645440, 0xc4206c7ec0)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc4206e4660, 0xc4201701b8, 0x9, 0x9, 0xc4206f79d0, 0x0, 0x1)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc4201701b8, 0x9, 0x9, 0x1ed6680, 0xc4206e4660, 0x0, 0xc400000000, 0xc420057c80, 0xa3ed39)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc420170180, 0x1cb, 0x1cb, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc4203c6870, 0xc42021aa80, 0xc42021aa80, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Server).HandleStreams(0xc4207c02d0, 0xc4203c6900)
    /go/src/google.golang.org/grpc/transport/http2_server.go:260 +0x200
google.golang.org/grpc.(*Server).serveStreams(0xc4200aa140, 0x1eeed00, 0xc4207c02d0)
    /go/src/google.golang.org/grpc/server.go:421 +0x160
google.golang.org/grpc.(*Server).serveNewHTTP2Transport(0xc4200aa140, 0x1eeeee0, 0xc4207a8700, 0x1edcec0, 0xc4201246e0)
    /go/src/google.golang.org/grpc/server.go:408 +0x3da
google.golang.org/grpc.(*Server).handleRawConn(0xc4200aa140, 0x1eeef40, 0xc42013ce70)
    /go/src/google.golang.org/grpc/server.go:385 +0x422
created by google.golang.org/grpc.(*Server).Serve
    /go/src/google.golang.org/grpc/server.go:357 +0x1a9

goroutine 168 [select]:
google.golang.org/grpc/transport.(*http2Server).controller(0xc4207c02d0)
    /go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c
created by google.golang.org/grpc/transport.newHTTP2Server
    /go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767

goroutine 323 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e41a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 169 [select]:
github.com/cockroachdb/cockroach/gossip.(*server).Gossip(0xc42018c410, 0x1eee8e0, 0xc4206f6800, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:157 +0x543
github.com/cockroachdb/cockroach/gossip._Gossip_Gossip_Handler(0x1502700, 0xc42018c410, 0x1eeb160, 0xc4207c0360, 0x0, 0xc4209157a2)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.pb.go:211 +0xbb
google.golang.org/grpc.(*Server).processStreamingRPC(0xc4200aa140, 0x1eeed00, 0xc4207c02d0, 0xc4201fc690, 0xc42021b440, 0x1ec57a0, 0x0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/server.go:686 +0x702
google.golang.org/grpc.(*Server).handleStream(0xc4200aa140, 0x1eeed00, 0xc4207c02d0, 0xc4201fc690, 0x0)
    /go/src/google.golang.org/grpc/server.go:770 +0xc36
google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc4206f67a0, 0xc4200aa140, 0x1eeed00, 0xc4207c02d0, 0xc4201fc690)
    /go/src/google.golang.org/grpc/server.go:419 +0xab
created by google.golang.org/grpc.(*Server).serveStreams.func1
    /go/src/google.golang.org/grpc/server.go:420 +0xa3

goroutine 117 [select]:
google.golang.org/grpc.NewClientStream.func1(0x1eeeca0, 0xc42029dd00, 0xc4200eaa50, 0xc42095e5a0)
    /go/src/google.golang.org/grpc/stream.go:187 +0x426
created by google.golang.org/grpc.NewClientStream
    /go/src/google.golang.org/grpc/stream.go:207 +0xa4f

goroutine 170 [select]:
google.golang.org/grpc/transport.(*recvBufferReader).Read(0xc4206f8780, 0xc42031f3d0, 0x5, 0x5, 0x0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a
google.golang.org/grpc/transport.(*Stream).Read(0xc4201fc690, 0xc42031f3d0, 0x5, 0x5, 0xc42073b968, 0x630f4b, 0x30)
    /go/src/google.golang.org/grpc/transport/transport.go:314 +0x59
io.ReadAtLeast(0x1eda240, 0xc4201fc690, 0xc42031f3d0, 0x5, 0x5, 0x5, 0xc420013890, 0x0, 0xc420013f20)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1eda240, 0xc4201fc690, 0xc42031f3d0, 0x5, 0x5, 0xc400000001, 0x0, 0x5ff1b9)
    /usr/local/go/src/io/io.go:325 +0x58
google.golang.org/grpc.(*parser).recvMsg(0xc42031f3c0, 0x7fffffff, 0x0, 0x38, 0x16fd624, 0x16fd623, 0xc41ffb4dc5, 0x0)
    /go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f
google.golang.org/grpc.recv(0xc42031f3c0, 0x1ee7f80, 0x2257890, 0xc4201fc690, 0x0, 0x0, 0x15525c0, 0xc420964700, 0x7fffffff, 0x20001, ...)
    /go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d
google.golang.org/grpc.(*serverStream).RecvMsg(0xc4207c0360, 0x15525c0, 0xc420964700, 0x0, 0x0)
    /go/src/google.golang.org/grpc/stream.go:482 +0xec
github.com/cockroachdb/cockroach/gossip.(*gossipGossipServer).Recv(0xc4206f6800, 0x0, 0x0, 0x100010000)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.pb.go:230 +0x62
github.com/cockroachdb/cockroach/gossip.(Gossip_GossipServer).Recv-fm(0xc42018c418, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:123 +0x2f
github.com/cockroachdb/cockroach/gossip.(*server).gossipReceiver(0xc42018c410, 0xc420480018, 0xc4206f8840, 0xc42073bf40, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:267 +0x39f
github.com/cockroachdb/cockroach/gossip.(*server).Gossip.func3.1()
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:123 +0x87
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc4206f8880)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 118 [select]:
google.golang.org/grpc/transport.(*recvBufferReader).Read(0xc4208069c0, 0xc4204df170, 0x5, 0x5, 0x0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a
google.golang.org/grpc/transport.(*Stream).Read(0xc4200eaa50, 0xc4204df170, 0x5, 0x5, 0xc4206b1b00, 0xc4206b1cd0, 0xc2654b)
    /go/src/google.golang.org/grpc/transport/transport.go:314 +0x59
io.ReadAtLeast(0x1eda240, 0xc4200eaa50, 0xc4204df170, 0x5, 0x5, 0x5, 0xc420312ff8, 0x0, 0x0)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1eda240, 0xc4200eaa50, 0xc4204df170, 0x5, 0x5, 0xc4200fc418, 0xc4203cc820, 0x0)
    /usr/local/go/src/io/io.go:325 +0x58
google.golang.org/grpc.(*parser).recvMsg(0xc4204df160, 0x7fffffff, 0x8b, 0x1, 0x8b, 0xc4206afe50, 0x0, 0x0)
    /go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f
google.golang.org/grpc.recv(0xc4204df160, 0x1ee7f80, 0x2257890, 0xc4200eaa50, 0x0, 0x0, 0x15439e0, 0xc420bb0230, 0x7fffffff, 0xc4202a9000, ...)
    /go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d
google.golang.org/grpc.(*clientStream).RecvMsg(0xc42095e5a0, 0x15439e0, 0xc420bb0230, 0x0, 0x0)
    /go/src/google.golang.org/grpc/stream.go:295 +0xc4
github.com/cockroachdb/cockroach/gossip.(*gossipGossipClient).Recv(0xc4206f4f90, 0xc4206d0dc0, 0xc4206afe50, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.pb.go:194 +0x62
github.com/cockroachdb/cockroach/gossip.(*client).gossip.func2.1(0x1eeefa0, 0xc4206f4f90, 0xc42018dd40, 0xc4206d0dc0, 0xc42090e788, 0xc42090e790)
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:266 +0x35
github.com/cockroachdb/cockroach/gossip.(*client).gossip.func2()
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:274 +0x52
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420312d80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 222 [select]:
google.golang.org/grpc/transport.(*http2Client).controller(0xc4203ac100)
    /go/src/google.golang.org/grpc/transport/http2_client.go:968 +0x59d
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:202 +0xe5d

goroutine 221 [IO wait]:
net.runtime_pollWait(0x7f6270ccd400, 0x72, 0xc)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420c167d0, 0x72, 0xc4207c6828, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420c167d0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420c16770, 0xc4203b9c00, 0x400, 0x400, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420ba0568, 0xc4203b9c00, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc4204b72c0, 0x7f6270018000, 0xc420ba0568, 0x5, 0xc420ba0568, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207bf880, 0x1703917, 0xc4207bf980, 0x645550)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207bf880, 0xc420d66000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc4206c23c0)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4206c23c0, 0xc42035e338, 0x9, 0x9, 0xc4207c6ca8, 0x645440, 0xc420807880)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc4206c23c0, 0xc42035e338, 0x9, 0x9, 0x9, 0x30, 0xc420164d28, 0x1eda380)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc4206c23c0, 0xc42035e338, 0x9, 0x9, 0xc4207c6eb0, 0xa3a9f0, 0xc420d78000)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc42035e338, 0x9, 0x9, 0x1ed6680, 0xc4206c23c0, 0x0, 0xc400000000, 0xc420b9a260, 0xc)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc42035e300, 0x0, 0x0, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420164c30, 0xc420164ea0, 0xc420164ea0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Client).reader(0xc4203ac100)
    /go/src/google.golang.org/grpc/transport/http2_client.go:890 +0xb6
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:172 +0x89c

goroutine 195 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startComputePeriodicMetrics.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:618 +0x256
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42048a7a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 196 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:578 +0x465
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420217830)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 188 [select]:
github.com/cockroachdb/cockroach/kv.(*DistSender).sendToReplicas(0xc420bb6ea0, 0x7f6270cce288, 0xc42030ecf0, 0x2540be400, 0xb2d05e00, 0x0, 0x1, 0xc4204a6c40, 0x1, 0x1, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:937 +0xa77
github.com/cockroachdb/cockroach/kv.(*DistSender).sendRPC(0xc420bb6ea0, 0x7f6270cce288, 0xc42030ecf0, 0x1, 0xc4204a6c40, 0x1, 0x1, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:364 +0x1c6
github.com/cockroachdb/cockroach/kv.(*DistSender).sendSingleRange(0xc420bb6ea0, 0x7f6270cce288, 0xc42030ecf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:480 +0x19f
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk.func2(0xc4207607a0, 0xc420760640, 0xc420760e88, 0xc420bb6ea0, 0xc420760e78, 0x16, 0xc4204a6b00)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:739 +0x18e
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk(0xc420bb6ea0, 0x7f6270cce288, 0xc42030ecf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:740 +0x437
github.com/cockroachdb/cockroach/kv.(*DistSender).Send(0xc420bb6ea0, 0x7f6270cce288, 0xc42030ecf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:584 +0x3c0
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc420c1fc80, 0x7f6270cce288, 0xc42030ecf0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:375 +0x546
github.com/cockroachdb/cockroach/internal/client.(*DB).send(0xc420bc6320, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:486 +0x220
github.com/cockroachdb/cockroach/internal/client.(*DB).(github.com/cockroachdb/cockroach/internal/client.send)-fm(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:433 +0x58
github.com/cockroachdb/cockroach/internal/client.sendAndFill(0xc420761ab8, 0xc420412480, 0x0, 0x1)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:415 +0x16b
github.com/cockroachdb/cockroach/internal/client.(*DB).Run(0xc420bc6320, 0xc420412480, 0x1eefda0, 0xc4200f0300)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:433 +0x75
github.com/cockroachdb/cockroach/internal/client.runOneResult(0x1ed6e00, 0xc420bc6320, 0xc420412480, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:513 +0x80
github.com/cockroachdb/cockroach/internal/client.(*DB).PutInline(0xc420bc6320, 0x1538560, 0xc4204a6b20, 0x1548360, 0xc420362000, 0x1bc30e5, 0xe)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:248 +0xce
github.com/cockroachdb/cockroach/server.(*Node).writeSummaries.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:679 +0x111
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunTask(0xc420bb6e10, 0xc420761dc8, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:215 +0x100
github.com/cockroachdb/cockroach/server.(*Node).writeSummaries(0xc420708960, 0x7f6270ccca40, 0xc4200106b0)
    /go/src/github.com/cockroachdb/cockroach/server/node.go:690 +0x69
github.com/cockroachdb/cockroach/server.(*Node).bootstrapStores(0xc420708960, 0x7f6270ccca40, 0xc4200106b0, 0xc420bc8148, 0x1, 0x1, 0xc420bb6e10)
    /go/src/github.com/cockroachdb/cockroach/server/node.go:531 +0x443
github.com/cockroachdb/cockroach/server.(*Node).initStores.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:461 +0x66
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask.func1(0xc420bb6e10, 0x1bc30e5, 0xe, 0x1ce, 0xc420964280)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:231 +0x95
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:232 +0xbc

goroutine 198 [select]:
github.com/cockroachdb/cockroach/server.(*Server).startSampleEnvironment.func1()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:565 +0x16b
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42048a840)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 199 [select]:
github.com/cockroachdb/cockroach/ts.(*poller).start.func1()
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:81 +0x16f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420180b70)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 200 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startWriteSummaries.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:652 +0x2bb
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc42048a860)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 210 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4209b1f80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 211 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:2554 +0x8a6
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc4209b1fe0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 186 [IO wait]:
net.runtime_pollWait(0x7f6270ccd340, 0x72, 0xd)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420bf81b0, 0x72, 0xc4209ef588, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420bf81b0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420bf8150, 0xc4202a9400, 0x400, 0x400, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc42016a030, 0xc4202a9400, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
github.com/cockroachdb/cmux.(*MuxConn).Read(0xc420adc000, 0xc4202a9400, 0x400, 0x400, 0x1552320, 0x0, 0x7f6270018028)
    /go/src/github.com/cockroachdb/cmux/cmux.go:218 +0x113
crypto/tls.(*block).readFromUntil(0xc42031c660, 0x7f6270018028, 0xc420adc000, 0x5, 0xc420adc000, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207a8a80, 0x1703917, 0xc4207a8b80, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207a8a80, 0xc42040a000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc420307080)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420307080, 0xc4206fe878, 0x9, 0x9, 0x9, 0x18, 0x28)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc420307080, 0xc4206fe878, 0x9, 0x9, 0x9, 0x600ee8, 0x30, 0xc4209efad8)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc420307080, 0xc4206fe878, 0x9, 0x9, 0x3c2fe50c8d5f6e01, 0x3c00000000000000, 0x2)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc4206fe878, 0x9, 0x9, 0x1ed6680, 0xc420307080, 0x0, 0xc400000000, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc4206fe840, 0x1edfc80, 0xc420aa93e0, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420aa8db0, 0xc420aa93e0, 0xc420aa93e0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Server).HandleStreams(0xc420c02510, 0xc420aa9110)
    /go/src/google.golang.org/grpc/transport/http2_server.go:260 +0x200
google.golang.org/grpc.(*Server).serveStreams(0xc4201d9c20, 0x1eeed00, 0xc420c02510)
    /go/src/google.golang.org/grpc/server.go:421 +0x160
google.golang.org/grpc.(*Server).serveNewHTTP2Transport(0xc4201d9c20, 0x1eeeee0, 0xc4207a8a80, 0x1edcec0, 0xc420bad290)
    /go/src/google.golang.org/grpc/server.go:408 +0x3da
google.golang.org/grpc.(*Server).handleRawConn(0xc4201d9c20, 0x1eeef40, 0xc420adc000)
    /go/src/google.golang.org/grpc/server.go:385 +0x422
created by google.golang.org/grpc.(*Server).Serve
    /go/src/google.golang.org/grpc/server.go:357 +0x1a9

goroutine 279 [select]:
google.golang.org/grpc/transport.(*http2Server).controller(0xc420c02510)
    /go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c
created by google.golang.org/grpc/transport.newHTTP2Server
    /go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767

goroutine 259 [select]:
google.golang.org/grpc/transport.(*http2Client).controller(0xc42000b100)
    /go/src/google.golang.org/grpc/transport/http2_client.go:968 +0x59d
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:202 +0xe5d

goroutine 213 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1134 +0x165
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420b36040)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 214 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1208 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420b36060)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 215 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func2()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1227 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420b36080)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 159 [select]:
github.com/cockroachdb/cockroach/sql.(*SchemaChangeManager).Start.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/schema_changer.go:682 +0x12b7
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2700)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 218 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420b361a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 219 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc42024dd50, 0xecf38bb27, 0xc4047e76e2, 0x2208f40, 0xc4200f5f80, 0xc4202333b0, 0x0, 0x61a9b3)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:229 +0x2c1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420b361c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 152 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad25e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 153 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2600)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 154 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2620)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 155 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2640)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 156 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2660)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 157 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2680)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 158 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc42024dab0, 0xecf38bb27, 0xc4047f1d22, 0x2208f40, 0xc4200f5f80, 0xc4202333b0, 0x0, 0x61a9b3)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:229 +0x2c1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad26a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 258 [IO wait]:
net.runtime_pollWait(0x7f6270ccd880, 0x72, 0x7)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc4201881b0, 0x72, 0xc4207cb828, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc4201881b0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc420188150, 0xc420152800, 0x400, 0x400, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420038060, 0xc420152800, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc42030e000, 0x7f6270018000, 0xc420038060, 0x5, 0xc420038060, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4207a8000, 0x1703917, 0xc4207a8100, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4207a8000, 0xc420c4e000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc420c1e180)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc420c1e180, 0xc420be40f8, 0x9, 0x9, 0x9, 0x18, 0x28)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc420c1e180, 0xc420be40f8, 0x9, 0x9, 0x9, 0x600ee8, 0x30, 0xc4207cbd18)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc420c1e180, 0xc420be40f8, 0x9, 0x9, 0x3c2fe50c8d5f6e01, 0x3c00000000000000, 0x2)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc420be40f8, 0x9, 0x9, 0x1ed6680, 0xc420c1e180, 0x0, 0xc400000000, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc420be40c0, 0x1edfc80, 0xc4204b7020, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420c180c0, 0xc4204b7020, 0xc4204b7020, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Client).reader(0xc42000b100)
    /go/src/google.golang.org/grpc/transport/http2_client.go:890 +0xb6
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:172 +0x89c

goroutine 242 [select]:
google.golang.org/grpc/transport.(*http2Server).controller(0xc420c02000)
    /go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c
created by google.golang.org/grpc/transport.newHTTP2Server
    /go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767

goroutine 160 [IO wait]:
net.runtime_pollWait(0x7f6270ccd700, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42024da30, 0x72, 0xc420b50df8, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42024da30, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc42024d9d0, 0x0, 0x1edb140, 0xc42093e080)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc4207aa140, 0x624bce, 0xc420b50ea8, 0xe4a3cb)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc4207aa140, 0x1700a98, 0xc420161500, 0x1eef180, 0xc42016a030)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc420161500, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func11()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:439 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420ad2740)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 261 [select]:
github.com/cockroachdb/cockroach/rpc.(*Context).runHeartbeat(0xc4204dbbc0, 0xc4203e0400, 0xc420c34000, 0xc42016f4b0, 0xf, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:293 +0x54e
github.com/cockroachdb/cockroach/rpc.(*Context).GRPCDial.func1.1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:189 +0x7f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc4202333b0, 0xc420c183f0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 260 [select]:
google.golang.org/grpc.(*addrConn).transportMonitor(0xc420be6500)
    /go/src/google.golang.org/grpc/clientconn.go:700 +0x63e
google.golang.org/grpc.(*ClientConn).resetAddrConn.func1(0xc420be6500)
    /go/src/google.golang.org/grpc/clientconn.go:461 +0x1de
created by google.golang.org/grpc.(*ClientConn).resetAddrConn
    /go/src/google.golang.org/grpc/clientconn.go:462 +0x3c7

goroutine 262 [chan receive]:
database/sql.(*DB).connectionOpener(0xc420ba94a0)
    /usr/local/go/src/database/sql/sql.go:730 +0x4a
created by database/sql.Open
    /usr/local/go/src/database/sql/sql.go:493 +0x1e9

goroutine 263 [chan receive]:
github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open.func1(0xc420c1ec00)
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:384 +0x44
created by github.com/cockroachdb/cockroach/storage/engine.(*RocksDB).Open
    /go/src/github.com/cockroachdb/cockroach/storage/engine/rocksdb.go:385 +0x6eb

goroutine 309 [select]:
google.golang.org/grpc/transport.(*http2Client).controller(0xc4203e0d00)
    /go/src/google.golang.org/grpc/transport/http2_client.go:968 +0x59d
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:202 +0xe5d

goroutine 310 [select]:
google.golang.org/grpc.NewClientStream.func1(0x1eeeca0, 0xc4203e0d00, 0xc420300690, 0xc420bb46c0)
    /go/src/google.golang.org/grpc/stream.go:187 +0x426
created by google.golang.org/grpc.NewClientStream
    /go/src/google.golang.org/grpc/stream.go:207 +0xa4f

goroutine 264 [chan receive]:
github.com/cockroachdb/cockroach/rpc.NewContext.func1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:115 +0x66
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420169500)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 265 [select]:
github.com/cockroachdb/cockroach/storage.(*StorePool).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store_pool.go:308 +0x3da
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420169c20)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 266 [select]:
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).startStats(0xc420c1fc80)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:203 +0xaa3
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).(github.com/cockroachdb/cockroach/kv.startStats)-fm()
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:188 +0x2a
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4206b97b0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 267 [select]:
github.com/cockroachdb/cockroach/sql.(*LeaseManager).RefreshLeases.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/lease.go:1146 +0xcc1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420312b10)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 268 [select]:
github.com/cockroachdb/cockroach/sql.NewExecutor.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/executor.go:255 +0x175
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420903140)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 269 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420169f20)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 270 [chan receive]:
github.com/cockroachdb/cockroach/util/netutil.MakeServer.func2()
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:100 +0x70
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420169f80)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 271 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func2()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:336 +0x5f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f2320)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 272 [IO wait]:
net.runtime_pollWait(0x7f6270ccd1c0, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420c2fdb0, 0x72, 0xc420915e08, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420c2fdb0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc420c2fd50, 0x0, 0x1edb140, 0xc4200f2a00)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc420bc8128, 0xc420915ef0, 0xc420915f00, 0x645340)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc420bc8128, 0x1700a90, 0xc4206c6a80, 0xc42025d500, 0x0)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc4206c6a80, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func3()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:348 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f23e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 273 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4200f2360, 0xc42019aae0, 0x14961a0, 0x1ec28c0, 0x1514960)
    <autogenerated>:9 +0x7f
net/http.(*Server).Serve(0xc420c56980, 0x1ee7700, 0xc4200f2360, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:352 +0x3c
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f2460)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 290 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4200f23a0, 0xc420bc8128, 0xc42019b050, 0x14961a0, 0x1ec28c0)
    <autogenerated>:9 +0x7f
crypto/tls.(*listener).Accept(0xc4200f2480, 0xc42019acc0, 0x14961a0, 0x1ec28c0, 0x1514960)
    /usr/local/go/src/crypto/tls/tls.go:52 +0x37
net/http.(*Server).Serve(0xc420c56900, 0x1ee1ec0, 0xc4200f2480, 0x0, 0x0)
    /usr/local/go/src/net/http/server.go:2273 +0x1ce
github.com/cockroachdb/cockroach/server.(*Server).Start.func5()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:359 +0x42
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f24c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 291 [chan receive]:
github.com/cockroachdb/cockroach/server.(*Server).Start.func6()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:363 +0x6d
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f24e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 292 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4200f21a0, 0x1702d50, 0xc420bb3f40, 0x1eeef40, 0xc420124000)
    <autogenerated>:9 +0x7f
google.golang.org/grpc.(*Server).Serve(0xc420bb3f40, 0x1ee7700, 0xc4200f21a0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/server.go:348 +0x15a
github.com/cockroachdb/cockroach/server.(*Server).Start.func7()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:370 +0x43
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f2540)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 293 [chan receive]:
github.com/cockroachdb/cmux.(*muxListener).Accept(0xc4200f20e0, 0xc42025d530, 0x0, 0xc4204c7c00, 0x0)
    <autogenerated>:9 +0x7f
github.com/cockroachdb/cockroach/util/netutil.(*Server).ServeWith(0xc420bc8108, 0xc420bb6e10, 0x1ee7700, 0xc4200f20e0, 0xc42025d530, 0xc4203fcf98, 0x645340)
    /go/src/github.com/cockroachdb/cockroach/util/netutil/net.go:117 +0x5d
github.com/cockroachdb/cockroach/server.(*Server).Start.func8()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:378 +0xb5
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420313bc0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 294 [chan receive]:
github.com/cockroachdb/cockroach/gossip.(*server).start.func3()
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:323 +0x65
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f2640)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 295 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).bootstrap.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:863 +0x2af
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc42027ef90)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 296 [select]:
github.com/cockroachdb/cockroach/gossip.(*Gossip).manage.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:898 +0x2fa
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc42027efa0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 297 [select]:
github.com/cockroachdb/cockroach/storage.(*bookie).start.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/reservation.go:275 +0x217
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4200f2960)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 298 [select]:
github.com/cockroachdb/cockroach/gossip.(*client).gossip(0xc420bdd450, 0x7f6270bbb140, 0xc4206ab280, 0xc42029bce0, 0x1ed6d40, 0xc420bc8168, 0xc420bb6e10, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:278 +0x57d
github.com/cockroachdb/cockroach/gossip.(*client).start.func1()
    /go/src/github.com/cockroachdb/cockroach/gossip/client.go:93 +0x25b
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4206aaf00)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 301 [select]:
github.com/cockroachdb/cockroach/rpc.(*Context).runHeartbeat(0xc420c1f020, 0xc42000bb00, 0xc420bb6fc0, 0xc420c1a920, 0xf, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:293 +0x54e
github.com/cockroachdb/cockroach/rpc.(*Context).GRPCDial.func1.1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:189 +0x7f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc42019bd10)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 300 [select]:
google.golang.org/grpc.(*addrConn).transportMonitor(0xc4200ac000)
    /go/src/google.golang.org/grpc/clientconn.go:700 +0x63e
google.golang.org/grpc.(*ClientConn).resetAddrConn.func1(0xc4200ac000)
    /go/src/google.golang.org/grpc/clientconn.go:461 +0x1de
created by google.golang.org/grpc.(*ClientConn).resetAddrConn
    /go/src/google.golang.org/grpc/clientconn.go:462 +0x3c7

goroutine 308 [IO wait]:
net.runtime_pollWait(0x7f6270ccd100, 0x72, 0x10)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42047c4c0, 0x72, 0xc420b3e828, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42047c4c0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42047c460, 0xc420dde000, 0x1000, 0x1000, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420bc8178, 0xc420dde000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc420212a20, 0x7f6270018000, 0xc420bc8178, 0x5, 0xc420bc8178, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc4208fd880, 0x1703917, 0xc4208fd980, 0x5fefbc)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).Read(0xc4208fd880, 0xc420dac000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1109 +0x116
bufio.(*Reader).fill(0xc4206c0c00)
    /usr/local/go/src/bufio/bufio.go:97 +0x10c
bufio.(*Reader).Read(0xc4206c0c00, 0xc420463838, 0x9, 0x9, 0x645440, 0xc4206a6e40, 0xc420b3ed08)
    /usr/local/go/src/bufio/bufio.go:209 +0x1bc
io.ReadAtLeast(0x1ed6680, 0xc4206c0c00, 0xc420463838, 0x9, 0x9, 0x9, 0xc420b98b78, 0x1eda380, 0xc420217560)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1ed6680, 0xc4206c0c00, 0xc420463838, 0x9, 0x9, 0xa39988, 0xc420300690, 0xc420dd0680)
    /usr/local/go/src/io/io.go:325 +0x58
golang.org/x/net/http2.readFrameHeader(0xc420463838, 0x9, 0x9, 0x1ed6680, 0xc4206c0c00, 0x0, 0xc400000000, 0x0, 0x37)
    /go/src/golang.org/x/net/http2/frame.go:237 +0x7b
golang.org/x/net/http2.(*Framer).ReadFrame(0xc420463800, 0x1edfa40, 0xc420217530, 0x0, 0x0)
    /go/src/golang.org/x/net/http2/frame.go:464 +0xa4
google.golang.org/grpc/transport.(*framer).readFrame(0xc420b98ab0, 0xc420217530, 0xc420217530, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f
google.golang.org/grpc/transport.(*http2Client).reader(0xc4203e0d00)
    /go/src/google.golang.org/grpc/transport/http2_client.go:890 +0xb6
created by google.golang.org/grpc/transport.newHTTP2Client
    /go/src/google.golang.org/grpc/transport/http2_client.go:172 +0x89c

goroutine 305 [runnable]:
crypto/tls.(*Conn).RemoteAddr(0xc420b8c700, 0xc4200106b8, 0xb2d02750)
    /usr/local/go/src/crypto/tls/conn.go:104
google.golang.org/grpc/transport.(*http2Server).operateHeaders(0xc420bb73b0, 0xc42030f080, 0xc42030e690, 0x0)
    /go/src/google.golang.org/grpc/transport/http2_server.go:176 +0x419
google.golang.org/grpc/transport.(*http2Server).HandleStreams(0xc420bb73b0, 0xc42030e690)
    /go/src/google.golang.org/grpc/transport/http2_server.go:282 +0x44c
google.golang.org/grpc.(*Server).serveStreams(0xc4200aa140, 0x1eeed00, 0xc420bb73b0)
    /go/src/google.golang.org/grpc/server.go:421 +0x160
google.golang.org/grpc.(*Server).serveNewHTTP2Transport(0xc4200aa140, 0x1eeeee0, 0xc420b8c700, 0x1edcec0, 0xc4200c1ce0)
    /go/src/google.golang.org/grpc/server.go:408 +0x3da
google.golang.org/grpc.(*Server).handleRawConn(0xc4200aa140, 0x1eeef40, 0xc4200c1550)
    /go/src/google.golang.org/grpc/server.go:385 +0x422
created by google.golang.org/grpc.(*Server).Serve
    /go/src/google.golang.org/grpc/server.go:357 +0x1a9

goroutine 322 [select]:
google.golang.org/grpc/transport.(*http2Server).controller(0xc420bb73b0)
    /go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c
created by google.golang.org/grpc/transport.newHTTP2Server
    /go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767

goroutine 201 [select]:
github.com/cockroachdb/cockroach/gossip.(*server).Gossip(0xc42018c410, 0x1eee8e0, 0xc42016e2d0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:157 +0x543
github.com/cockroachdb/cockroach/gossip._Gossip_Gossip_Handler(0x1502700, 0xc42018c410, 0x1eeb160, 0xc4200a4990, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.pb.go:211 +0xbb
google.golang.org/grpc.(*Server).processStreamingRPC(0xc4200aa140, 0x1eeed00, 0xc420bb73b0, 0xc420dc2000, 0xc42021b440, 0x1ec57a0, 0x0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/server.go:686 +0x702
google.golang.org/grpc.(*Server).handleStream(0xc4200aa140, 0x1eeed00, 0xc420bb73b0, 0xc420dc2000, 0x0)
    /go/src/google.golang.org/grpc/server.go:770 +0xc36
google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc420180570, 0xc4200aa140, 0x1eeed00, 0xc420bb73b0, 0xc420dc2000)
    /go/src/google.golang.org/grpc/server.go:419 +0xab
created by google.golang.org/grpc.(*Server).serveStreams.func1
    /go/src/google.golang.org/grpc/server.go:420 +0xa3

goroutine 202 [select]:
google.golang.org/grpc/transport.(*recvBufferReader).Read(0xc420dd0040, 0xc420d86110, 0x5, 0x5, 0x0, 0x0, 0x0)
    /go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a
google.golang.org/grpc/transport.(*Stream).Read(0xc420dc2000, 0xc420d86110, 0x5, 0x5, 0xc42073d968, 0x630f4b, 0x40)
    /go/src/google.golang.org/grpc/transport/transport.go:314 +0x59
io.ReadAtLeast(0x1eda240, 0xc420dc2000, 0xc420d86110, 0x5, 0x5, 0x5, 0xc4200f4a40, 0x0, 0xc4200f5300)
    /usr/local/go/src/io/io.go:307 +0xa4
io.ReadFull(0x1eda240, 0xc420dc2000, 0xc420d86110, 0x5, 0x5, 0xc400000001, 0x0, 0x5ff1b9)
    /usr/local/go/src/io/io.go:325 +0x58
google.golang.org/grpc.(*parser).recvMsg(0xc420d86100, 0x7fffffff, 0x0, 0x38, 0x16fd624, 0x16fd623, 0xc41fff8539, 0x0)
    /go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f
google.golang.org/grpc.recv(0xc420d86100, 0x1ee7f80, 0x2257890, 0xc420dc2000, 0x0, 0x0, 0x15525c0, 0xc4200f5880, 0x7fffffff, 0x20001, ...)
    /go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d
google.golang.org/grpc.(*serverStream).RecvMsg(0xc4200a4990, 0x15525c0, 0xc4200f5880, 0x0, 0x0)
    /go/src/google.golang.org/grpc/stream.go:482 +0xec
github.com/cockroachdb/cockroach/gossip.(*gossipGossipServer).Recv(0xc42016e2d0, 0x0, 0x0, 0x1000000010000)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.pb.go:230 +0x62
github.com/cockroachdb/cockroach/gossip.(Gossip_GossipServer).Recv-fm(0xc42018c418, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:123 +0x2f
github.com/cockroachdb/cockroach/gossip.(*server).gossipReceiver(0xc42018c410, 0xc4207aa018, 0xc420dd0100, 0xc42073df40, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:267 +0x39f
github.com/cockroachdb/cockroach/gossip.(*server).Gossip.func3.1()
    /go/src/github.com/cockroachdb/cockroach/gossip/server.go:123 +0x87
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420232090, 0xc420dd0140)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 389 [select]:
google.golang.org/grpc/transport.(*Stream).Header(0xc4200ea3c0, 0x1702df0, 0xc420401b88, 0x1eeeca0)
    /go/src/google.golang.org/grpc/transport/transport.go:239 +0x299
google.golang.org/grpc.recvResponse(0x1ee7f80, 0x2257890, 0x0, 0x0, 0x0, 0x0, 0x1edce00, 0xc4200f2de0, 0x0, 0x0, ...)
    /go/src/google.golang.org/grpc/call.go:62 +0xad
google.golang.org/grpc.Invoke(0x7f6270c8d800, 0xc42033e060, 0x15f09fd, 0x21, 0x15b8f80, 0xc4206a8b68, 0x155e960, 0xc42033e0c0, 0xc42000bb00, 0x0, ...)
    /go/src/google.golang.org/grpc/call.go:202 +0x846
github.com/cockroachdb/cockroach/roachpb.(*internalClient).Batch(0xc4207aa1d8, 0x7f6270c8d800, 0xc42033e060, 0xc4206a8b68, 0x0, 0x0, 0x0, 0xc420ab25d0, 0xbb7838, 0x1bbf7fb)
    /go/src/github.com/cockroachdb/cockroach/roachpb/api.pb.go:1545 +0xd2
github.com/cockroachdb/cockroach/kv.(*grpcTransport).SendNext.func1(0xc420bb0b40, 0xc4206a8b40, 0xc42018fec0)
    /go/src/github.com/cockroachdb/cockroach/kv/transport.go:185 +0xfd
created by github.com/cockroachdb/cockroach/kv.(*grpcTransport).SendNext
    /go/src/github.com/cockroachdb/cockroach/kv/transport.go:194 +0x19a

goroutine 189 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startComputePeriodicMetrics.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:618 +0x256
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c0a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 190 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:578 +0x465
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c189c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 191 [semacquire]:
sync.runtime_Semacquire(0xc420bdc82c)
    /usr/local/go/src/runtime/sema.go:47 +0x30
sync.(*Mutex).Lock(0xc420bdc828)
    /usr/local/go/src/sync/mutex.go:85 +0xd0
github.com/cockroachdb/cockroach/gossip.(*Gossip).GetNodeDescriptor(0xc42029bce0, 0x1, 0x0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/gossip/gossip.go:373 +0x54
github.com/cockroachdb/cockroach/kv.newReplicaSlice(0xc42029bce0, 0xc420014c00, 0x1b, 0x2, 0x2)
    /go/src/github.com/cockroachdb/cockroach/kv/replica_slice.go:53 +0x101
github.com/cockroachdb/cockroach/kv.(*DistSender).sendSingleRange(0xc420bb6ea0, 0x7f6270cce288, 0xc420214900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc4201ac600, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:462 +0xa8
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk.func2(0xc420bd4a20, 0xc420bd48c0, 0xc420bd5108, 0xc420bb6ea0, 0xc420bd50f8, 0x8, 0xc420178600)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:739 +0x18e
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk(0xc420bb6ea0, 0x7f6270cce288, 0xc420214900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc4201ac600, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:740 +0x437
github.com/cockroachdb/cockroach/kv.(*DistSender).Send(0xc420bb6ea0, 0x7f6270cce288, 0xc420214900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc4201ac600, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:584 +0x3c0
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc420c1fc80, 0x7f6270cce288, 0xc420214900, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc420b229f8, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:375 +0x546
github.com/cockroachdb/cockroach/internal/client.(*txnSender).Send(0xc420b229a0, 0x7f6270ccca40, 0xc4200106b8, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc420b229f8, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:52 +0xb6
github.com/cockroachdb/cockroach/internal/client.(*DB).send(0xc420b229a0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:486 +0x220
github.com/cockroachdb/cockroach/internal/client.(*Txn).send(0xc420b229a0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:675 +0x4d4
github.com/cockroachdb/cockroach/internal/client.(*Txn).(github.com/cockroachdb/cockroach/internal/client.send)-fm(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:359 +0x58
github.com/cockroachdb/cockroach/internal/client.sendAndFill(0xc420bd6350, 0xc420288d80, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:415 +0x16b
github.com/cockroachdb/cockroach/internal/client.(*Txn).Run(0xc420b229a0, 0xc420288d80, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:359 +0xc6
github.com/cockroachdb/cockroach/internal/client.runOneResult(0x1ed6e40, 0xc420b229a0, 0xc420288d80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:513 +0x80
github.com/cockroachdb/cockroach/internal/client.runOneRow(0x1ed6e40, 0xc420b229a0, 0xc420288d80, 0x18, 0xc4202f62c0, 0x0, 0x220ad20, 0x10, 0x7f6270d274b0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:527 +0x5a
github.com/cockroachdb/cockroach/internal/client.(*Txn).Get(0xc420b229a0, 0x1538560, 0xc4202f62c0, 0xc4202f62c0, 0x18, 0x18, 0xc420178601, 0xc4202f62c0, 0xc420bd65d8)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:221 +0xbd
github.com/cockroachdb/cockroach/internal/client.(*Txn).GetProto(0xc420b229a0, 0x1538560, 0xc4202f62c0, 0x1ee6040, 0xc420178620, 0x10, 0xc420214750)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:229 +0x49
github.com/cockroachdb/cockroach/sql.(*planner).getDescriptor(0xc4204d4800, 0x1ee0c40, 0xc4206f7720, 0x1ef02a0, 0xc420b369c0, 0xc420231e00, 0x1618d70, 0x6)
    /go/src/github.com/cockroachdb/cockroach/sql/descriptor.go:167 +0x209
github.com/cockroachdb/cockroach/sql.(*planner).getDatabaseDesc(0xc4204d4800, 0x1618d70, 0x6, 0x0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/sql/database.go:133 +0x22e
github.com/cockroachdb/cockroach/sql.(*planner).mustGetDatabaseDesc(0xc4204d4800, 0x1618d70, 0x6, 0x0, 0x0, 0x14ab0a0)
    /go/src/github.com/cockroachdb/cockroach/sql/database.go:142 +0x43
github.com/cockroachdb/cockroach/sql.(*planner).getTableDesc(0xc4204d4800, 0xc4208062c0, 0x636f6c6300000002, 0x1, 0xc4201aa960)
    /go/src/github.com/cockroachdb/cockroach/sql/table.go:130 +0xe0
github.com/cockroachdb/cockroach/sql.(*planner).mustGetTableDesc(0xc4204d4800, 0xc4208062c0, 0x1618d70, 0x6, 0x22588a0)
    /go/src/github.com/cockroachdb/cockroach/sql/table.go:148 +0x39
github.com/cockroachdb/cockroach/sql.(*planner).getTableLease(0xc4204d4800, 0xc4208062c0, 0x65180a232a000000, 0x6574616c2e636578, 0x2d6d30312d79636e)
    /go/src/github.com/cockroachdb/cockroach/sql/table.go:178 +0x8eb
github.com/cockroachdb/cockroach/sql.(*planner).getAliasedTableLease(0xc4204d4800, 0x1edef40, 0xc420806300, 0x79636e6574616c2e, 0x113537702d68312d, 0x0)
    /go/src/github.com/cockroachdb/cockroach/sql/table.go:334 +0x83
github.com/cockroachdb/cockroach/sql.(*planner).makeEditNode(0xc4204d4800, 0x1edef40, 0xc420806300, 0x639397000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/sql/update.go:43 +0x88
github.com/cockroachdb/cockroach/sql.(*planner).Insert(0xc4204d4800, 0xc4206aec80, 0x0, 0x0, 0x0, 0x0, 0xc4206f76a8, 0x0, 0x14580c0, 0xc4206f74b0)
    /go/src/github.com/cockroachdb/cockroach/sql/insert.go:58 +0x9e
github.com/cockroachdb/cockroach/sql.(*planner).newPlan(0xc4204d4800, 0x1ee9100, 0xc4206aec80, 0x0, 0x0, 0x0, 0x1457600, 0xc4206f76b0, 0x0, 0x1ee9100, ...)
    /go/src/github.com/cockroachdb/cockroach/sql/plan.go:260 +0x16fe
github.com/cockroachdb/cockroach/sql.(*planner).makePlan(0xc4204d4800, 0x1ee9100, 0xc4206aec80, 0x0, 0x0, 0x0, 0xc4204d5000, 0x0)
    /go/src/github.com/cockroachdb/cockroach/sql/plan.go:212 +0x70
github.com/cockroachdb/cockroach/sql.(*planner).query(0xc4204d4800, 0x1618d63, 0x74, 0xc420bd7978, 0x5, 0x5, 0x0, 0x0, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/sql/planner.go:215 +0xbd
github.com/cockroachdb/cockroach/sql.(*planner).exec(0xc4204d4800, 0x1618d63, 0x74, 0xc420bd7978, 0x5, 0x5, 0x5fdc6b, 0x14580c0, 0xc4206f74b0)
    /go/src/github.com/cockroachdb/cockroach/sql/planner.go:243 +0x6d
github.com/cockroachdb/cockroach/sql.InternalExecutor.ExecuteStatementInTransaction(0xc4206a8c80, 0xc420b229a0, 0x1618d63, 0x74, 0xc420bd7978, 0x5, 0x5, 0xc420ab1996, 0xc41ffb72d2, 0xc420ab19a0)
    /go/src/github.com/cockroachdb/cockroach/sql/internal.go:46 +0xb5
github.com/cockroachdb/cockroach/sql.EventLogger.InsertEventRecord(0xc4206a8c80, 0xc420b229a0, 0x15d9d9c, 0x9, 0x300000003, 0x15077a0, 0xc42091a5a0, 0x0, 0x3fc3333333333333)
    /go/src/github.com/cockroachdb/cockroach/sql/event_log.go:134 +0x395
github.com/cockroachdb/cockroach/server.(*Node).recordJoinEvent.func1.1(0xc420b229a0, 0x0, 0x1)
    /go/src/github.com/cockroachdb/cockroach/server/node.go:723 +0x126
github.com/cockroachdb/cockroach/internal/client.(*DB).Txn.func1(0xc420b229a0, 0xc420b36720, 0x4000000000000000, 0x0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:450 +0x2f
github.com/cockroachdb/cockroach/internal/client.(*Txn).Exec(0xc420b229a0, 0xc4206f0101, 0x0, 0x0, 0xc4206f7380, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/txn.go:553 +0x232
github.com/cockroachdb/cockroach/internal/client.(*DB).Txn(0xc420bc6320, 0xc420b36700, 0x4000000000000000, 0x0)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:451 +0x28d
github.com/cockroachdb/cockroach/server.(*Node).recordJoinEvent.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:724 +0x1d9
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c0c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 192 [select]:
github.com/cockroachdb/cockroach/server.(*Server).startSampleEnvironment.func1()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:565 +0x16b
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c140)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 193 [select]:
github.com/cockroachdb/cockroach/kv.(*DistSender).sendToReplicas(0xc420bb6ea0, 0x7f6270cce288, 0xc420164cc0, 0x2540be400, 0xb2d05e00, 0x0, 0x1, 0xc42048b460, 0x1, 0x1, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:937 +0xa77
github.com/cockroachdb/cockroach/kv.(*DistSender).sendRPC(0xc420bb6ea0, 0x7f6270cce288, 0xc420164cc0, 0x1, 0xc42048b460, 0x1, 0x1, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:364 +0x1c6
github.com/cockroachdb/cockroach/kv.(*DistSender).sendSingleRange(0xc420bb6ea0, 0x7f6270cce288, 0xc420164cc0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:480 +0x19f
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk.func2(0xc420c42778, 0xc420c42618, 0xc420c42e60, 0xc420bb6ea0, 0xc420c42e50, 0x60, 0xc42019bc20)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:739 +0x18e
github.com/cockroachdb/cockroach/kv.(*DistSender).sendChunk(0xc420bb6ea0, 0x7f6270cce288, 0xc420164cc0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:740 +0x437
github.com/cockroachdb/cockroach/kv.(*DistSender).Send(0xc420bb6ea0, 0x7f6270cce288, 0xc420164cc0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/dist_sender.go:584 +0x3c0
github.com/cockroachdb/cockroach/kv.(*TxnCoordSender).Send(0xc420c1fc80, 0x7f6270cce288, 0xc420164cc0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/kv/txn_coord_sender.go:375 +0x546
github.com/cockroachdb/cockroach/internal/client.(*DB).send(0xc420bc6320, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:486 +0x220
github.com/cockroachdb/cockroach/internal/client.(*DB).(github.com/cockroachdb/cockroach/internal/client.send)-fm(0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:433 +0x58
github.com/cockroachdb/cockroach/internal/client.sendAndFill(0xc420c43a90, 0xc420706480, 0x0, 0xc420dd5bc8)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:415 +0x16b
github.com/cockroachdb/cockroach/internal/client.(*DB).Run(0xc420bc6320, 0xc420706480, 0x1, 0x1)
    /go/src/github.com/cockroachdb/cockroach/internal/client/db.go:433 +0x75
github.com/cockroachdb/cockroach/ts.(*DB).StoreData(0xc420bc80c0, 0x1, 0xc420bb8000, 0x98, 0x124, 0xbb5bc2, 0xc420dd5dd8)
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:143 +0x77c
github.com/cockroachdb/cockroach/ts.(*poller).poll.func1()
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:100 +0x7d
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunTask(0xc420bb6e10, 0xc420c43e68, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:215 +0x100
github.com/cockroachdb/cockroach/ts.(*poller).poll(0xc420c189f0)
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:103 +0x4e
github.com/cockroachdb/cockroach/ts.(*poller).start.func1()
    /go/src/github.com/cockroachdb/cockroach/ts/db.go:77 +0x41
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1a140)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 370 [select]:
github.com/cockroachdb/cockroach/server.(*Node).startWriteSummaries.func1()
    /go/src/github.com/cockroachdb/cockroach/server/node.go:652 +0x2bb
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c160)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 371 [select]:
github.com/cockroachdb/cockroach/sql.(*SchemaChangeManager).Start.func1()
    /go/src/github.com/cockroachdb/cockroach/sql/schema_changer.go:682 +0x12b7
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c180)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 372 [IO wait]:
net.runtime_pollWait(0x7f6270ccd280, 0x72, 0x0)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc420c2fd40, 0x72, 0xc420aacdf8, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc420c2fd40, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).accept(0xc420c2fce0, 0x0, 0x1edb140, 0xc4209b0040)
    /usr/local/go/src/net/fd_unix.go:419 +0x238
net.(*TCPListener).accept(0xc420bc8110, 0x624bce, 0xc420aacea8, 0xe4a3cb)
    /usr/local/go/src/net/tcpsock_posix.go:132 +0x2e
net.(*TCPListener).Accept(0xc420bc8110, 0x1700a98, 0xc4206c6a40, 0x1eef180, 0xc4200f6000)
    /usr/local/go/src/net/tcpsock.go:222 +0x49
github.com/cockroachdb/cmux.(*cMux).Serve(0xc4206c6a40, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cmux/cmux.go:124 +0xa4
github.com/cockroachdb/cockroach/server.(*Server).Start.func11()
    /go/src/github.com/cockroachdb/cockroach/server/server.go:439 +0x2f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420b9c1c0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 375 [select]:
google.golang.org/grpc.(*addrConn).wait(0xc4207c2000, 0x7f6270c8d800, 0xc420b90360, 0x1, 0xc420081500, 0x15, 0x16fd617, 0x16fd616)
    /go/src/google.golang.org/grpc/clientconn.go:782 +0x173
google.golang.org/grpc.(*ClientConn).getTransport(0xc42000af00, 0x7f6270c8d800, 0xc420b90360, 0x0, 0x0, 0xc420bb0320, 0x7f6270d28770, 0x61b66c, 0xc420dd4ae8)
    /go/src/google.golang.org/grpc/clientconn.go:505 +0x298
google.golang.org/grpc.Invoke(0x7f6270c8d800, 0xc420b90360, 0x15ec46a, 0x1d, 0x1552b00, 0xc420948640, 0x15450a0, 0xc420b6c320, 0xc42000af00, 0x0, ...)
    /go/src/google.golang.org/grpc/call.go:167 +0x2bf
github.com/cockroachdb/cockroach/rpc.(*heartbeatClient).Ping(0xc4207aa1c0, 0x7f6270c8d800, 0xc420b90360, 0xc420948640, 0x0, 0x0, 0x0, 0xc4200f4188, 0xc4200f4188, 0xc4203f6528)
    /go/src/github.com/cockroachdb/cockroach/rpc/heartbeat.pb.go:121 +0xd2
github.com/cockroachdb/cockroach/rpc.(*Context).heartbeat(0xc420c1f020, 0x1ed7500, 0xc4207aa1c0, 0x0, 0x0, 0x0, 0x0, 0x0, 0xc42027ee60, 0xf, ...)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:307 +0x16c
github.com/cockroachdb/cockroach/rpc.(*Context).runHeartbeat(0xc420c1f020, 0xc42000af00, 0xc420c34090, 0xc42027ee60, 0xf, 0x0, 0x0)
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:257 +0x1e3
github.com/cockroachdb/cockroach/rpc.(*Context).GRPCDial.func1.1()
    /go/src/github.com/cockroachdb/cockroach/rpc/context.go:189 +0x7f
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c18d50)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 374 [select]:
google.golang.org/grpc/credentials.(*tlsCreds).ClientHandshake(0xc420b60018, 0x7f6270c8d800, 0xc420ba2780, 0xc42027ee60, 0xf, 0x1eef180, 0xc420b60088, 0x0, 0x0, 0x40, ...)
    /go/src/google.golang.org/grpc/credentials/credentials.go:154 +0x366
google.golang.org/grpc/transport.newHTTP2Client(0x7f6270c8d800, 0xc420ba2780, 0xc42027ee60, 0xf, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/google.golang.org/grpc/transport/http2_client.go:129 +0x1386
google.golang.org/grpc/transport.NewClientTransport(0x7f6270c8d800, 0xc420ba2780, 0xc42027ee60, 0xf, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
    /go/src/google.golang.org/grpc/transport/transport.go:368 +0x87
google.golang.org/grpc.(*addrConn).resetTransport(0xc4207c2000, 0xc420b9c300, 0xc4206c22a0, 0xa3bd03)
    /go/src/google.golang.org/grpc/clientconn.go:639 +0x25e
google.golang.org/grpc.(*ClientConn).resetAddrConn.func1(0xc4207c2000)
    /go/src/google.golang.org/grpc/clientconn.go:453 +0x34
created by google.golang.org/grpc.(*ClientConn).resetAddrConn
    /go/src/google.golang.org/grpc/clientconn.go:462 +0x3c7

goroutine 376 [chan receive]:
database/sql.(*DB).connectionOpener(0xc4201d4580)
    /usr/local/go/src/database/sql/sql.go:730 +0x4a
created by database/sql.Open
    /usr/local/go/src/database/sql/sql.go:493 +0x1e9

goroutine 380 [IO wait]:
net.runtime_pollWait(0x7f6270cccf80, 0x72, 0x12)
    /usr/local/go/src/runtime/netpoll.go:160 +0x59
net.(*pollDesc).wait(0xc42047cfb0, 0x72, 0xc420dd8838, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:73 +0x38
net.(*pollDesc).waitRead(0xc42047cfb0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_poll_runtime.go:78 +0x34
net.(*netFD).Read(0xc42047cf50, 0xc420153c00, 0x400, 0x400, 0x0, 0x1eddc80, 0xc4200100b8)
    /usr/local/go/src/net/fd_unix.go:243 +0x1a1
net.(*conn).Read(0xc420b60088, 0xc420153c00, 0x400, 0x400, 0x0, 0x0, 0x0)
    /usr/local/go/src/net/net.go:173 +0x70
crypto/tls.(*block).readFromUntil(0xc420c19740, 0x7f6270018000, 0xc420b60088, 0x5, 0xc420b60088, 0xc420c051e0)
    /usr/local/go/src/crypto/tls/conn.go:472 +0x91
crypto/tls.(*Conn).readRecord(0xc420b8ca80, 0x416, 0x91, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:574 +0xc4
crypto/tls.(*Conn).readHandshake(0xc420b8ca80, 0xc420c34116, 0xc420c34120, 0x8c, 0x8c)
    /usr/local/go/src/crypto/tls/conn.go:925 +0x8f
crypto/tls.(*Conn).clientHandshake(0xc420b8ca80, 0x1703928, 0xc420b8cb80)
    /usr/local/go/src/crypto/tls/handshake_client.go:159 +0x99f
crypto/tls.(*Conn).Handshake(0xc420b8ca80, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1232 +0xd3
google.golang.org/grpc/credentials.(*tlsCreds).ClientHandshake.func1(0xc420ba2960, 0xc420b8ca80)
    /go/src/google.golang.org/grpc/credentials/credentials.go:152 +0x2b
created by google.golang.org/grpc/credentials.(*tlsCreds).ClientHandshake
    /go/src/google.golang.org/grpc/credentials/credentials.go:153 +0x132

goroutine 228 [runnable]:
math/big.nat.montgomery(0xc4203f4240, 0x10, 0x24, 0xc420dbeb40, 0x10, 0x26, 0xc420dbeb40, 0x10, 0x26, 0xc420ba9550, ...)
    /usr/local/go/src/math/big/nat.go:211
math/big.nat.expNNMontgomery(0xc420dbeb40, 0x10, 0x24, 0xc420934d80, 0x10, 0x25, 0xc420be6a00, 0x10, 0x25, 0xc420ba9550, ...)
    /usr/local/go/src/math/big/nat.go:1141 +0x848
math/big.nat.expNN(0x0, 0x0, 0x0, 0xc420934d80, 0x20, 0x45, 0xc420be6a00, 0x10, 0x25, 0xc420ba9550, ...)
    /usr/local/go/src/math/big/nat.go:955 +0x990
math/big.(*Int).Exp(0xc42090d7c0, 0xc42045f460, 0xc420326540, 0xc420326440, 0x20)
    /usr/local/go/src/math/big/int.go:420 +0xf2
crypto/rsa.decrypt(0x1ed6900, 0xc4200124e0, 0xc420c1ed80, 0xc42045f460, 0x0, 0x0, 0x0)
    /usr/local/go/src/crypto/rsa/rsa.go:507 +0x3c7
crypto/rsa.decryptAndCheck(0x1ed6900, 0xc4200124e0, 0xc420c1ed80, 0xc42045f5b0, 0xc42045f5b0, 0x100, 0x0)
    /usr/local/go/src/crypto/rsa/rsa.go:542 +0x56
crypto/rsa.SignPKCS1v15(0x1ed6900, 0xc4200124e0, 0xc420c1ed80, 0x5, 0xc4209b0260, 0x20, 0x20, 0xc42045f648, 0x5fdd1f, 0x14d88c0, ...)
    /usr/local/go/src/crypto/rsa/pkcs1v15.go:250 +0x2b1
crypto/rsa.(*PrivateKey).Sign(0xc420c1ed80, 0x1ed6900, 0xc4200124e0, 0xc4209b0260, 0x20, 0x20, 0x1edb540, 0xc4206b8500, 0x0, 0x0, ...)
    /usr/local/go/src/crypto/rsa/rsa.go:102 +0x167
crypto/tls.(*ecdheKeyAgreement).generateServerKeyExchange(0xc4206ab780, 0xc42029bb80, 0xc420c1ede0, 0xc420dbe000, 0xc420bf41a0, 0x34f, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/key_agreement.go:255 +0x67c
crypto/tls.(*serverHandshakeState).doFullHandshake(0xc42045fb28, 0xc420aadb00, 0x0)
    /usr/local/go/src/crypto/tls/handshake_server.go:397 +0x3de
crypto/tls.(*Conn).serverHandshake(0xc4207a8e00, 0x1703928, 0xc4207a8f00)
    /usr/local/go/src/crypto/tls/handshake_server.go:86 +0x30d
crypto/tls.(*Conn).Handshake(0xc4207a8e00, 0x0, 0x0)
    /usr/local/go/src/crypto/tls/conn.go:1234 +0x14e
google.golang.org/grpc/credentials.(*tlsCreds).ServerHandshake(0xc420bc8068, 0x1eeef40, 0xc420124000, 0x1, 0x1, 0x1ee7380, 0xc420bc8110, 0xc4209037a0, 0xc420bc8118)
    /go/src/google.golang.org/grpc/credentials/credentials.go:170 +0xd3
google.golang.org/grpc.(*Server).useTransportAuthenticator(0xc420bb3f40, 0x1eeef40, 0xc420124000, 0xc4206f6010, 0x0, 0xc420af9778, 0x61a9b3, 0xc420af9748, 0xbb743f)
    /go/src/google.golang.org/grpc/server.go:321 +0x50
google.golang.org/grpc.(*Server).handleRawConn(0xc420bb3f40, 0x1eeef40, 0xc420124000)
    /go/src/google.golang.org/grpc/server.go:364 +0x5a
created by google.golang.org/grpc.(*Server).Serve
    /go/src/google.golang.org/grpc/server.go:357 +0x1a9

goroutine 324 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).processRaft.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:2554 +0x8a6
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4200)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 326 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).Start.func4()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1134 +0x165
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4240)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 327 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1208 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4260)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 328 [select]:
github.com/cockroachdb/cockroach/storage.(*Store).startGossip.func2()
    /go/src/github.com/cockroachdb/cockroach/storage/store.go:1227 +0x263
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4280)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 331 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4360)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 332 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc42047c0e0, 0xecf38bb27, 0xc40767f810, 0x2208f40, 0xc4200f4180, 0xc420bb6e10, 0x0, 0x61a9b3)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:229 +0x2c1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc4203e4380)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 357 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c7e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 358 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c800)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 359 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c820)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 360 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c840)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 361 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c860)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 362 [select]:
github.com/cockroachdb/cockroach/storage.(*baseQueue).processLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/queue.go:402 +0x2a1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c8a0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 363 [select]:
github.com/cockroachdb/cockroach/storage.(*replicaScanner).waitAndProcess(0xc420c2fdc0, 0xecf38bb27, 0xc407697554, 0x2208f40, 0xc4200f4180, 0xc420bb6e10, 0x0, 0x61a9b3)
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:176 +0x382
github.com/cockroachdb/cockroach/storage.(*replicaScanner).scanLoop.func1()
    /go/src/github.com/cockroachdb/cockroach/storage/scanner.go:229 +0x2c1
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker.func1(0xc420bb6e10, 0xc420c1c8e0)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:187 +0x7d
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunWorker
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:188 +0x66

goroutine 365 [select]:
google.golang.org/grpc/transport.(*Stream).Header(0xc4201fce10, 0x1702df0, 0xc420edfb88, 0x1eeeca0)
    /go/src/google.golang.org/grpc/transport/transport.go:239 +0x299
google.golang.org/grpc.recvResponse(0x1ee7f80, 0x2257890, 0x0, 0x0, 0x0, 0x0, 0x1edce00, 0xc4200f2de0, 0x0, 0x0, ...)
    /go/src/google.golang.org/grpc/call.go:62 +0xad
google.golang.org/grpc.Invoke(0x7f6270c8d800, 0xc4200f04e0, 0x15f09fd, 0x21, 0x15b8f80, 0xc420bb2528, 0x155e960, 0xc4200f0540, 0xc42000bb00, 0x0, ...)
    /go/src/google.golang.org/grpc/call.go:202 +0x846
github.com/cockroachdb/cockroach/roachpb.(*internalClient).Batch(0xc42016a0a0, 0x7f6270c8d800, 0xc4200f04e0, 0xc420bb2528, 0x0, 0x0, 0x0, 0xc420181900, 0x0, 0xc420c1f920)
    /go/src/github.com/cockroachdb/cockroach/roachpb/api.pb.go:1545 +0xd2
github.com/cockroachdb/cockroach/kv.(*grpcTransport).SendNext.func1(0xc420c24d20, 0xc420bb2500, 0xc4200f0360)
    /go/src/github.com/cockroachdb/cockroach/kv/transport.go:185 +0xfd
created by github.com/cockroachdb/cockroach/kv.(*grpcTransport).SendNext
    /go/src/github.com/cockroachdb/cockroach/kv/transport.go:194 +0x19a

goroutine 244 [runnable]:
sync.runtime_Semacquire(0xc42017e7dc)
    /usr/local/go/src/runtime/sema.go:47 +0x30
sync.(*Mutex).Lock(0xc42017e7d8)
    /usr/local/go/src/sync/mutex.go:85 +0xd0
github.com/cockroachdb/cockroach/gossip.(*infoStore).runCallbacks.func2()
    /go/src/github.com/cockroachdb/cockroach/gossip/infostore.go:278 +0x3e
github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask.func1(0xc420232090, 0x1bbf7fb, 0x13, 0x122, 0xc420808240)
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:231 +0x95
created by github.com/cockroachdb/cockroach/util/stop.(*Stopper).RunAsyncTask
    /go/src/github.com/cockroachdb/cockroach/util/stop/stopper.go:232 +0xbc

goroutine 366 [runnable]:
google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc420180570, 0xc4200aa140, 0x1eeed00, 0xc420bb73b0, 0xc4201fcf00)
    /go/src/google.golang.org/grpc/server.go:417
created by google.golang.org/grpc.(*Server).serveStreams.func1
    /go/src/google.golang.org/grpc/server.go:420 +0xa3

ERROR: exit status 2

Run Details:

50 runs so far, 0 failures, over 5s
117 runs so far, 0 failures, over 10s
185 runs so far, 0 failures, over 15s
257 runs so far, 0 failures, over 20s
323 runs so far, 0 failures, over 25s
391 runs so far, 0 failures, over 30s
456 runs so far, 0 failures, over 35s
525 runs so far, 0 failures, over 40s
591 runs so far, 0 failures, over 45s
602 runs completed, 1 failures, over 46s
FAIL

Please assign, take a look and update the issue accordingly.

cockroachdb / cockroach

stress: failed test in cockroach/sql/distsql/distsql.test: TestClusterFlow #8358

8349.