cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.17k stars 3.82k forks source link

'make testrace' fails in storage & storage/engine #84

Closed tbg closed 10 years ago

tbg commented 10 years ago

Time to fix this, #54 and get on with it.

cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb; make static_lib
make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb'
g++ -g -Wall -Werror -Wsign-compare -I. -I./include -std=c++11  -DROCKSDB_PLATFORM_POSIX  -DOS_LINUX -fno-builtin-memcmp -DROCKSDB_ATOMIC_PRESENT -DROCKSDB_FALLOCATE_PRESENT -DSNAPPY -DGFLAGS=google -DZLIB -DBZIP2   -DHAVE_JEMALLOC -O2 -fno-omit-frame-pointer -momit-leaf-frame-pointer -DNDEBUG -Woverloaded-virtual -c util/build_version.cc -o util/build_version.o 
rm -f librocksdb.a
ar -rs librocksdb.a db/builder.o db/c.o db/column_family.o db/compaction.o db/compaction_picker.o db/db_filesnapshot.o db/dbformat.o db/db_impl.o db/db_impl_debug.o db/db_impl_readonly.o db/db_iter.o db/file_indexer.o db/filename.o db/forward_iterator.o db/internal_stats.o db/log_reader.o db/log_writer.o db/memtable.o db/memtable_list.o db/merge_helper.o db/merge_operator.o db/repair.o db/table_cache.o db/table_properties_collector.o db/tailing_iter.o db/transaction_log_impl.o db/version_edit.o db/version_set.o db/write_batch.o table/adaptive_table_factory.o table/block_based_table_builder.o table/block_based_table_factory.o table/block_based_table_reader.o table/block_builder.o table/block.o table/block_hash_index.o table/block_prefix_index.o table/bloom_block.o table/cuckoo_table_builder.o table/cuckoo_table_reader.o table/filter_block.o table/flush_block_policy.o table/format.o table/iterator.o table/merger.o table/meta_blocks.o table/plain_table_builder.o table/plain_table_factory.o table/plain_table_index.o table/plain_table_key_coding.o table/plain_table_reader.o table/table_properties.o table/two_level_iterator.o util/arena.o util/auto_roll_logger.o util/blob_store.o util/bloom.o util/build_version.o util/cache.o util/coding.o util/comparator.o util/crc32c.o util/dynamic_bloom.o util/env.o util/env_hdfs.o util/env_posix.o util/filter_policy.o util/hash.o util/hash_cuckoo_rep.o util/hash_linklist_rep.o util/hash_skiplist_rep.o util/histogram.o util/iostats_context.o utilities/backupable/backupable_db.o utilities/document/document_db.o utilities/document/json_document.o utilities/geodb/geodb_impl.o utilities/merge_operators/put.o utilities/merge_operators/string_append/stringappend2.o utilities/merge_operators/string_append/stringappend.o utilities/merge_operators/uint64add.o utilities/redis/redis_lists.o utilities/spatialdb/spatial_db.o utilities/ttl/db_ttl_impl.o util/ldb_cmd.o util/ldb_tool.o util/log_buffer.o util/logging.o util/murmurhash.o util/options_builder.o util/options.o util/perf_context.o util/rate_limiter.o util/skiplistrep.o util/slice.o util/statistics.o util/status.o util/string_util.o util/sync_point.o util/thread_local.o util/vectorrep.o util/xxhash.o port/port_posix.o port/stack_trace.o 
make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb'
cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib
make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto'
make[1]: Nothing to be done for 'static_lib'.
make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto'
cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib
make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib'
make[1]: Nothing to be done for 'static_lib'.
make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib'
cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/sql/parser; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make
CGO_LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " go test -race -run ".*" "./..." -logtostderr -timeout 10s
?       github.com/cockroachdb/cockroach    [no test files]
ok      github.com/cockroachdb/cockroach/gossip 1.409s
==================
WARNING: DATA RACE
Read by goroutine 16:
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).Put()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123
  github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 16:
  github.com/cockroachdb/cockroach/util.(*intervalKey).Start()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c
  github.com/cockroachdb/cockroach/util.(*intervalKey).Overlap()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14:
  github.com/cockroachdb/cockroach/util.(*intervalKey).SetStart()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).Put()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123
  github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 16:
  github.com/cockroachdb/cockroach/util.(*intervalKey).End()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c
  github.com/cockroachdb/cockroach/util.(*intervalKey).Overlap()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14:
  github.com/cockroachdb/cockroach/util.(*intervalKey).SetEnd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a
  code.google.com/p/biogo.store/interval.(*Node).adjustRange()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610
  code.google.com/p/biogo.store/interval.(*Node).fixUp()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).Put()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123
  github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 16:
  code.google.com/p/biogo.store/interval.(*Node).doMatch()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14:
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).Put()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123
  github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 16:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x2af
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).Put()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123
  github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Write by goroutine 27:
  github.com/cockroachdb/cockroach/kv.func·006()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:142 +0x23c
  github.com/cockroachdb/cockroach/util.IsTrueWithin()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/testing.go:82 +0x64
  github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:149 +0x457
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous read by goroutine 36:
  github.com/cockroachdb/cockroach/util/hlc.*ManualClock.UnixNano·fm()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:36 +0x39
  github.com/cockroachdb/cockroach/util/hlc.(*Clock).Update()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/hlc/hlc.go:169 +0x193
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:418 +0x38b
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 27 (running) created at:
  testing.RunTests()
      /usr/local/go/src/pkg/testing/testing.go:504 +0xb46
  testing.Main()
      /usr/local/go/src/pkg/testing/testing.go:435 +0xa2
  main.main()
      github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc

Goroutine 36 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f
==================
==================
WARNING: DATA RACE
Write by goroutine 27:
  github.com/cockroachdb/cockroach/storage.(*Store).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:146 +0x195
  github.com/cockroachdb/cockroach/kv.(*LocalKV).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe
  github.com/cockroachdb/cockroach/kv.(*DB).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f
  github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:153 +0x554
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous read by goroutine 36:
  github.com/cockroachdb/cockroach/storage.(*Store).GetRange()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:242 +0xb1
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:425 +0x1a2
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 27 (running) created at:
  testing.RunTests()
      /usr/local/go/src/pkg/testing/testing.go:504 +0xb46
  testing.Main()
      /usr/local/go/src/pkg/testing/testing.go:435 +0xa2
  main.main()
      github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc

Goroutine 36 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalHeartbeatTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).heartbeat()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f
==================
==================
WARNING: DATA RACE
Read by goroutine 43:
  github.com/cockroachdb/cockroach/storage.(*Store).LookupRange()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:256 +0x10f
  github.com/cockroachdb/cockroach/kv.(*LocalKV).lookupReplica()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:144 +0x1ac
  github.com/cockroachdb/cockroach/kv.(*LocalKV).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:109 +0x10d
  github.com/cockroachdb/cockroach/kv.(*DB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 37:
  github.com/cockroachdb/cockroach/storage.(*Store).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:147 +0x1ba
  github.com/cockroachdb/cockroach/kv.(*LocalKV).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe
  github.com/cockroachdb/cockroach/kv.(*DB).Close()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f
  github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:187 +0x56c
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 43 (running) created at:
  github.com/cockroachdb/cockroach/kv.(*DB).InternalResolveIntent()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:245 +0xca
  github.com/cockroachdb/cockroach/kv.(*coordinator).EndTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:198 +0x359
  github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:181 +0x404
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 37 (finished) created at:
  testing.RunTests()
      /usr/local/go/src/pkg/testing/testing.go:504 +0xb46
  testing.Main()
      /usr/local/go/src/pkg/testing/testing.go:435 +0xa2
  main.main()
      github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc
==================
I0927 14:56:07.440885 31689 simulation.go:62] simulating gossip network with 3 nodes
I0927 14:56:07.443450 31689 server.go:88] serving on /tmp/unix-socket039167907...
I0927 14:56:07.443531 31689 server.go:88] serving on /tmp/unix-socket413785254...
I0927 14:56:07.443577 31689 server.go:88] serving on /tmp/unix-socket447364045...
I0927 14:56:07.443656 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254
I0927 14:56:07.443904 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket039167907
I0927 14:56:07.444122 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254
I0927 14:56:07.448062 31689 client.go:124] client /tmp/unix-socket039167907 connected
I0927 14:56:07.449830 31689 client.go:187] client /tmp/unix-socket039167907 starting heartbeat
I0927 14:56:07.450346 31689 client.go:124] client /tmp/unix-socket413785254 connected
I0927 14:56:07.451210 31689 client.go:187] client /tmp/unix-socket413785254 starting heartbeat
I0927 14:56:07.452469 31689 server.go:103] gossip: client /tmp/unix-socket039167907 sent 1 info(s)
I0927 14:56:07.453322 31689 server.go:103] gossip: client /tmp/unix-socket447364045 sent 2 info(s)
I0927 14:56:07.455057 31689 server.go:103] gossip: client /tmp/unix-socket413785254 sent 1 info(s)
W0927 14:56:07.455684 31689 gossip.go:420] missing sentinel gossip cluster-id; assuming partition and reconnecting
I0927 14:56:07.455958 31689 server.go:102] done serving on /tmp/unix-socket039167907
I0927 14:56:07.456055 31689 server.go:102] done serving on /tmp/unix-socket413785254
I0927 14:56:07.456128 31689 server.go:102] done serving on /tmp/unix-socket447364045
I0927 14:56:07.456350 31689 simulation.go:62] simulating gossip network with 1 nodes
I0927 14:56:07.467819 31689 server.go:88] serving on /tmp/unix-socket480063176...
I0927 14:56:07.467883 31689 server.go:102] done serving on /tmp/unix-socket480063176
PASS
Found 8 data race(s)
FAIL    github.com/cockroachdb/cockroach/kv 1.111s
ok      github.com/cockroachdb/cockroach/multiraft  1.100s
ok      github.com/cockroachdb/cockroach/proto  1.026s
ok      github.com/cockroachdb/cockroach/rpc    1.879s
ok      github.com/cockroachdb/cockroach/server 2.091s
?       github.com/cockroachdb/cockroach/server/status  [no test files]
?       github.com/cockroachdb/cockroach/simulation [no test files]
ok      github.com/cockroachdb/cockroach/sql/parser 1.134s
==================
WARNING: DATA RACE
Read by goroutine 78:
  github.com/cockroachdb/cockroach/storage.(*blockingEngine).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:244 +0x7e
  github.com/cockroachdb/cockroach/storage/engine.GetProto()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a
  github.com/cockroachdb/cockroach/storage/engine.(*MVCC).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab
  github.com/cockroachdb/cockroach/storage.(*Range).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0
  github.com/cockroachdb/cockroach/storage.(*Range).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31
  github.com/cockroachdb/cockroach/storage.(*Range).addReadOnlyCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455
  github.com/cockroachdb/cockroach/storage.func·016()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:500 +0x171

Previous write by goroutine 77:
  github.com/cockroachdb/cockroach/storage.(*blockingEngine).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:245 +0xee
  github.com/cockroachdb/cockroach/storage/engine.GetProto()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a
  github.com/cockroachdb/cockroach/storage/engine.(*MVCC).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab
  github.com/cockroachdb/cockroach/storage.(*Range).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0
  github.com/cockroachdb/cockroach/storage.(*Range).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31
  github.com/cockroachdb/cockroach/storage.(*Range).addReadOnlyCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455
  github.com/cockroachdb/cockroach/storage.func·015()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c

Goroutine 78 (running) created at:
  github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:505 +0x8fd
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 77 (running) created at:
  github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 22:
  sync.raceRead()
      /usr/local/go/src/pkg/sync/race.go:37 +0x35
  sync.(*WaitGroup).Add()
      /usr/local/go/src/pkg/sync/waitgroup.go:60 +0xbe
  github.com/cockroachdb/cockroach/storage.(*blockingEngine).block()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:236 +0xc7
  github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:485 +0x658
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous write by goroutine 77:
  sync.raceWrite()
      /usr/local/go/src/pkg/sync/race.go:41 +0x35
  sync.(*WaitGroup).Wait()
      /usr/local/go/src/pkg/sync/waitgroup.go:122 +0x176
  github.com/cockroachdb/cockroach/storage.(*blockingEngine).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:246 +0x127
  github.com/cockroachdb/cockroach/storage/engine.GetProto()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a
  github.com/cockroachdb/cockroach/storage/engine.(*MVCC).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab
  github.com/cockroachdb/cockroach/storage.(*Range).Get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0
  github.com/cockroachdb/cockroach/storage.(*Range).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31
  github.com/cockroachdb/cockroach/storage.(*Range).addReadOnlyCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455
  github.com/cockroachdb/cockroach/storage.func·015()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c

Goroutine 22 (running) created at:
  testing.RunTests()
      /usr/local/go/src/pkg/testing/testing.go:504 +0xb46
  testing.Main()
      /usr/local/go/src/pkg/testing/testing.go:435 +0xa2
  main.main()
      github.com/cockroachdb/cockroach/storage/_test/_testmain.go:189 +0xdc

Goroutine 77 (running) created at:
  github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa
  testing.tRunner()
      /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
==================
==================
WARNING: DATA RACE
Read by goroutine 98:
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
==================
==================
WARNING: DATA RACE
Read by goroutine 98:
  github.com/cockroachdb/cockroach/util.(*intervalKey).Start()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c
  github.com/cockroachdb/cockroach/util.(*intervalKey).Overlap()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96:
  github.com/cockroachdb/cockroach/util.(*intervalKey).SetStart()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
==================
==================
WARNING: DATA RACE
Read by goroutine 98:
  github.com/cockroachdb/cockroach/util.(*intervalKey).End()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c
  github.com/cockroachdb/cockroach/util.(*intervalKey).Overlap()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96:
  github.com/cockroachdb/cockroach/util.(*intervalKey).SetEnd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a
  code.google.com/p/biogo.store/interval.(*Node).adjustRange()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610
  code.google.com/p/biogo.store/interval.(*Node).fixUp()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
==================
==================
WARNING: DATA RACE
Read by goroutine 98:
  code.google.com/p/biogo.store/interval.(*Node).doMatch()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f
  code.google.com/p/biogo.store/interval.(*Tree).Get()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175
  github.com/cockroachdb/cockroach/util.(*IntervalCache).get()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96:
  code.google.com/p/biogo.store/interval.(*Node).delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
==================
==================
WARNING: DATA RACE
Read by goroutine 98:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96:
  code.google.com/p/biogo.store/interval.(*Tree).Delete()
      /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x2af
  github.com/cockroachdb/cockroach/util.(*IntervalCache).del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9
  github.com/cockroachdb/cockroach/util.(*baseCache).removeElement()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed
  github.com/cockroachdb/cockroach/util.(*baseCache).Del()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94
  github.com/cockroachdb/cockroach/storage.(*CommandQueue).Remove()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d
  github.com/cockroachdb/cockroach/storage.func·010()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343
  github.com/cockroachdb/cockroach/storage.(*Range).addReadWriteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada
  github.com/cockroachdb/cockroach/storage.(*Range).AddCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7
  github.com/cockroachdb/cockroach/storage.(*Store).ExecuteCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245
  github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at:
  github.com/cockroachdb/cockroach/storage.(*testDB).Increment()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca
  github.com/cockroachdb/cockroach/storage.(*IDAllocator).allocateBlock()
      /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
==================
PASS
Found 7 data race(s)
FAIL    github.com/cockroachdb/cockroach/storage    1.193s
ok      github.com/cockroachdb/cockroach/storage/engine 1.400s
ok      github.com/cockroachdb/cockroach/structured 1.061s
ok      github.com/cockroachdb/cockroach/util   3.650s
ok      github.com/cockroachdb/cockroach/util/encoding  1.010s
ok      github.com/cockroachdb/cockroach/util/hlc   1.010s
?       github.com/cockroachdb/cockroach/util/log   [no test files]
ok      github.com/cockroachdb/cockroach/util/metrics   1.012s
tbg commented 10 years ago

Git bisect tells me it's from

commit bdefc8548cb087f6caae5e849f6eb743390ef93f
Author: Spencer Kimball <spencer.kimball@gmail.com>
Date:   Wed Sep 24 18:35:44 2014 -0400

    Move read queue to a more general "command" queue.

Assigning Spencer since he's the author but maybe someone else can pin this down?

spencerkimball commented 10 years ago

OK, sent a PR with fixes.

On Sat, Sep 27, 2014 at 9:00 AM, Tobias Schottdorf <notifications@github.com

wrote:

Time to fix this, #54 https://github.com/cockroachdb/cockroach/issues/54 and get on with it.

cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb; make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb' g++ -g -Wall -Werror -Wsign-compare -I. -I./include -std=c++11 -DROCKSDB_PLATFORM_POSIX -DOS_LINUX -fno-builtin-memcmp -DROCKSDB_ATOMIC_PRESENT -DROCKSDB_FALLOCATE_PRESENT -DSNAPPY -DGFLAGS=google -DZLIB -DBZIP2 -DHAVE_JEMALLOC -O2 -fno-omit-frame-pointer -momit-leaf-frame-pointer -DNDEBUG -Woverloaded-virtual -c util/build_version.cc -o util/build_version.o rm -f librocksdb.a ar -rs librocksdb.a db/builder.o db/c.o db/column_family.o db/compaction.o db/compaction_picker.o db/db_filesnapshot.o db/dbformat.o db/db_impl.o db/db_impl_debug.o db/db_impl_readonly.o db/db_iter.o db/file_indexer.o db/filename.o db/forward_iterator.o db/internal_stats.o db/log_reader.o db/log_writer.o db/memtable.o db/memtable_list.o db/merge_helper.o db/merge_operator.o db/repair.o db/table_cache.o db/table_properties_collector.o db/tailing_iter.o db/transaction_log_impl.o db/version_edit.o db/version_set.o db/write_batch.o table/adaptive_table_factory.o table/block_based_table_builder.o table/block_based_table_factory.o table/block_based_table_reader.o table/block_builder.o table/block.o table/block_hash_index.o table/block_prefix_index.o table/bloom_block.o table/cuckoo_table_builder.o table/cuckoo_table_reader.o table/filter_block.o table/flush_block_policy.o table/format.o table/iterator.o table/merger.o table/meta_blocks.o table/plain_table_builder.o table/plain_table_factory.o table/plain_table_index.o table/plain_table_key_coding.o table/plain_table_reader.o table/table_properties.o table/two_level_iterator.o util/arena.o util/auto_roll_logger.o util/blob_store.o util/bloom.o util/build_version.o util/cache.o util/coding.o util/comparator.o util/crc32c.o util/dynamic_bloom.o util/env.o util/env_hdfs.o util/env_posix.o util/filter_policy.o util/hash.o util/hash_cuckoo_rep.o util/hash_linklist_rep.o util/hash_skiplist_rep.o util/histogram.o util/iostats_context.o utilities/backupable/backupable_db.o utilities/document/document_db.o utilities/document/json_document.o utilities/geodb/geodb_impl.o utilities/merge_operators/put.o utilities/merge_operators/string_append/stringappend2.o utilities/merge_operators/string_append/stringappend.o utilities/merge_operators/uint64add.o utilities/redis/redis_lists.o utilities/spatialdb/spatial_db.o utilities/ttl/db_ttl_impl.o util/ldb_cmd.o util/ldb_tool.o util/log_buffer.o util/logging.o util/murmurhash.o util/options_builder.o util/options.o util/perf_context.o util/rate_limiter.o util/skiplistrep.o util/slice.o util/statistics.o util/status.o util/string_util.o util/sync_point.o util/thread_local.o util/vectorrep.o util/xxhash.o port/port_posix.o port/stack_trace.o make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto' make[1]: Nothing to be done for 'static_lib'. make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib' make[1]: Nothing to be done for 'static_lib'. make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/sql/parser; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make CGO_LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " go test -race -run ".*" "./..." -logtostderr -timeout 10s ? github.com/cockroachdb/cockroach [no test files]

ok github.com/cockroachdb/cockroach/gossip 1.409s

WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 16: github.com/cockroachdb/cockroach/util.(_intervalKey).Start() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14: github.com/cockroachdb/cockroach/util.(_intervalKey).SetStart() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 16: github.com/cockroachdb/cockroach/util.(_intervalKey).End() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3 code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14: github.com/cockroachdb/cockroach/util.(_intervalKey).SetEnd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a code.google.com/p/biogo.store/interval.(_Node).adjustRange() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610 code.google.com/p/biogo.store/interval.(_Node).fixUp() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Node).doMatch() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x2af github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d

Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Write by goroutine 27: github.com/cockroachdb/cockroach/kv.func·006() http://github.com/cockroachdb/cockroach/kv.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:142 +0x23c github.com/cockroachdb/cockroach/util.IsTrueWithin() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/testing.go:82 +0x64 github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:149 +0x457 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous read by goroutine 36: github.com/cockroachdb/cockroach/util/hlc._ManualClock.UnixNano·fm() http://github.com/cockroachdb/cockroach/util/hlc._ManualClock.UnixNano%C3%82%C2%B7fm() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:36 +0x39 github.com/cockroachdb/cockroach/util/hlc.(_Clock).Update() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/hlc/hlc.go:169 +0x193 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:418 +0x38b github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 27 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc

Goroutine 36 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f

WARNING: DATA RACE Write by goroutine 27: github.com/cockroachdb/cockroach/storage.(_Store).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:146 +0x195 github.com/cockroachdb/cockroach/kv.(_LocalKV).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe github.com/cockroachdb/cockroach/kv.(*DB).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:153 +0x554 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous read by goroutine 36: github.com/cockroachdb/cockroach/storage.(_Store).GetRange() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:242 +0xb1 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:425 +0x1a2 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Goroutine 27 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc

Goroutine 36 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f

WARNING: DATA RACE Read by goroutine 43: github.com/cockroachdb/cockroach/storage.(_Store).LookupRange() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:256 +0x10f github.com/cockroachdb/cockroach/kv.(_LocalKV).lookupReplica() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:144 +0x1ac github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:109 +0x10d github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102

Previous write by goroutine 37: github.com/cockroachdb/cockroach/storage.(_Store).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:147 +0x1ba github.com/cockroachdb/cockroach/kv.(_LocalKV).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe github.com/cockroachdb/cockroach/kv.(*DB).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:187 +0x56c testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 43 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalResolveIntent() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:245 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).EndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:198 +0x359 github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:181 +0x404 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 37 (finished) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main()

github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc

I0927 14:56:07.440885 31689 simulation.go:62] simulating gossip network with 3 nodes I0927 14:56:07.443450 31689 server.go:88] serving on /tmp/unix-socket039167907... I0927 14:56:07.443531 31689 server.go:88] serving on /tmp/unix-socket413785254... I0927 14:56:07.443577 31689 server.go:88] serving on /tmp/unix-socket447364045... I0927 14:56:07.443656 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254 I0927 14:56:07.443904 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket039167907 I0927 14:56:07.444122 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254 I0927 14:56:07.448062 31689 client.go:124] client /tmp/unix-socket039167907 connected I0927 14:56:07.449830 31689 client.go:187] client /tmp/unix-socket039167907 starting heartbeat I0927 14:56:07.450346 31689 client.go:124] client /tmp/unix-socket413785254 connected I0927 14:56:07.451210 31689 client.go:187] client /tmp/unix-socket413785254 starting heartbeat I0927 14:56:07.452469 31689 server.go:103] gossip: client /tmp/unix-socket039167907 sent 1 info(s) I0927 14:56:07.453322 31689 server.go:103] gossip: client /tmp/unix-socket447364045 sent 2 info(s) I0927 14:56:07.455057 31689 server.go:103] gossip: client /tmp/unix-socket413785254 sent 1 info(s) W0927 14:56:07.455684 31689 gossip.go:420] missing sentinel gossip cluster-id; assuming partition and reconnecting I0927 14:56:07.455958 31689 server.go:102] done serving on /tmp/unix-socket039167907 I0927 14:56:07.456055 31689 server.go:102] done serving on /tmp/unix-socket413785254 I0927 14:56:07.456128 31689 server.go:102] done serving on /tmp/unix-socket447364045 I0927 14:56:07.456350 31689 simulation.go:62] simulating gossip network with 1 nodes I0927 14:56:07.467819 31689 server.go:88] serving on /tmp/unix-socket480063176... I0927 14:56:07.467883 31689 server.go:102] done serving on /tmp/unix-socket480063176 PASS Found 8 data race(s) FAIL github.com/cockroachdb/cockroach/kv 1.111s ok github.com/cockroachdb/cockroach/multiraft 1.100s ok github.com/cockroachdb/cockroach/proto 1.026s ok github.com/cockroachdb/cockroach/rpc 1.879s ok github.com/cockroachdb/cockroach/server 2.091s ? github.com/cockroachdb/cockroach/server/status [no test files] ? github.com/cockroachdb/cockroach/simulation [no test files]

ok github.com/cockroachdb/cockroach/sql/parser 1.134s

WARNING: DATA RACE Read by goroutine 78: github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:244 +0x7e github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·016() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7016() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:500 +0x171

Previous write by goroutine 77: github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:245 +0xee github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·015() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7015() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c

Goroutine 78 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:505 +0x8fd testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Goroutine 77 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 22: sync.raceRead() /usr/local/go/src/pkg/sync/race.go:37 +0x35 sync.(_WaitGroup).Add() /usr/local/go/src/pkg/sync/waitgroup.go:60 +0xbe github.com/cockroachdb/cockroach/storage.(_blockingEngine).block() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:236 +0xc7 github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:485 +0x658 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f

Previous write by goroutine 77: sync.raceWrite() /usr/local/go/src/pkg/sync/race.go:41 +0x35 sync.(_WaitGroup).Wait() /usr/local/go/src/pkg/sync/waitgroup.go:122 +0x176 github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:246 +0x127 github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(*Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·015() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7015() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c

Goroutine 22 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/storage/_test/_testmain.go:189 +0xdc

Goroutine 77 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa testing.tRunner()

/usr/local/go/src/pkg/testing/testing.go:422 +0x10f

WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

WARNING: DATA RACE Read by goroutine 98: github.com/cockroachdb/cockroach/util.(_intervalKey).Start() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96: github.com/cockroachdb/cockroach/util.(_intervalKey).SetStart() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

WARNING: DATA RACE Read by goroutine 98: github.com/cockroachdb/cockroach/util.(_intervalKey).End() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3 code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96: github.com/cockroachdb/cockroach/util.(_intervalKey).SetEnd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a code.google.com/p/biogo.store/interval.(_Node).adjustRange() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610 code.google.com/p/biogo.store/interval.(_Node).fixUp() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Node).doMatch() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Previous write by goroutine 96: code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369

Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()

/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194

WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tob