Closed tbg closed 10 years ago
Git bisect tells me it's from
commit bdefc8548cb087f6caae5e849f6eb743390ef93f
Author: Spencer Kimball <spencer.kimball@gmail.com>
Date: Wed Sep 24 18:35:44 2014 -0400
Move read queue to a more general "command" queue.
Assigning Spencer since he's the author but maybe someone else can pin this down?
OK, sent a PR with fixes.
On Sat, Sep 27, 2014 at 9:00 AM, Tobias Schottdorf <notifications@github.com
wrote:
Time to fix this, #54 https://github.com/cockroachdb/cockroach/issues/54 and get on with it.
cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb; make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb' g++ -g -Wall -Werror -Wsign-compare -I. -I./include -std=c++11 -DROCKSDB_PLATFORM_POSIX -DOS_LINUX -fno-builtin-memcmp -DROCKSDB_ATOMIC_PRESENT -DROCKSDB_FALLOCATE_PRESENT -DSNAPPY -DGFLAGS=google -DZLIB -DBZIP2 -DHAVE_JEMALLOC -O2 -fno-omit-frame-pointer -momit-leaf-frame-pointer -DNDEBUG -Woverloaded-virtual -c util/build_version.cc -o util/build_version.o rm -f librocksdb.a ar -rs librocksdb.a db/builder.o db/c.o db/column_family.o db/compaction.o db/compaction_picker.o db/db_filesnapshot.o db/dbformat.o db/db_impl.o db/db_impl_debug.o db/db_impl_readonly.o db/db_iter.o db/file_indexer.o db/filename.o db/forward_iterator.o db/internal_stats.o db/log_reader.o db/log_writer.o db/memtable.o db/memtable_list.o db/merge_helper.o db/merge_operator.o db/repair.o db/table_cache.o db/table_properties_collector.o db/tailing_iter.o db/transaction_log_impl.o db/version_edit.o db/version_set.o db/write_batch.o table/adaptive_table_factory.o table/block_based_table_builder.o table/block_based_table_factory.o table/block_based_table_reader.o table/block_builder.o table/block.o table/block_hash_index.o table/block_prefix_index.o table/bloom_block.o table/cuckoo_table_builder.o table/cuckoo_table_reader.o table/filter_block.o table/flush_block_policy.o table/format.o table/iterator.o table/merger.o table/meta_blocks.o table/plain_table_builder.o table/plain_table_factory.o table/plain_table_index.o table/plain_table_key_coding.o table/plain_table_reader.o table/table_properties.o table/two_level_iterator.o util/arena.o util/auto_roll_logger.o util/blob_store.o util/bloom.o util/build_version.o util/cache.o util/coding.o util/comparator.o util/crc32c.o util/dynamic_bloom.o util/env.o util/env_hdfs.o util/env_posix.o util/filter_policy.o util/hash.o util/hash_cuckoo_rep.o util/hash_linklist_rep.o util/hash_skiplist_rep.o util/histogram.o util/iostats_context.o utilities/backupable/backupable_db.o utilities/document/document_db.o utilities/document/json_document.o utilities/geodb/geodb_impl.o utilities/merge_operators/put.o utilities/merge_operators/string_append/stringappend2.o utilities/merge_operators/string_append/stringappend.o utilities/merge_operators/uint64add.o utilities/redis/redis_lists.o utilities/spatialdb/spatial_db.o utilities/ttl/db_ttl_impl.o util/ldb_cmd.o util/ldb_tool.o util/log_buffer.o util/logging.o util/murmurhash.o util/options_builder.o util/options.o util/perf_context.o util/rate_limiter.o util/skiplistrep.o util/slice.o util/statistics.o util/status.o util/string_util.o util/sync_point.o util/thread_local.o util/vectorrep.o util/xxhash.o port/port_posix.o port/stack_trace.o make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto' make[1]: Nothing to be done for 'static_lib'. make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make static_lib make[1]: Entering directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib' make[1]: Nothing to be done for 'static_lib'. make[1]: Leaving directory '/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib' cd /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/sql/parser; LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " make CGO_LDFLAGS="-L/usr/local/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -L/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " CGO_CXXFLAGS="-I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/_vendor/rocksdb/include -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/proto/lib -I/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/roachlib " go test -race -run ".*" "./..." -logtostderr -timeout 10s ? github.com/cockroachdb/cockroach [no test files]
ok github.com/cockroachdb/cockroach/gossip 1.409s
WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d
Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 16: github.com/cockroachdb/cockroach/util.(_intervalKey).Start() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 14: github.com/cockroachdb/cockroach/util.(_intervalKey).SetStart() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d
Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 16: github.com/cockroachdb/cockroach/util.(_intervalKey).End() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3 code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 14: github.com/cockroachdb/cockroach/util.(_intervalKey).SetEnd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a code.google.com/p/biogo.store/interval.(_Node).adjustRange() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610 code.google.com/p/biogo.store/interval.(_Node).fixUp() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d
Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Node).doMatch() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(*DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d
Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 16: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 14: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x2af github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·006() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 16 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:238 +0x18d
Goroutine 14 (finished) created at: github.com/cockroachdb/cockroach/kv.(*DB).Put() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:95 +0x123 github.com/cockroachdb/cockroach/kv.TestCoordinatorAddRequest() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:78 +0x34f testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Write by goroutine 27: github.com/cockroachdb/cockroach/kv.func·006() http://github.com/cockroachdb/cockroach/kv.func%C3%82%C2%B7006() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:142 +0x23c github.com/cockroachdb/cockroach/util.IsTrueWithin() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/testing.go:82 +0x64 github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:149 +0x457 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Previous read by goroutine 36: github.com/cockroachdb/cockroach/util/hlc._ManualClock.UnixNano·fm() http://github.com/cockroachdb/cockroach/util/hlc._ManualClock.UnixNano%C3%82%C2%B7fm() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:36 +0x39 github.com/cockroachdb/cockroach/util/hlc.(_Clock).Update() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/hlc/hlc.go:169 +0x193 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:418 +0x38b github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 27 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc
Goroutine 36 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f
WARNING: DATA RACE Write by goroutine 27: github.com/cockroachdb/cockroach/storage.(_Store).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:146 +0x195 github.com/cockroachdb/cockroach/kv.(_LocalKV).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe github.com/cockroachdb/cockroach/kv.(*DB).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f github.com/cockroachdb/cockroach/kv.TestCoordinatorHeartbeat() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:153 +0x554 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Previous read by goroutine 36: github.com/cockroachdb/cockroach/storage.(_Store).GetRange() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:242 +0xb1 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:425 +0x1a2 github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:121 +0x4b7 github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Goroutine 27 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc
Goroutine 36 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalHeartbeatTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:222 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).heartbeat()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:251 +0x40f
WARNING: DATA RACE Read by goroutine 43: github.com/cockroachdb/cockroach/storage.(_Store).LookupRange() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:256 +0x10f github.com/cockroachdb/cockroach/kv.(_LocalKV).lookupReplica() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:144 +0x1ac github.com/cockroachdb/cockroach/kv.(_LocalKV).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:109 +0x10d github.com/cockroachdb/cockroach/kv.(_DB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:70 +0x102
Previous write by goroutine 37: github.com/cockroachdb/cockroach/storage.(_Store).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:147 +0x1ba github.com/cockroachdb/cockroach/kv.(_LocalKV).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/local_kv.go:134 +0xfe github.com/cockroachdb/cockroach/kv.(*DB).Close() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:63 +0x7f github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:187 +0x56c testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Goroutine 43 (running) created at: github.com/cockroachdb/cockroach/kv.(_DB).InternalResolveIntent() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/db.go:245 +0xca github.com/cockroachdb/cockroach/kv.(_coordinator).EndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator.go:198 +0x359 github.com/cockroachdb/cockroach/kv.TestCoordinatorEndTxn() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/kv/coordinator_test.go:181 +0x404 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Goroutine 37 (finished) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main()
github.com/cockroachdb/cockroach/kv/_test/_testmain.go:81 +0xdc
I0927 14:56:07.440885 31689 simulation.go:62] simulating gossip network with 3 nodes I0927 14:56:07.443450 31689 server.go:88] serving on /tmp/unix-socket039167907... I0927 14:56:07.443531 31689 server.go:88] serving on /tmp/unix-socket413785254... I0927 14:56:07.443577 31689 server.go:88] serving on /tmp/unix-socket447364045... I0927 14:56:07.443656 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254 I0927 14:56:07.443904 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket039167907 I0927 14:56:07.444122 31689 gossip.go:347] bootstrapping gossip protocol using host /tmp/unix-socket413785254 I0927 14:56:07.448062 31689 client.go:124] client /tmp/unix-socket039167907 connected I0927 14:56:07.449830 31689 client.go:187] client /tmp/unix-socket039167907 starting heartbeat I0927 14:56:07.450346 31689 client.go:124] client /tmp/unix-socket413785254 connected I0927 14:56:07.451210 31689 client.go:187] client /tmp/unix-socket413785254 starting heartbeat I0927 14:56:07.452469 31689 server.go:103] gossip: client /tmp/unix-socket039167907 sent 1 info(s) I0927 14:56:07.453322 31689 server.go:103] gossip: client /tmp/unix-socket447364045 sent 2 info(s) I0927 14:56:07.455057 31689 server.go:103] gossip: client /tmp/unix-socket413785254 sent 1 info(s) W0927 14:56:07.455684 31689 gossip.go:420] missing sentinel gossip cluster-id; assuming partition and reconnecting I0927 14:56:07.455958 31689 server.go:102] done serving on /tmp/unix-socket039167907 I0927 14:56:07.456055 31689 server.go:102] done serving on /tmp/unix-socket413785254 I0927 14:56:07.456128 31689 server.go:102] done serving on /tmp/unix-socket447364045 I0927 14:56:07.456350 31689 simulation.go:62] simulating gossip network with 1 nodes I0927 14:56:07.467819 31689 server.go:88] serving on /tmp/unix-socket480063176... I0927 14:56:07.467883 31689 server.go:102] done serving on /tmp/unix-socket480063176 PASS Found 8 data race(s) FAIL github.com/cockroachdb/cockroach/kv 1.111s ok github.com/cockroachdb/cockroach/multiraft 1.100s ok github.com/cockroachdb/cockroach/proto 1.026s ok github.com/cockroachdb/cockroach/rpc 1.879s ok github.com/cockroachdb/cockroach/server 2.091s ? github.com/cockroachdb/cockroach/server/status [no test files] ? github.com/cockroachdb/cockroach/simulation [no test files]
ok github.com/cockroachdb/cockroach/sql/parser 1.134s
WARNING: DATA RACE Read by goroutine 78: github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:244 +0x7e github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·016() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7016() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:500 +0x171
Previous write by goroutine 77: github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:245 +0xee github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·015() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7015() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c
Goroutine 78 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:505 +0x8fd testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Goroutine 77 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 22: sync.raceRead() /usr/local/go/src/pkg/sync/race.go:37 +0x35 sync.(_WaitGroup).Add() /usr/local/go/src/pkg/sync/waitgroup.go:60 +0xbe github.com/cockroachdb/cockroach/storage.(_blockingEngine).block() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:236 +0xc7 github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:485 +0x658 testing.tRunner() /usr/local/go/src/pkg/testing/testing.go:422 +0x10f
Previous write by goroutine 77: sync.raceWrite() /usr/local/go/src/pkg/sync/race.go:41 +0x35 sync.(_WaitGroup).Wait() /usr/local/go/src/pkg/sync/waitgroup.go:122 +0x176 github.com/cockroachdb/cockroach/storage.(_blockingEngine).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:246 +0x127 github.com/cockroachdb/cockroach/storage/engine.GetProto() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/engine.go:162 +0x8a github.com/cockroachdb/cockroach/storage/engine.(_MVCC).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/engine/mvcc.go:101 +0x1ab github.com/cockroachdb/cockroach/storage.(_Range).Get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:674 +0xe0 github.com/cockroachdb/cockroach/storage.(_Range).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:601 +0xf31 github.com/cockroachdb/cockroach/storage.(_Range).addReadOnlyCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:367 +0x21b github.com/cockroachdb/cockroach/storage.(*Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:307 +0x455 github.com/cockroachdb/cockroach/storage.func·015() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7015() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:489 +0x16c
Goroutine 22 (running) created at: testing.RunTests() /usr/local/go/src/pkg/testing/testing.go:504 +0xb46 testing.Main() /usr/local/go/src/pkg/testing/testing.go:435 +0xa2 main.main() github.com/cockroachdb/cockroach/storage/_test/_testmain.go:189 +0xdc
Goroutine 77 (running) created at: github.com/cockroachdb/cockroach/storage.TestRangeCommandQueue() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range_test.go:494 +0x7aa testing.tRunner()
/usr/local/go/src/pkg/testing/testing.go:422 +0x10f
WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0x6b github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Previous write by goroutine 96: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x27a github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
WARNING: DATA RACE Read by goroutine 98: github.com/cockroachdb/cockroach/util.(_intervalKey).Start() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:340 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0x3a code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Previous write by goroutine 96: github.com/cockroachdb/cockroach/util.(_intervalKey).SetStart() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:342 +0x3a code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:407 +0x368 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
WARNING: DATA RACE Read by goroutine 98: github.com/cockroachdb/cockroach/util.(_intervalKey).End() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:341 +0x4c github.com/cockroachdb/cockroach/util.(_intervalKey).Overlap() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:345 +0xc3 code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:221 +0xf1 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Previous write by goroutine 96: github.com/cockroachdb/cockroach/util.(_intervalKey).SetEnd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:343 +0x3a code.google.com/p/biogo.store/interval.(_Node).adjustRange() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:170 +0x610 code.google.com/p/biogo.store/interval.(_Node).fixUp() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:144 +0x3b code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:433 +0x386 code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Node).doMatch() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:617 +0x3f code.google.com/p/biogo.store/interval.(_Tree).Get() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:222 +0x175 github.com/cockroachdb/cockroach/util.(_IntervalCache).get() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:371 +0xcf github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:158 +0x74 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(*testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Previous write by goroutine 96: code.google.com/p/biogo.store/interval.(_Node).delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:406 +0x28b code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:390 +0x256 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:159 +0x94 github.com/cockroachdb/cockroach/storage.(_CommandQueue).Remove() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/command_queue.go:125 +0x6d github.com/cockroachdb/cockroach/storage.func·010() http://github.com/cockroachdb/cockroach/storage.func%C3%82%C2%B7010() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:453 +0x343 github.com/cockroachdb/cockroach/storage.(_Range).addReadWriteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:464 +0xada github.com/cockroachdb/cockroach/storage.(_Range).AddCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/range.go:309 +0x4b7 github.com/cockroachdb/cockroach/storage.(_Store).ExecuteCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/store.go:429 +0x245 github.com/cockroachdb/cockroach/storage.(_testDB).executeCmd() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:45 +0x369
Goroutine 98 (running) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
Goroutine 96 (finished) created at: github.com/cockroachdb/cockroach/storage.(_testDB).Increment() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/db_test.go:78 +0xca github.com/cockroachdb/cockroach/storage.(_IDAllocator).allocateBlock()
/home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/storage/id_alloc.go:85 +0x194
WARNING: DATA RACE Read by goroutine 98: code.google.com/p/biogo.store/interval.(_Tree).Delete() /home/tobias/Code/Go/src/code.google.com/p/biogo.store/interval/interval.go:391 +0x290 github.com/cockroachdb/cockroach/util.(_IntervalCache).del() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:386 +0xe9 github.com/cockroachdb/cockroach/util.(_baseCache).removeElement() /home/tobias/Code/Go/src/github.com/cockroachdb/cockroach/util/cache.go:183 +0xed github.com/cockroachdb/cockroach/util.(_baseCache).Del() /home/tob
Time to fix this, #54 and get on with it.