search

brianfrankcooper / YCSB

Yahoo! Cloud Serving Benchmark
Apache License 2.0
4.94k stars 2.24k forks source link

Release version 0.7.0 #624

Closed risdenk closed 8 years ago

risdenk commented 8 years ago

For the next release, 0.7.0, the following items have already been merged:

Breaking changes:

Bindings to test:

Release plan:

risdenk commented 8 years ago

RC1 is out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.7.0-RC1

risdenk commented 8 years ago

First draft of release notes (a bit early but figured I'd get a start on it): https://gist.github.com/risdenk/2c739719a815c4e74c64

busbey commented 8 years ago

Excellent! thanks for driving this Kevin.

I can take care of Accumulo and Windows platform testing.

risdenk commented 8 years ago

@kruthar Can you take care of testing OrientDB, JDBC, and Couchbase bindings?

sbawaska commented 8 years ago

The Geode binding looks good.

On Tue, Feb 16, 2016 at 7:33 AM, Kevin Risden notifications@github.com wrote:

@kruthar https://github.com/kruthar Can you take care of testing OrientDB, JDBC, and Couchbase bindings?

— Reply to this email directly or view it on GitHub https://github.com/brianfrankcooper/YCSB/issues/624#issuecomment-184731296 .

busbey commented 8 years ago

I tried building on windows and ran into #617 again. submitted PR #626 to skip the Accumulo tests on windows. We should cherry-pick that back for the 0.7.0 release to make sure building from source on windows works.

risdenk commented 8 years ago

@busbey Merged #626. I'll cherry-pick that commit back to 0.7.0 and respin the RC.

risdenk commented 8 years ago

@busbey had to back out #626. When it is fixed I can merge it and respin the RC.

risdenk commented 8 years ago

RC2 is out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.7.0-RC2

Fixes from @busbey for Accumulo and @kruthar for OrientDB readallfields

busbey commented 8 years ago

RC2 builds on windows fine. running tests through accumulo now.

busbey commented 8 years ago

Accumulo works. I had a server-side issue while running through the workload a loading phase and everything properly tracked the failures and continued on.

Running HBase10 next.

kruthar commented 8 years ago

I tested a few dbs, everything looks ok to me:

jdbc MySQL 5.1.73 cassandra2-cql Cassandra 2.0.17 couchbase Couchbase 4.0.0 memcached Memcached 1.4.4 orientdb OrientDB 2.1.2 (remote and local) mongodb MongoDB 3.0.9

For the curious, I'm running:

bin/ycsb load mongodb -P ~/projects/YCSB/testing/testworkload
bin/ycsb run mongodb -P ~/projects/YCSB/testing/testworkload

testworkload:

operationcount=10000
recordcount=10000
fieldcount=3
fieldlength=20
dataintegrity=true
writeallfields=true
readallfields=true
insertorder=ordered
maxscanlength=100
threadcount=1
workload=com.yahoo.ycsb.workloads.CoreWorkload

scanproportion=0.3
readproportion=0.3
updateproportion=0.4
insertproportion=0.0

hdrhistogram.percentiles=50,75,95

# mysql
db.driver=com.mysql.jdbc.Driver
db.url=jdbc:mysql://mysql.vagrant:3306/ycsb
db.user=admin
db.passwd=admin

# cassandra
hosts=cassandra.vagrant

# couchbase
couchbase.url=http://couchbase.vagrant:8091/pools
couchbase.bucket=usertable
couchbase.ddoc=ycsb_ddoc
couchbase.view=ycsb_view

# memcached
memcached.hosts=memcached.vagrant

# orientdb
# orientdb.url=plocal:ycsb
orientdb.url=remote:orientdb.vagrant/ycsb
orientdb.user=root
orientdb.password=password
orientdb.remote.storagetype=plocal

# mongodb
mongodb.url=mongodb://mongodb.vagrant:27017/ycsb?w=1
risdenk commented 8 years ago

@ghaughian - Do you have time to test out the new Solr bindings? If not I can take a look at testing it.

risdenk commented 8 years ago

@kruthar Thanks!

ghaughian commented 8 years ago

@risdenk it would be Thursday before I get a chance to test the Solr binding unfortunately. Would that work?

risdenk commented 8 years ago

@ghaughian Thanks! That should work. I'll update this thread if I get around to testing the Solr binding before you do.

busbey commented 8 years ago

Tested hbase10 and hbase098 bindings against a small (7 worker) cluster. Both work fine.

busbey commented 8 years ago

@yuyantingzero do you think you could check out the release candidate and make sure the updated DynamoDB client works as expected?

busbey commented 8 years ago

@magicbane could you spare some time to validate the release candidate works with ElasticSearch with the newer version?

busbey commented 8 years ago

@allanbank do you think we need the full mongodb battery of tests given the changes that happened?

@risdenk I just want to confirm that the plan is to keep these previously listed "tested supported" bindings from 0.6.0 as some form of "supported / expected to work" for this release:

risdenk commented 8 years ago

@busbey Yes going to keep the bindings that haven't changed from 0.6.0 as Supported but not listed as tested for this release.

I need to make a few minor edits still to the release notes, but draft release notes are here: https://gist.github.com/risdenk/2c739719a815c4e74c64

busbey commented 8 years ago

I also tested the HBase 098 binding, so it should be in "tested supported". @kruthar mentioned testing Memcached, so it should be in "tested supported".

Technically, the version of HBase I ran against was the CDH5.5.1 version (which is 1.0.0 based). Similarly, the Accumulo version was the Cloudera packaging 1.6.0-CDH5.1.4 (which is 1.6.0 based). I don't think the distinction is worth calling out, but now folks can find it later if I'm wrong. :)

The JDBC note should probably include what backing database it was used against because that can make a big difference in how tolerant of correctness things are.

I haven't seen anyone test DynamoDB or ElasticSearch yet. More importantly, I haven't seen anyone agree to test them.

risdenk commented 8 years ago

@busbey yea agreed on all your comments. Those were the edits that I was planning to make to the release notes. Just waiting to see what other testing comes in.

risdenk commented 8 years ago

Updated release notes based on comments from @busbey https://gist.github.com/risdenk/2c739719a815c4e74c64

Currently waiting on testing for Solr.

yuyantingzero commented 8 years ago

Sry for the late reply. I just tested dynamodb binding with workloada as well as some manual testing using ycsb shell for both HASH and HASH_AND_RANGE key mode.

busbey commented 8 years ago

excellent! thanks for checking it.

ghaughian commented 8 years ago

@risdenk Tested the Solr binding, everything looks good!

risdenk commented 8 years ago

thanks @yuyantingzero and @ghaughian.

@yuyantingzero - Which version of DynamoDB did you test?

@ghaughian - Which version of Solr did you test?

ghaughian commented 8 years ago

@risdenk Solr 5.4.0

risdenk commented 8 years ago

All testing for RC2 has been completed. Draft release notes: https://gist.github.com/risdenk/2c739719a815c4e74c64

busbey commented 8 years ago

+1 release notes look good to me.

risdenk commented 8 years ago

Thanks @busbey. Going ahead with the steps for releasing 0.7.0.

cmatser commented 8 years ago

+1 Nice work handling this release.

risdenk commented 8 years ago

YCSB 0.7.0 is out https://github.com/brianfrankcooper/YCSB/releases/tag/0.7.0

risdenk commented 8 years ago

Starting release announcements. Will close out this issue when announcements are done.

busbey commented 8 years ago

excellent!

one nit on the release: the elasticsearch binding ended up in the untested category, so it shouldn't have convenience binaries included.

risdenk commented 8 years ago

Oops thanks @busbey. Removed the elasticsearch convenience binary.

magicbane commented 8 years ago

Sorry I'm currently traveling, so I didn't have time to test it. I can see if I have time later today. On Feb 25, 2016 12:00 PM, "Sean Busbey" notifications@github.com wrote:

excellent!

one nit on the release: the elasticsearch binding ended up in the untested category, so it shouldn't have convenience binaries included.

— Reply to this email directly or view it on GitHub https://github.com/brianfrankcooper/YCSB/issues/624#issuecomment-188877389 .

busbey commented 8 years ago

No worries @magicbane. We'll start another release in a few weeks and can get it tested in that release cycle.

yuyantingzero commented 8 years ago

@risdenk dynamodb is managed, doesn't have a version. But the aws sdk version is 1.10.48.

risdenk commented 8 years ago

@yuyantingzero Thanks yea my mistake when asking. I knew that but just blanked when responding to this thread.

risdenk commented 8 years ago

Announcement template: https://gist.github.com/risdenk/c921e833aaf46bb59500

Announced to the following: