search

fullcontact / hadoop-sstable

Splittable Input Format for Reading Cassandra SSTables Directly
Apache License 2.0
49 stars 14 forks source link

Support Cassandra 2.0.x #23

Open java8964 opened 9 years ago

java8964 commented 9 years ago

I have one dataset already upgraded to Cassandra 2.0. I am trying to see if "hadoop-sstable" can be changed to support Cassandra 2.0.

One problem I found out is that in Cassandra 2.0, for the class SSTableIdentityIterator, Cassandra changed the constructor of taking "DataInput" to a private constructor, see this link:

https://github.com/apache/cassandra/blob/cassandra-2.0.10/src/java/org/apache/cassandra/io/sstable/SSTableIdentityIterator.java

On line 81.

This brings a problem that it is hard to create a SSTableIdentityIterator instance, as the public constructors only take Cassandra RandomAccessReader, not fullcontact's RandomAccessReader.

I wonder what could be a good solution in this case? Do you guys plan anything for supporting Cassandra 2.x?

Thanks

bvanberg commented 9 years ago

Yes, and we've done it already. Let me see if our internal 2.0 support can be pushed today.

java8964 commented 9 years ago

Great, I am interested to test it with our data.

Thanks

bvanberg commented 9 years ago

Please try the cassandra-2.0.x branch.