Open ADBalici opened 3 years ago
@igorbernstein2, @kolea2 — can you please take a look at this issue?
Is there any update on this issue? It has become a blocker to use OLAP with JanusGraph and Bigtable.
After looking at the code base for BigtableAdmin.java in 2_x version, we saw that it is hardcoded to throw the exception:
@Override
public List<RegionMetrics> getRegionMetrics(ServerName arg0, TableName arg1) throws IOException {
throw new UnsupportedOperationException("getRegionMetrics"); // TODO
}
A quick workaround for this is to switch off region size calculation (please note: not aware of the negative consequences, but this gets the job done) using:
janusgraphmr.ioformat.conf.storage.hbase.ext.hbase.regionsizecalculator.enable=false
JanusGraph Version: 0.5.2 Storage Backend: Google Cloud BigTable
Steps to reproduce:
Configure JanusGraph to perform an OLAP traversals on a graph persisted in HBase using Spark in YARN mode:
read-hbase-spark-yarn.properties
lib.zip
was created based on this recipe: http://yaaics.blogspot.com/2017/07/configuring-janusgraph-for-spark-yarn.html Assume theCLASSPATH
and the Hadoop Conf are properly created as the Spark Job is submitted and appears in the YARN Resource Manager.With all this configured, attempting to run a simple OLAP traversal will result in a
java.lang.IllegalStateException: java.lang.UnsupportedOperationException: getRegionMetrics
(see below for the extended stacktrace).This error comes from
com.google.cloud.bigtable.hbase2_x.BigtableAdmin
(https://github.com/googleapis/java-bigtable-hbase/blob/master/bigtable-hbase-2.x-parent/bigtable-hbase-2.x/src/main/java/com/google/cloud/bigtable/hbase2_x/BigtableAdmin.java).Otherwise, normal OLTP traversal are working just fine. I was able to create vertex, delete them, add edges, etc...
Stack Trace