Closed szewi closed 6 years ago
At first glance, it looks like sqoop's code needs to change. The stacktrace shows the use of the HBaseAdmin
class, which is only usable with HBase. HBase 1.0 introduced new interfaces that allowed Cloud Bigtable to extend the HBase interfaces. I'm guessing that sqoop will have a few of changes.
Here's the list of differences.
I'm going to close this bug, since it sounds like sqoop is not yet up-to-date with the idioms introduced in HBase 1.0, which is about 3 years ago. It seems like the Cloud Bigtable client is working as intended. I'm going to close this issue. If you would like, feel free to open a bug on https://github.com/GoogleCloudPlatform/cloud-bigtable-examples which is more oriented towards samples of client use and samples of integrations.
I am working on using sqoop with BigTable. On configured a dataproc cluster with sqoop 1.4.7 and installed hbase 1.3.2, I added bigtable-hbase-1.x-hadoop-1.3.0.jar to hbase/lib and modified hbase-site.xml as described in cloud-bigtable-examples.
As a result:
Does anyone make it working with sqoop or there is no way to make it working? I tried several version of bigtable-client with no luck. Import to locally installed HBase works so it's not a problem with sqoop and rather bigtable-client issue.
Full error message: