Closed ronsher closed 11 years ago
I think you should use 8020 for hbase. The ZooKeeper port is the same 2181.
Thanks for the quick reply, but it didn't work :-(
8020 is the Hadoop HDFS namenode. Are you sure it's the one I should use?
Anything else I can investigate?
Thanks again, Ron
On Tue, Dec 11, 2012 at 12:51 PM, Igor Cher notifications@github.comwrote:
I think you should use 8020 for hbase. The ZooKeeper port is the same 2181 .
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11239160.
You are right this is HDFS namenode but it looked promising :-) Basically you should provide hbase master. According to your previous link it might be 60000.
Used the ports in bold (verified that something listens on these ports), but without success: HBase Master 60000TCP Externalhbase.master.port IPC Master* * 60010 TCP* _External_hbase.master.info.port HTTP RegionServer 60020TCPExternal hbase.regionserver.port IPC RegionServer 60030TCP External hbase.regionserver.info.port HTTP HQuorumPeer 2888TCP hbase.zookeeper.property.clientPort HBase-managed ZK mode HQuorumPeer 3888 TCP hbase.zookeeper.peerport HBase-managed ZK mode HQuorumPeer* * 2181 TCP * hbase.zookeeper.leaderport HBase-managed ZK mode Any other suggestion?
Thanks again for your help, Ron
On Tue, Dec 11, 2012 at 2:20 PM, Igor Cher notifications@github.com wrote:
You are right this is HDFS namenode but it looked promising :-) Basically you should provide hbase master. According to your previous link it might be 60000.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11241422.
Are you sure this is a port problem?
Do you have a ping by host names from your machine to the hadoop cluster? You need to have a ping to each node in the cluster by the machine name. If you don't you must map them in the hosts file.
If ping is not the issue try to find in the hadoop configuration the 'hbase.rootdir'. Its value should contain the port. You can find this property in 'hbase-site.xml' file located under [hbase installation folder]\conf.
I'm facing similar issues too. Logs displayed on the console looks good, however, seems I'm not able to connect. ZK is replying correctly, but not HBase. HBase is installed on the default port, so should be 60000.
I tried all my ZK nodes and all are replying correctly. But the master is not.
@phenom:~/$ /usr/local/jdk1.7.0_05/bin/java -jar h-rider-1.0.0.0.jar
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:host.name=phenom
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_05
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/local/jdk1.7.0_05/jre
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.class.path=h-rider-1.0.0.0.jar
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
12/12/11 11:17:58 INFO zookeeper.ZooKeeper: Client environment:java.compiler=
see if the pom changes submitted by dhardy92 works for you (https://github.com/NiceSystems/hrider/pulls)
Unfortunatly I'm not using CDH. I was initialy testing with the jar dowloaded directly from here.
Now, I have cloned the source and I tried "mvn package" and "mvn -Pcdh4 package" and got the same issue twice.
I tried to update the pom with my HBase version (0.94.3) build build is failing.
Finally, I have updated the CDH4 section with my HBase and Hadoop version, rebuild like if I had CDH, and it's now working ;)
Thanks.
This toll is very cool, but the release manager is very poor.
Don't use fat jar to package your released jar. just write a correct maven pom.
My hbase version: 0.94.2, hadoop-1.0.4
I had to compile your source code and correct your pom.
And, I must do a simple scan, then I can have an advanced scan. if I do advanced scan firstly, it throw Exception: MoveTable IndexOutofArray
You are probably right azuryy. I will fix the pom.
In regards to the error you get can you describe what exactly you do in what sequence and what controls you use?
I try again, but I cannot repro it now. I will keep you update if it appear again.
after I download the package, it cannot connect to the Hbase master. so I download the source code, changed the hbase version in the pom, add hadoop-core-{my-version} in the pom, after the compile, I can connect the HMaster, and meet the above Exception. but it cannot be reproduced now, Sorry.
Another, I changed a little bit source code. Add close() method in the HbaseHelper.java to call hbaseAdmin.close();
In the Window.java, I call hbaseHelper.close() in the windowClosing event. accordingly hbaseHelper cannot be local variables in the loadTables method, I changed it to the Class static member.
BTW, we'd better close HbaseAdmin but we'd better not close HTable.
enjoy.
Compiled the latest sources and tried again with no luck. This is what I
get:
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client environment:host.name
=myHostName
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_09
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.home=C:\Program Files\Java\jre7
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=h-rider-1.0.0.1.jar
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=C:\Windows\system32;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program
Files\Common Files\Microsoft Shared\Windo
ws Live;C:\Program Files (x86)\Common Files\Microsoft Shared\Windows
Live;C:\Program Files (x86)\Intel\iCLS Client\;C:\Program Files\Intel\iCLS
Client\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;
C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Intel\Intel(R)
Management Engine Components\DAL;C:\Program Files\Intel\Intel(R) Management
Engine Components\IPT;C:\Program Files (x86)\Intel\Intel
(R) Management Engine Components\DAL;C:\Program Files (x86)\Intel\Intel(R)
Management Engine Components\IPT;C:\Program Files\Dell\Dell Data
Protection\Access\Advanced\Wave\Gemalto\Access Client\v5\;C:\Program
Files (x86)\NTRU Cryptosystems\NTRU TCG Software Stack\bin\;C:\Program
Files\NTRU Cryptosystems\NTRU TCG Software Stack\bin\;C:\Program Files
(x86)\Windows Live\Shared;C:\Program Files (x86)\ATI Technologies
\ATI.ACE\Core-Static;c:\Program Files (x86)\Microsoft SQL
Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL
Server\100\Tools\Binn\;c:\Program Files\Microsoft SQL
Server\100\DTS\Binn\;C:\Program Files (x86
)\Seapine\Surround SCM;c:\tools;C:\Program
Files\Java\jdk1.7.0_09\bin;C:\Program Files\Microsoft\Web Platform
Installer\;C:\Program Files (x86)\Microsoft ASP.NET\ASP.NET Web
Pages\v1.0\;C:\Program Files (x86)
\Windows Kits\8.0\Windows Performance Toolkit\;C:\Program Files\Microsoft
SQL
Server\110\Tools\Binn\;C:\tools\eclipse\plugins\org.apache.ant_1.8.3.v20120321-1730\bin;C:\Program
Files (x86)\Notepad++;C:\tools\
apache-maven-3.0.4\bin;.
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=C:\Users\ron\AppData\Local\Temp\
12/12/12 09:35:41 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=
On Wed, Dec 12, 2012 at 8:35 AM, Igor Cher notifications@github.com wrote:
You are probably right azuryy. I will fix the pom.
In regards to the error you get can you describe what exactly you do in what sequence and what controls you use?
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11278472.
That's because zookeeper version not compatible. Just change the hbase version to your currently version in the pom.xml.
Changed the hbase version to 0.92.1, and still no luck :-(
On Wed, Dec 12, 2012 at 9:43 AM, azuryy notifications@github.com wrote:
That's because zookeeper version not compatible. Just change the hbase version to your currently version in the pom.xml.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11279636.
Also tried doing mvn -Pcdh4 package, but this fails with: [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for h-rider:h-rider:jar:1.0.0.1 [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-jar-plugin @ line 119, column 21 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 137, column 21 [WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:ideauidesigner-maven-plugin is missing. @ line 103, column 21 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building h-rider 1.0.0.1 [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ h-rider --- [debug] execute contextualize [WARNING] Using platform encoding (Cp1255 actually) to copy filtered resources, i.e. build is platform dependent! [INFO] Copying 21 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ h-rider --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- ideauidesigner-maven-plugin:1.0-beta-1:javac2 (default) @ h-rider --- [INFO] Executing IDEA UI Designer task... [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2.828s [INFO] Finished at: Wed Dec 12 10:00:11 IST 2012 [INFO] Final Memory: 11M/153M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "cdh4" could not be activated because it does not exist. [ERROR] Failed to execute goal org.codehaus.mojo:ideauidesigner-maven-plugin:1.0-beta-1:javac2 (default) on project h-rider: Execution default of goal org.codehaus.mojo:ideauidesigner-maven-plugin:1.0-beta-1: javac2 failed: A required class was missing while executing org.codehaus.mojo:ideauidesigner-maven-plugin:1.0-beta-1:javac2: org/apache/hadoop/io/Writable [ERROR] ----------------------------------------------------- [ERROR] realm = plugin>org.codehaus.mojo:ideauidesigner-maven-plugin:1.0-beta-1 [ERROR] strategy = org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy [ERROR] urls[0] = file:/C:/Users/ron/.m2/repository/org/codehaus/mojo/ideauidesigner-maven-plugin/1.0-beta-1/ideauidesigner-maven-plugin-1.0-beta-1.jar [ERROR] urls[1] = file:/C:/Users/ron/.m2/repository/org/codehaus/plexus/plexus-utils/1.0.5/plexus-utils-1.0.5.jar [ERROR] urls[2] = file:/C:/Users/ron/.m2/repository/com/intellij/javac2/7.0.3/javac2-7.0.3.jar [ERROR] urls[3] = file:/C:/Users/ron/.m2/repository/asm/asm-commons/3.0/asm-commons-3.0.jar [ERROR] urls[4] = file:/C:/Users/ron/.m2/repository/asm/asm-tree/3.0/asm-tree-3.0.jar [ERROR] urls[5] = file:/C:/Users/ron/.m2/repository/asm/asm/3.0/asm-3.0.jar [ERROR] urls[6] = file:/C:/Users/ron/.m2/repository/jdom/jdom/1.0/jdom-1.0.jar [ERROR] urls[7] = file:/C:/Users/ron/.m2/repository/org/apache/ant/ant/1.7.0/ant-1.7.0.jar [ERROR] urls[8] = file:/C:/Users/ron/.m2/repository/org/apache/ant/ant-launcher/1.7.0/ant-launcher-1.7.0.jar [ERROR] urls[9] = file:/C:/Users/ron/.m2/repository/com/jgoodies/forms/1.1-preview/forms-1.1-preview.jar [ERROR] urls[10] = file:/C:/Users/ron/.m2/repository/com/intellij/forms_rt/7.0.3/forms_rt-7.0.3.jar [ERROR] Number of foreign imports: 1 [ERROR] import: Entry[import from realm ClassRealm[maven.api, parent: null]] [ERROR] [ERROR] -----------------------------------------------------: org.apache.hadoop.io.Writable [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginContainerException
I commented the cdh4 profile in the new pom maybe this is the problem?
first, run: mvn dependency:tree then run: mvn package, just try it.
Done that and later I fail to connect.
I'm trying to work with CDH4.
Tried before compiling with mvn -Pcdh4 package and the build failed.
:-(
On Wed, Dec 12, 2012 at 10:07 AM, azuryy notifications@github.com wrote:
mvn package
if you want to run mvn -Pcdh4 you probably need to uncomment this profile in the pom.
Now it fails with: [INFO] Scanning for projects... [WARNING] [WARNING] Some problems were encountered while building the effective model for h-rider:h-rider:jar:1.0.0.1 [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-jar-plugin @ line 118, column 21 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-compiler-plugin is missing. @ line 136, column 21 [WARNING] [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build. [WARNING] [WARNING] For this reason, future Maven versions might no longer support building such malformed projects. [WARNING] [INFO]
[INFO] Building h-rider 1.0.0.1
[WARNING] The POM for org.apache.hbase:hbase:jar:0.92.1-cdh4.1.2 is missing, no dependency information available [WARNING] The POM for org.apache.hadoop:hadoop-client:jar:2.0.0-cdh4.1.2 is missing, no dependency information available
[INFO] BUILD FAILURE
[INFO] Total time: 1.486s [INFO] Finished at: Wed Dec 12 10:36:43 IST 2012 [INFO] Final Memory: 5M/122M
[ERROR] Failed to execute goal on project h-rider: Could not resolve dependencies for project h-rider:h-rider:jar:1.0.0.1: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.92.1-cd .1.2, org.apache.hadoop:hadoop-client:jar:2.0.0-cdh4.1.2: Failure to find org.apache.hbase:hbase:jar:0.92.1-cdh4.1.2 in file://c:\tools\hrider-master/repo was cached in the local repository, resolution will ot be reattempted until the update interval of repo has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
Maybe dhardy92 can help on this?
On Wed, Dec 12, 2012 at 10:25 AM, Igor Cher notifications@github.comwrote:
if you want to run mvn -Pcdh4 you probably need to uncomment this profile in the pom.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11280476.
Add the following in the pom.xml as I've done:
Change the hadoop version to your currently version.
HI igorcher, I reproduced the Exception:
start menu -> run -> cmd -> java -jar hr***.jar
1) connect the HMaster 2) select one table on the left panel 3) click "unselect all colums" 4) click "select all colums", here, Exceptions throw out.
let me know if you cannot get it.
Ronsher,
I've not noticed pom.xml updated. so ignore my answers.
I don't think latest pom.xml is correct :(
I updated the POM again. Removed duplication for jar plugin and returned commented CDH4 profile. Try to use it.
In addition I compiled another version of the application which this time has all its dependencies in lib folder. You can try to use it and replace all hadoop/hbase related dependencies to what you have.
@azuryy, could you paste the pom.xml that works for you?
Thanks, Ron
On Wed, Dec 12, 2012 at 10:42 AM, azuryy notifications@github.com wrote:
Add the following in the pom.xml as I've done:
org.apache.hadoop hadoop-core 1.0.4
Change the hadoop version to your currently version.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11280873.
It fails with [ERROR] Failed to execute goal on project h-rider: Could not resolve dependencies for project h-rider:h-rider:jar:1.0.0.1: The following artifacts could not be resolved: org.apache.hbase:hbase:jar:0.92.1-cdh4 .1.2, org.apache.hadoop:hadoop-client:jar:2.0.0-cdh4.1.2: Failure to find org.apache.hbase:hbase:jar:0.92.1-cdh4.1.2 in file://c:\tools\hrider-master/repo was cached in the local repository, resolution will n ot be reattempted until the update interval of repo has elapsed or updates are forced -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
Should I manually do something regarding the dependencies?
On Wed, Dec 12, 2012 at 11:20 AM, Ron Sher ron.sher@gmail.com wrote:
@azuryy, could you paste the pom.xml that works for you?
Thanks, Ron
On Wed, Dec 12, 2012 at 10:42 AM, azuryy notifications@github.com wrote:
Add the following in the pom.xml as I've done:
org.apache.hadoop hadoop-core 1.0.4
Change the hadoop version to your currently version.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11280873.
Hey azuryy, I fixed the issue you had. You can take the update.
Best Regards,
Igor Cher
Ron,
Have you tried to download the .zip and then to replace the dependencies?
I've reopened the zip. Where should I replace the dependencies?
On Wed, Dec 12, 2012 at 12:09 PM, Igor Cher notifications@github.comwrote:
Ron,
Have you tried to download the .zip and then to replace the dependencies?
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11283271.
OK finally go it working :-)
Updated the POM. Added the following:
then ran mvn -Pcdh4 package
ran the jar with java -jar h-rider-1.0.0.1.jar Changed the port to 60010 and everything worked !!!!
Thanks a lot for your help.
I suggest you update the POM for others working on CDH4.
I'd send a pull request but I'm also a newbie in git so I can't right now.
On Wed, Dec 12, 2012 at 12:18 PM, Ron Sher ron.sher@gmail.com wrote:
I've reopened the zip. Where should I replace the dependencies?
On Wed, Dec 12, 2012 at 12:09 PM, Igor Cher notifications@github.comwrote:
Ron,
Have you tried to download the .zip and then to replace the dependencies?
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11283271.
Glad to here that. I'm also newbie in git :-)
Ron, I know it works for you, so there is no need to paste my pom here:)
@igorcher Thanks for fix it.
yep, sent it before I eventually fixed this.
Thanks anyways
On Wed, Dec 12, 2012 at 2:53 PM, azuryy notifications@github.com wrote:
Ron, I know it works for you, so there is no need to paste my pom here:)
@igorcher https://github.com/igorcher Thanks for fix it.
— Reply to this email directly or view it on GitHubhttps://github.com/NiceSystems/hrider/issues/2#issuecomment-11287702.
But my bug still not fixed. I tried latest release.
It doesn't happen to me anymore and I can see that the change is indeed checked in. What do you mean by saying you tried the latest release? have you download it or compiled it?
I download and compile it. but I cannot run.
java -jar h....jar
then,throw out : D:>java -jar h-rider-1.0.0.2.jar Exception in thread "AWT-EventQueue-0" java.lang.NoClassDefFoundError: com/intel lij/uiDesigner/core/GridLayoutManager
win7 64bit English OS
What development environment do you use? Have you modified the POM?
I have the cloudera VM (https://ccp.cloudera.com/display/SUPPORT/Cloudera's+Hadoop+Demo+VM+for+CDH4) I'm unable to do the first connection. I don't see any of the default ports used.
Here is the table of the ports used by cloudera: https://ccp.cloudera.com/display/CDHDOC/Configuring+Ports+for+CDH3
Which should I use