Open johanwasserman opened 6 years ago
Johan -
Probably a missing file or setup .... here is mine. HDP 2.6.4 RHEL 7.5
Dave ----begin----
/var/lib/ambari-server/resources/stacks/HDP/2.6/services/JANUSGRAPH/
[root@master JANUSGRAPH]# ll total 32 -rwxr-xr-x 1 root root 1423 Aug 9 00:37 alerts.json drwxr-xr-x 2 root root 171 Aug 9 00:37 configuration -rwxr-xr-x 1 root root 1425 Aug 9 00:37 kerberos.json -rw-r--r-- 1 root root 11333 Aug 9 00:37 LICENSE -rwxr-xr-x 1 root root 4620 Aug 9 00:37 metainfo.xml drwxr-xr-x 6 root root 97 Aug 9 00:37 package drwxr-xr-x 2 root root 29 Aug 9 00:37 quicklinks -rw-r--r-- 1 root root 2866 Aug 9 00:37 README.md drwxr-xr-x 2 root root 303 Aug 9 00:37 screenshots [root@master JANUSGRAPH]# ls configuration/ gremlin-server.xml hadoop-gryo.xml hadoop-hbase-read.xml janusgraph-env.xml janusgraph-hbase-solr.xml janusgraph-log4j.xml [root@master JANUSGRAPH]# ls package/ alerts archive.zip files scripts templates [root@master JANUSGRAPH]# ls quicklinks/ quicklinks.json
----metainfo.xml----
<?xml version="1.0"?>
----end----
On Tue, Aug 14, 2018 at 6:30 PM Johan notifications@github.com wrote:
Hi, keep up the good work.
I get the following trying to install on: Ambari version 2.7.0.0 HDP standard version 3.0.0.0-1634 CentOS Linux release 7.5.1804
stderr
Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 35, in
BeforeAnyHook().execute() File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 353, in execute method(env) File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook setup_users() File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users groups = params.user_to_groups_dict[user], KeyError: u'janusgraph' Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-257.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-257.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] stdout
2018-08-15 08:25:09,409 - Stack Feature Version Info: Cluster Stack=3.0, Command Stack=None, Command Version=None -> 3.0 2018-08-15 08:25:09,418 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-08-15 08:25:09,420 - Group['livy'] {} 2018-08-15 08:25:09,421 - Group['spark'] {} 2018-08-15 08:25:09,422 - Group['janusgraph'] {} 2018-08-15 08:25:09,422 - Group['hdfs'] {} 2018-08-15 08:25:09,422 - Group['zeppelin'] {} 2018-08-15 08:25:09,422 - Group['hadoop'] {} 2018-08-15 08:25:09,423 - Group['users'] {} 2018-08-15 08:25:09,424 - User['yarn-ats'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,425 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,426 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,428 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,429 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-15 08:25:09,430 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,432 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2018-08-15 08:25:09,433 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'users'], 'uid': None} 2018-08-15 08:25:09,434 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['zeppelin', 'hadoop'], 'uid': None} 2018-08-15 08:25:09,436 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['livy', 'hadoop'], 'uid': None} 2018-08-15 08:25:09,437 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['spark', 'hadoop'], 'uid': None} Error: Error: Unable to run the custom hook script ['/usr/bin/python', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py', 'ANY', '/var/lib/ambari-agent/data/command-257.json', '/var/lib/ambari-agent/cache/stack-hooks/before-ANY', '/var/lib/ambari-agent/data/structured-out-257.json', 'INFO', '/var/lib/ambari-agent/tmp', 'PROTOCOL_TLSv1_2', ''] 2018-08-15 08:25:09,720 - The repository with version 3.0.0.0-1634 for this command has been marked as resolved. It will be used to report the version of the component which was installed 2018-08-15 08:25:09,730 - Skipping stack-select on JANUSGRAPH because it does not exist in the stack-select package structure.
Command failed after 1 tries
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/chupman/janusgraph-ambari-service/issues/11, or mute the thread https://github.com/notifications/unsubscribe-auth/ACZAMkbP5uvgGGjUw8Kk8vytzg40m-u3ks5uQ0-ggaJpZM4V9Rxz .
--
Dave Winters
530.217.3282 c 530.887.0686 o
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of clients, business partners, or employers.
If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone.
Hi Dave, Nope, followed your instructions to the T, it's all there
# ls -la /var/lib/ambari-server/resources/stacks/HDP/3.0/services/JANUSGRAPH
total 40
drwxr-xr-x 7 root root 201 Aug 15 07:38 .
drwxr-xr-x 28 root root 4096 Aug 15 07:38 ..
-rwxr-xr-x 1 root root 1423 Aug 15 07:38 alerts.json
drwxr-xr-x 2 root root 171 Aug 15 07:38 configuration
drwxr-xr-x 8 root root 163 Aug 15 07:38 .git
-rw-r--r-- 1 root root 1157 Aug 15 07:38 .gitignore
-rwxr-xr-x 1 root root 1425 Aug 15 07:38 kerberos.json
-rw-r--r-- 1 root root 11333 Aug 15 07:38 LICENSE
-rwxr-xr-x 1 root root 4620 Aug 15 07:38 metainfo.xml
drwxr-xr-x 6 root root 97 Aug 15 07:38 package
drwxr-xr-x 2 root root 29 Aug 15 07:38 quicklinks
-rw-r--r-- 1 root root 2866 Aug 15 07:38 README.md
drwxr-xr-x 2 root root 303 Aug 15 07:38 screenshots
# ls -la /var/lib/ambari-server/resources/stacks/HDP/3.0/services/JANUSGRAPH/configuration/
total 32
drwxr-xr-x 2 root root 171 Aug 15 07:38 .
drwxr-xr-x 7 root root 201 Aug 15 07:38 ..
-rwxr-xr-x 1 root root 3955 Aug 15 07:38 gremlin-server.xml
-rwxr-xr-x 1 root root 3874 Aug 15 07:38 hadoop-gryo.xml
-rwxr-xr-x 1 root root 4172 Aug 15 07:38 hadoop-hbase-read.xml
-rwxr-xr-x 1 root root 6610 Aug 15 07:38 janusgraph-env.xml
-rwxr-xr-x 1 root root 2929 Aug 15 07:38 janusgraph-hbase-solr.xml
-rwxr-xr-x 1 root root 2716 Aug 15 07:38 janusgraph-log4j.xml
# ls -la /var/lib/ambari-server/resources/stacks/HDP/3.0/services/JANUSGRAPH/package/
total 52
drwxr-xr-x 6 root root 97 Aug 15 07:38 .
drwxr-xr-x 7 root root 201 Aug 15 07:38 ..
drwxr-xr-x 2 root root 46 Aug 15 07:38 alerts
-rwxr-xr-x 1 root root 47750 Aug 15 07:38 archive.zip
drwxr-xr-x 2 root root 104 Aug 15 07:38 files
-rw-r--r-- 1 root root 40 Aug 15 07:38 .hash
drwxr-xr-x 2 root root 177 Aug 15 07:38 scripts
drwxr-xr-x 2 root root 85 Aug 15 07:38 templates
# ls -la /var/lib/ambari-server/resources/stacks/HDP/3.0/services/JANUSGRAPH/quicklinks/
total 4
drwxr-xr-x 2 root root 29 Aug 15 07:38 .
drwxr-xr-x 7 root root 201 Aug 15 07:38 ..
-rw-r--r-- 1 root root 3537 Aug 15 07:38 quicklinks.json
Hi, Does this ring a bell? Seems like I need some modules?
# python /var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 20, in <module>
from resource_management import *
ImportError: No module named resource_management
Doesn't ring a bell. I only tested against ambari 2.5 and 2.6 so I'm not sure if there's anything breaking in 2.7. I was waiting for JanusGraph 0.3.0 to continue on this and will hopefully find time to pick it back up in the near future.
I'll try to find time this week to recreate your issue.
My installation has those in place. If you're missing them then maybe the Ambari install is partial.
Here is my directory.
----begin---- [root@master scripts]# pwd /var/lib/ambari-server/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts [root@master scripts]# ls hook.py hook.pyo params.pyc shared_initialization.py shared_initialization.pyo hook.pyc params.py params.pyo shared_initialization.pyc [root@master scripts]# ----end----
-
On Tue, Aug 14, 2018 at 8:13 PM Johan notifications@github.com wrote:
Hi, Does this ring a bell? Seems like I need some modules?
python /var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py
Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 20, in
from resource_management import * ImportError: No module named resource_management — You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/chupman/janusgraph-ambari-service/issues/11#issuecomment-413055341, or mute the thread https://github.com/notifications/unsubscribe-auth/ACZAMrBklE2fJj-YDzaP-cG-qiS28Cm7ks5uQ2epgaJpZM4V9Rxz .
Chris -
Happy to give it a try when 0.3 comes out. Have not tried 2.7 either ..
Dave
On Wed, Aug 15, 2018 at 12:09 AM chupman notifications@github.com wrote:
Doesn't ring a bell. I only tested against ambari 2.5 and 2.6 so I'm not sure if there's anything breaking in 2.7. I was waiting for JanusGraph 0.3.0 to continue on this and will hopefully find time to pick it back up in the near future.
I'll try to find time this week to recreate your issue.
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/chupman/janusgraph-ambari-service/issues/11#issuecomment-413088809, or mute the thread https://github.com/notifications/unsubscribe-auth/ACZAMhR676MGOvn5JZl2ocU5Mc3sQdJ6ks5uQ577gaJpZM4V9Rxz .
From the error
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/hook.py", line 29, in hook
setup_users()
File "/var/lib/ambari-agent/cache/stack-hooks/before-ANY/scripts/shared_initialization.py", line 50, in setup_users
groups = params.user_to_groups_dict[user],
KeyError: u'janusgraph'
it looks like the janusgraph user isn't getting created or passed to params correctly. Since the HDP 3.0 sandbox isn't out I don't have a way to reproduce or test right now.
you might want to try manually creating the janusgraph user and group or using 2.6 if possible
Quick FYI. I'm planning to essentially archive this repo in the very near future. The proposal to move this under the official JanusGraph umbrella was approved. All future development will happen in the janusgraph-ambari repo going forward.
I'm assuming this will make no one sad.
No sadness here., thanks for the good work you've done. Also, close this issue please, I'm downgrading my HDP installation to 2.6.
Hi, keep up the good work.
I get the following trying to install on: Ambari version 2.7.0.0 HDP standard version 3.0.0.0-1634 CentOS Linux release 7.5.1804
stderr
stdout