search

XiaoMi / minos

Minos is beyond a hadoop deployment system.
Apache License 2.0
522 stars 200 forks source link

请问下，Minos支持引入现有集群监控吗？ #36

Closed zengzhaozheng closed 9 years ago

zengzhaozheng commented 9 years ago

我公司已经有一套集群在运行了，但是监控工具比较缺乏。现在想知道，我们可不可以用你们的Minos来对我们现在的集群进行相关监控。而不是去重新再装一个集群！

wuzesheng commented 9 years ago

可以用minos下面的owl组件，具体怎么用，你可以看一下相关文档

zengzhaozheng commented 9 years ago

用owl组件需要其他组件的支持吗，例如：superviso、tank？

wuzesheng commented 9 years ago

不需要

zengzhaozheng commented 9 years ago

[hadoop@jl-master minos-master]$ ./build.sh start owl --owl_ip 172.16.8.1 --owl_port 9001 2014-11-21 18:20:17 Building owl 2014-11-21 18:20:17 Check and install prerequisite python libraries 2014-11-21 18:20:17 Installing python-ldap Downloading/unpacking python-ldap>=2.4.13 Downloading python-ldap-2.4.18.tar.gz (137kB): 137kB downloaded Running setup.py (path:/data/hadoop/z.zeng/minos-master/build/env/build/python-ldap/setup.py) egg_info for package python-ldap defines: HAVE_SASL HAVE_TLS HAVE_LIBLDAP_R extra_compile_args: extra_objects: include_dirs: /opt/openldap/include /usr/include/sasl /usr/include library_dirs: /opt/openldap/lib64 /usr/lib libs: ldap_r

file Lib/ldap.py (for module ldap) not found
file Lib/ldap/controls.py (for module ldap.controls) not found
file Lib/ldap/extop.py (for module ldap.extop) not found
file Lib/ldap/schema.py (for module ldap.schema) not found
warning: no files found matching 'Makefile'
warning: no files found matching 'Modules/LICENSE'

Requirement already satisfied (use --upgrade to upgrade): setuptools in ./build/env/lib/python2.7/site-packages (from python-ldap>=2.4.13) Installing collected packages: python-ldap Running setup.py install for python-ldap defines: HAVE_SASL HAVE_TLS HAVE_LIBLDAP_R extra_compile_args: extra_objects: include_dirs: /opt/openldap/include /usr/include/sasl /usr/include library_dirs: /opt/openldap/lib64 /usr/lib libs: ldap_r file Lib/ldap.py (for module ldap) not found file Lib/ldap/controls.py (for module ldap.controls) not found file Lib/ldap/extop.py (for module ldap.extop) not found file Lib/ldap/schema.py (for module ldap.schema) not found file Lib/ldap.py (for module ldap) not found file Lib/ldap/controls.py (for module ldap.controls) not found file Lib/ldap/extop.py (for module ldap.extop) not found file Lib/ldap/schema.py (for module ldap.schema) not found

file Lib/ldap.py (for module ldap) not found
file Lib/ldap/controls.py (for module ldap.controls) not found
file Lib/ldap/extop.py (for module ldap.extop) not found
file Lib/ldap/schema.py (for module ldap.schema) not found
warning: no files found matching 'Makefile'
warning: no files found matching 'Modules/LICENSE'
building '_ldap' extension
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/LDAPObject.c -o build/temp.linux-x86_64-2.7/Modules/LDAPObject.o
In file included from Modules/LDAPObject.c:18:
/usr/include/sasl/sasl.h:349: 警告：函数声明不是一个原型
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/ldapcontrol.c -o build/temp.linux-x86_64-2.7/Modules/ldapcontrol.o
Modules/ldapcontrol.c: In function ‘encode_assertion_control’:
Modules/ldapcontrol.c:352: 警告：隐式声明函数 ‘ldap_create_assertion_control_value’
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/common.c -o build/temp.linux-x86_64-2.7/Modules/common.o
gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/constants.c -o build/temp.linux-x86_64-2.7/Modules/constants.o
Modules/constants.c: In function ‘LDAPinit_constants’:
Modules/constants.c:159: 错误：‘LDAP_OPT_DIAGNOSTIC_MESSAGE’ 未声明 (在此函数内第一次使用)
Modules/constants.c:159: 错误：(即使在一个函数内多次出现，每个未声明的标识符在其
Modules/constants.c:159: 错误：所在的函数内只报告一次。)
Modules/constants.c:381: 错误：‘LDAP_CONTROL_RELAX’ 未声明 (在此函数内第一次使用)
error: command 'gcc' failed with exit status 1
Complete output from command /data/hadoop/z.zeng/minos-master/build/env/bin/python -c "import setuptools, tokenize;__file__='/data/hadoop/z.zeng/minos-master/build/env/build/python-ldap/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-v5smeV-record/install-record.txt --single-version-externally-managed --compile --install-headers /data/hadoop/z.zeng/minos-master/build/env/include/site/python2.7:
defines: HAVE_SASL HAVE_TLS HAVE_LIBLDAP_R

extra_compile_args:

extra_objects:

include_dirs: /opt/openldap/include /usr/include/sasl /usr/include

library_dirs: /opt/openldap/lib64 /usr/lib

libs: ldap_r

running install

running build

running build_py

file Lib/ldap.py (for module ldap) not found

file Lib/ldap/controls.py (for module ldap.controls) not found

file Lib/ldap/extop.py (for module ldap.extop) not found

file Lib/ldap/schema.py (for module ldap.schema) not found

creating build

creating build/lib.linux-x86_64-2.7

copying Lib/ldapurl.py -> build/lib.linux-x86_64-2.7

copying Lib/ldif.py -> build/lib.linux-x86_64-2.7

copying Lib/dsml.py -> build/lib.linux-x86_64-2.7

creating build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/init.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/async.py -> build/lib.linux-x86_64-2.7/ldap

creating build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/init.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/libldap.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/openldap.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/ppolicy.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/psearch.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/pwdpolicy.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/readentry.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/sessiontrack.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/controls/simple.py -> build/lib.linux-x86_64-2.7/ldap/controls

copying Lib/ldap/cidict.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/dn.py -> build/lib.linux-x86_64-2.7/ldap

creating build/lib.linux-x86_64-2.7/ldap/extop

copying Lib/ldap/extop/init.py -> build/lib.linux-x86_64-2.7/ldap/extop

copying Lib/ldap/extop/dds.py -> build/lib.linux-x86_64-2.7/ldap/extop

copying Lib/ldap/filter.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/functions.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/ldapobject.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/logger.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/modlist.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/resiter.py -> build/lib.linux-x86_64-2.7/ldap

copying Lib/ldap/sasl.py -> build/lib.linux-x86_64-2.7/ldap

creating build/lib.linux-x86_64-2.7/ldap/schema

copying Lib/ldap/schema/init.py -> build/lib.linux-x86_64-2.7/ldap/schema

copying Lib/ldap/schema/models.py -> build/lib.linux-x86_64-2.7/ldap/schema

copying Lib/ldap/schema/subentry.py -> build/lib.linux-x86_64-2.7/ldap/schema

copying Lib/ldap/schema/tokenizer.py -> build/lib.linux-x86_64-2.7/ldap/schema

copying Lib/ldap/syncrepl.py -> build/lib.linux-x86_64-2.7/ldap

file Lib/ldap.py (for module ldap) not found

file Lib/ldap/controls.py (for module ldap.controls) not found

file Lib/ldap/extop.py (for module ldap.extop) not found

file Lib/ldap/schema.py (for module ldap.schema) not found

running egg_info

writing dependency_links to Lib/python_ldap.egg-info/dependency_links.txt

writing requirements to Lib/python_ldap.egg-info/requires.txt

writing Lib/python_ldap.egg-info/PKG-INFO

writing top-level names to Lib/python_ldap.egg-info/top_level.txt

warning: manifest_maker: standard file '-c' not found

file Lib/ldap.py (for module ldap) not found

file Lib/ldap/controls.py (for module ldap.controls) not found

file Lib/ldap/extop.py (for module ldap.extop) not found

file Lib/ldap/schema.py (for module ldap.schema) not found

reading manifest file 'Lib/python_ldap.egg-info/SOURCES.txt'

reading manifest template 'MANIFEST.in'

warning: no files found matching 'Makefile'

warning: no files found matching 'Modules/LICENSE'

writing manifest file 'Lib/python_ldap.egg-info/SOURCES.txt'

running build_ext

building '_ldap' extension

creating build/temp.linux-x86_64-2.7

creating build/temp.linux-x86_64-2.7/Modules

gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/LDAPObject.c -o build/temp.linux-x86_64-2.7/Modules/LDAPObject.o

In file included from Modules/LDAPObject.c:18:

/usr/include/sasl/sasl.h:349: 警告：函数声明不是一个原型

gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/ldapcontrol.c -o build/temp.linux-x86_64-2.7/Modules/ldapcontrol.o

Modules/ldapcontrol.c: In function ‘encode_assertion_control’:

Modules/ldapcontrol.c:352: 警告：隐式声明函数 ‘ldap_create_assertion_control_value’

gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/common.c -o build/temp.linux-x86_64-2.7/Modules/common.o

gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_SASL -DHAVE_TLS -DHAVE_LIBLDAP_R -DHAVE_LIBLDAP_R -DLDAPMODULE_VERSION=2.4.18 -IModules -I/opt/openldap/include -I/usr/include/sasl -I/usr/include -I/usr/local/python2.7/include/python2.7 -c Modules/constants.c -o build/temp.linux-x86_64-2.7/Modules/constants.o

Modules/constants.c: In function ‘LDAPinit_constants’:

Modules/constants.c:159: 错误：‘LDAP_OPT_DIAGNOSTIC_MESSAGE’ 未声明 (在此函数内第一次使用)

Modules/constants.c:159: 错误：(即使在一个函数内多次出现，每个未声明的标识符在其

Modules/constants.c:159: 错误：所在的函数内只报告一次。)

Modules/constants.c:381: 错误：‘LDAP_CONTROL_RELAX’ 未声明 (在此函数内第一次使用)

error: command 'gcc' failed with exit status 1

Cleaning up... Command /data/hadoop/z.zeng/minos-master/build/env/bin/python -c "import setuptools, tokenize;file='/data/hadoop/z.zeng/minos-master/build/env/build/python-ldap/setup.py';exec(compile(getattr(tokenize, 'open', open)(file).read().replace('\r\n', '\n'), file, 'exec'))" install --record /tmp/pip-v5smeV-record/install-record.txt --single-version-externally-managed --compile --install-headers /data/hadoop/z.zeng/minos-master/build/env/include/site/python2.7 failed with error code 1 in /data/hadoop/z.zeng/minos-master/build/env/build/python-ldap Traceback (most recent call last): File "/data/hadoop/z.zeng/minos-master/build/env/bin/pip", line 11, in sys.exit(main()) File "/data/hadoop/z.zeng/minos-master/build/env/lib/python2.7/site-packages/pip/init.py", line 185, in main return command.main(cmd_args) File "/data/hadoop/z.zeng/minos-master/build/env/lib/python2.7/site-packages/pip/basecommand.py", line 161, in main text = '\n'.join(complete_log) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe8 in position 34: ordinal not in range(128) 2014-11-21 18:20:21 Command '['/data/hadoop/z.zeng/minos-master/build/env/bin/pip', 'install', 'python-ldap>=2.4.13']' returned non-zero exit status 1

启动owl时报了这个错，我的python2.7版本的。请问这是什么问题？

zengzhaozheng commented 9 years ago

奇怪 我python是2.7的，这里怎么装的是python-ldap-2.4.18.tar.gz？

YxAc commented 9 years ago

看起来像是缺少ldap的依赖库：参考：http://stackoverflow.com/questions/4768446/python-cant-install-python-ldap