Flower(0.8.0-dev) - Unable To View Broker.

[ChillarAnand]

flower -> 0.8.0-dev software -> celery:3.1.12 (Cipater) kombu:3.0.20 py:2.7.6 billiard:3.3.0.18 py-amqp:1.4.5 platform -> system:Linux arch:64bit, ELF imp:CPython loader -> celery.loaders.default.Loader settings -> transport:amqp results:disabled

Traceback (most recent call last): File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/web.py", line 1349, in _when_complete if result.result() is not None: File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/stack_context.py", line 302, in wrapped ret = fn(_args, _kwargs) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 574, in inner self.set_result(key, result) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 500, in set_result self.run() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(_exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/views/broker.py", line 31, in get queues = yield broker.queues(queue_names) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 520, in run next = self.yield_point.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 409, in get_result return self.runner.pop_result(self.key).result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/stack_context.py", line 302, in wrapped ret = fn(_args, _kwargs) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 574, in inner self.set_result(key, result) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 500, in set_result self.run() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(_exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/utils/broker.py", line 74, in queues url, auth_username=username, auth_password=password) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 520, in run next = self.yield_point.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 409, in get_result return self.runner.pop_result(self.key).result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 131, in result return super(TracebackFuture, self).result(timeout=timeout) File "/home/k3/work/p/local/lib/python2.7/site-packages/concurrent/futures/_base.py", line 397, in result return self.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/concurrent/futures/_base.py", line 356, in __get_result raise self._exception AttributeError: 'NoneType' object has no attribute 'submit'

[mher]

@ChillarAnand can you provide the debug log? (flower --debug)

[ChillarAnand]

[I 140908 10:57:46 command:113] Visit me at http://localhost:5555 [I 140908 10:57:46 command:114] Broker: amqp://guest:@localhost:5672// [D 140908 10:57:46 command:116] Registered tasks: ['celery.backend_cleanup', 'celery.chain', 'celery.chord', 'celery.chord_unlock', 'celery.chunks', 'celery.group', 'celery.map', 'celery.starmap'] [D 140908 10:57:46 command:117] Settings: {'cookie_secret': 'IVxe3+QtSoifl+41HqmGuR7DLibA80vEiOggYDP9Awg=', 'debug': True, 'login_url': '/login', 'static_path': '/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/static', 'template_path': '/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/templates'} [D 140908 10:57:46 control:28] Updating all worker's cache... [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 channel:438] Channel open [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 channel:438] Channel open [D 140908 10:57:46 channel:438] Channel open [D 140908 10:57:46 connection:640] Open OK! [D 140908 10:57:46 channel:438] Channel open [D 140908 10:57:46 channel:438] Channel open [I 140908 10:57:46 mixins:225] Connected to amqp://guest:@127.0.0.1:5672// [D 140908 10:57:46 channel:80] using channel_id: 1 [D 140908 10:57:46 channel:438] Channel open [W 140908 10:57:46 state:74] Substantial drift from celery@proc_vcf may mean clocks are out of sync. Current drift is 21600 seconds. [orig: 2014-09-08 10:57:46.557262 recv: 2014-09-08 04:57:46.555738]

[W 140908 10:57:46 state:74] Substantial drift from celery@project_queue may mean clocks are out of sync. Current drift is 21600 seconds. [orig: 2014-09-08 10:57:46.557715 recv: 2014-09-08 04:57:46.555514]

[W 140908 10:57:46 state:74] Substantial drift from celery@ftp_vcf may mean clocks are out of sync. Current drift is 21600 seconds. [orig: 2014-09-08 10:57:46.558985 recv: 2014-09-08 04:57:46.555610]

[W 140908 10:57:46 state:74] Substantial drift from celery@ftp_fastq may mean clocks are out of sync. Current drift is 21600 seconds. [orig: 2014-09-08 10:57:46.559768 recv: 2014-09-08 04:57:46.556240]

[W 140908 10:57:46 state:74] Substantial drift from celery@proc_fastq may mean clocks are out of sync. Current drift is 21600 seconds. [orig: 2014-09-08 10:57:46.560986 recv: 2014-09-08 04:57:46.556826]

[D 140908 10:57:47 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:47 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:47 connection:640] Open OK! [D 140908 10:57:47 channel:80] using channel_id: 1 [D 140908 10:57:47 connection:640] Open OK! [D 140908 10:57:47 connection:754] Start from server, version: 0.9, properties: {u'information': u'Licensed under the MPL. See http://www.rabbitmq.com/', u'product': u'RabbitMQ', u'copyright': u'Copyright (C) 2007-2013 GoPivotal, Inc.', u'capabilities': {u'exchange_exchange_bindings': True, u'connection.blocked': True, u'authentication_failure_close': True, u'basic.nack': True, u'consumer_priorities': True, u'consumer_cancel_notify': True, u'publisher_confirms': True}, u'platform': u'Erlang/OTP', u'version': u'3.2.4'}, mechanisms: [u'AMQPLAIN', u'PLAIN'], locales: [u'en_US'] [D 140908 10:57:47 channel:438] Channel open [D 140908 10:57:47 channel:80] using channel_id: 1 [D 140908 10:57:47 channel:438] Channel open [D 140908 10:57:47 connection:640] Open OK! [D 140908 10:57:47 channel:80] using channel_id: 1 [D 140908 10:57:47 channel:438] Channel open [D 140908 10:57:48 app:63] Updated workers cache [I 140908 10:57:53 web:1856] 200 GET /broker (127.0.0.1) 61.34ms [E 140908 10:57:53 web:1433] Uncaught exception GET /broker (127.0.0.1) HTTPRequest(protocol='http', host='localhost:5555', method='GET', uri='/broker', version='HTTP/1.1', remoteip='127.0.0.1', headers={'Accept-Language': 'en-US,en;q=0.8,ms;q=0.6,te;q=0.4', 'Accept-Encoding': 'gzip,deflate,sdch', 'Host': 'localhost:5555', 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,/_;q=0.8', 'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.94 Safari/537.36', 'Dnt': '1', 'Connection': 'keep-alive', 'Referer': 'http://localhost:5555/broker', 'Alexatoolbar-Alx_ns_ph': 'AlexaToolbar/alxg-3.3', 'Cookie': 'csrftoken=7wjtPVWQuYNjXRc2aun6SbVE3nv57ti5; djdt=hide'}) Traceback (most recent call last): File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/web.py", line 1349, in _when_complete if result.result() is not None: File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/stack_context.py", line 302, in wrapped ret = fn(_args, _kwargs) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 574, in inner self.set_result(key, result) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 500, in set_result self.run() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(_exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/views/broker.py", line 31, in get queues = yield broker.queues(queue_names) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 520, in run next = self.yield_point.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 409, in get_result return self.runner.pop_result(self.key).result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 129, in result raise_exc_info(self.__exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/stack_context.py", line 302, in wrapped ret = fn(_args, _kwargs) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 574, in inner self.set_result(key, result) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 500, in set_result self.run() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 529, in run yielded = self.gen.throw(_exc_info) File "/home/k3/work/p/local/lib/python2.7/site-packages/flower-0.8.0-py2.7.egg/flower/utils/broker.py", line 74, in queues url, auth_username=username, auth_password=password) File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 520, in run next = self.yield_point.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/gen.py", line 409, in get_result return self.runner.pop_result(self.key).result() File "/home/k3/work/p/local/lib/python2.7/site-packages/tornado/concurrent.py", line 131, in result return super(TracebackFuture, self).result(timeout=timeout) File "/home/k3/work/p/local/lib/python2.7/site-packages/concurrent/futures/_base.py", line 397, in result return self.get_result() File "/home/k3/work/p/local/lib/python2.7/site-packages/concurrent/futures/_base.py", line 356, in __get_result raise self._exception AttributeError: 'NoneType' object has no attribute 'submit' [E 140908 10:57:53 web:1856] 500 GET /broker (127.0.0.1) 21.26ms

[mher]

What version of tornado are you using? I'm not able to reproduce this.

[ChillarAnand]

tornado==3.2.2

All packages in my virtualenv: Babel==1.3 Django==1.6.5 Fabric==1.9.0 Jinja2==2.7.3 MarkupSafe==0.23 MySQL-python==1.2.5 Pillow==2.4.0 Pygments==1.6 South==0.8.4 Sphinx==1.2.2 Werkzeug==0.9.6 amqp==1.4.6 anyjson==0.3.3 argparse==1.2.1 autoflake==0.6.6 backports.ssl-match-hostname==3.4.0.2 billiard==3.3.0.18 celery==3.1.14 coverage==3.7.1 django-allauth==0.16.1 django-bootstrap-form==3.1 django-bootstrap3==4.8.2 django-celery==3.1.10 django-crispy-forms==1.4.0 django-debug-toolbar==1.2.1 django-email-as-username==1.6.7 django-extensions==1.3.8 django-grappelli==2.5.3 django-guardian==1.2.2 django-jenkins==0.16.2 django-nose==1.2 django-passwords==0.2.0 django-registration==1.0 django-sendgrid==1.0.1 django-shell-ipynb==0.3.0 django-simple-captcha==0.4.2 django-userena==1.3.0 dnspython==1.11.1 docutils==0.12 easy-thumbnails==2.0.1 ecdsa==0.11 epc==0.0.5 eventlet==0.15.1 execnet==1.2.0 factory-boy==2.4.1 flake8==2.1.0 flower==0.8.0 fudge==1.0.3 futures==2.1.6 greenlet==0.4.3 html2text==2014.7.3 ipython==2.1.0 jedi==0.8.1-final0 kombu==3.0.22 mccabe==0.2.1 mock==1.0.1 mod-wsgi==4.2.6 mod-wsgi-metrics==1.1.0 model-mommy==1.2.1 nose==1.3.3 oauthlib==0.6.3 paramiko==1.14.0 pep8==1.5.7 psutil==2.1.1 pudb==2014.1 py==1.4.22 pycrypto==2.6.1 pyflakes==0.8.1 pygeoip==0.3.1 pytest==2.6.0 pytest-cache==1.0 pytest-pep8==1.0.6 python-openid==2.2.5 pytz==2014.7 pyzmq==14.3.1 redis==2.10.3 requests==2.3.0 requests-oauthlib==0.4.1 rq==0.4.6 sexpdata==0.0.3 six==1.3.0 sphinxcontrib-fulltoc==1.0 sphinxcontrib-httpdomain==1.3.0 sqlparse==0.1.11 stevedore==0.15 tornado==3.2.2 tox==1.7.2 urwid==1.2.1 virtualenv==1.11.6 virtualenv-clone==0.2.5 virtualenvwrapper==4.3.1 wsgiref==0.1.2

[mher]

There is a bug in tornado.httpclient version 3.2.2. The issue will be resolved if you update the tornado version.

[ChillarAnand]

I am not sure, the bug is caused by tornado. With tornado==3.2.2 I am unable to reproduce this now. However I have upgraded tornado. Thank you @mher

[huntcsg]

I can confirm that I got a similar error, and then after updating tornado to 4.0.2 I can no longer reproduce the error.