Aug 10 14:28:55 video [servicevariant=lms][celery.worker.consumer][env:sandbox] ERROR [video 10346] [consumer.py:364] - consumer: Cannot connect to amqp://celery:*@192.168.212.115:5672//: [Errno 111] Connection refused.
Trying again in 32.00 seconds...
Aug 10 14:29:01 video [service_variant=lms][urllib3.connectionpool][env:sandbox] INFO [video 14805] [connectionpool.py:257] - Starting new HTTP connection (1): localhost
Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] INFO [video 14805] [base.py:49] - HEAD http://localhost:9200/courseware_index [status:200 request:0.051s]
Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] WARNING [video 14805] [base.py:68] - GET /courseware_index/course_info/_search?from=0&size=20 [status:503 request:0.019s]
Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] INFO [video 14805] [base.py:70] - > {"query": {"filtered": {"filter": {"bool": {"must": [{"or": [{"range": {"enrollment_end": {"gte": "2016-08-10T12:29:01.113002"}}}, {"missing": {"field": "enrollment_end"}}]}]}}, "query": {"bool": {"must": [{"querystring": {"fields": ["content."], "query": "cloud"}}]}}}}, "facets": {"org": {"terms": {"field": "org"}}, "modes": {"terms": {"field": "modes"}}, "language": {"terms": {"field": "language"}}}}
Aug 10 14:29:01 video [service_variant=lms][search.elastic][env:sandbox] ERROR [video 14805] [elastic.py:612] - error while searching index -
Traceback (most recent call last):
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/elastic.py", line 608, in search
_kwargs
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 70, in _wrapped
return func(_args, params=params, _kwargs)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/init.py", line 388, in search
params=params, body=body)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/transport.py", line 274, in perform_request
status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 55, in perform_request
self._raise_error(response.status, raw_data)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/base.py", line 83, in _raise_error
raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info)
TransportError: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]')
Aug 10 14:29:01 video [service_variant=lms][search.views][env:sandbox] ERROR [video 14805] [views.py:226] - Search view exception when searching for cloud for user None: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]', {u'status': 503, u'error': u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]'})
Traceback (most recent call last):
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/views.py", line 195, in course_discovery
field_dictionary=field_dictionary,
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/api.py", line 97, in course_discovery_search
facet_terms=course_discovery_facets(),
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/elastic.py", line 608, in search
_kwargs
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 70, in _wrapped
return func(_args, params=params, _kwargs)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/init.py", line 388, in search
params=params, body=body)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/transport.py", line 274, in perform_request
status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 55, in perform_request
self._raise_error(response.status, raw_data)
File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/base.py", line 83, in _raise_error
raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info)
TransportError: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]')
Aug 10 14:28:55 video [servicevariant=lms][celery.worker.consumer][env:sandbox] ERROR [video 10346] [consumer.py:364] - consumer: Cannot connect to amqp://celery:*@192.168.212.115:5672//: [Errno 111] Connection refused. Trying again in 32.00 seconds... Aug 10 14:29:01 video [service_variant=lms][urllib3.connectionpool][env:sandbox] INFO [video 14805] [connectionpool.py:257] - Starting new HTTP connection (1): localhost Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] INFO [video 14805] [base.py:49] - HEAD http://localhost:9200/courseware_index [status:200 request:0.051s] Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] WARNING [video 14805] [base.py:68] - GET /courseware_index/course_info/_search?from=0&size=20 [status:503 request:0.019s] Aug 10 14:29:01 video [service_variant=lms][elasticsearch][env:sandbox] INFO [video 14805] [base.py:70] - > {"query": {"filtered": {"filter": {"bool": {"must": [{"or": [{"range": {"enrollment_end": {"gte": "2016-08-10T12:29:01.113002"}}}, {"missing": {"field": "enrollment_end"}}]}]}}, "query": {"bool": {"must": [{"querystring": {"fields": ["content."], "query": "cloud"}}]}}}}, "facets": {"org": {"terms": {"field": "org"}}, "modes": {"terms": {"field": "modes"}}, "language": {"terms": {"field": "language"}}}} Aug 10 14:29:01 video [service_variant=lms][search.elastic][env:sandbox] ERROR [video 14805] [elastic.py:612] - error while searching index - Traceback (most recent call last): File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/elastic.py", line 608, in search _kwargs File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 70, in _wrapped return func(_args, params=params, _kwargs) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/init.py", line 388, in search params=params, body=body) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/transport.py", line 274, in perform_request status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 55, in perform_request self._raise_error(response.status, raw_data) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/base.py", line 83, in _raise_error raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info) TransportError: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]') Aug 10 14:29:01 video [service_variant=lms][search.views][env:sandbox] ERROR [video 14805] [views.py:226] - Search view exception when searching for cloud for user None: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]', {u'status': 503, u'error': u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]'}) Traceback (most recent call last): File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/views.py", line 195, in course_discovery field_dictionary=field_dictionary, File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/api.py", line 97, in course_discovery_search facet_terms=course_discovery_facets(), File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/search/elastic.py", line 608, in search _kwargs File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", line 70, in _wrapped return func(_args, params=params, _kwargs) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/client/init.py", line 388, in search params=params, body=body) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/transport.py", line 274, in perform_request status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", line 55, in perform_request self._raise_error(response.status, raw_data) File "/edx/app/edxapp/venvs/edxapp/local/lib/python2.7/site-packages/elasticsearch/connection/base.py", line 83, in _raise_error raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info) TransportError: TransportError(503, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed]')