search

mysociety / citizenconnect

Citizen Connect project for the NHS: reporting problems, leaving reviews
https://www.nhs.uk/careconnect/choices
Other
1 stars 0 forks source link

Investigate failing get_reviews_from_choices_api cron jobs #1279

Closed stevenday closed 10 years ago

stevenday commented 10 years ago

In the last three days we've had:

Traceback (most recent call last):
  File "./manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 443, in execute_from_command_line
    utility.execute()
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 382, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 196, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 232, in execute
    output = self.handle(*args, **options)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 371, in handle
    return self.handle_noargs(**options)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/management/commands/get_reviews_from_choices_api.py", line 39, in handle_noargs
    for review in reviews:
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 59, in next
    self.load_next_page()
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 215, in load_next_page
    reviews_from_xml = self.extract_reviews_from_xml(xml)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 170, in extract_reviews_from_xml
    root = ET.fromstring(xml)
  File "lxml.etree.pyx", line 2993, in lxml.etree.fromstring (src/lxml/lxml.etree.c:63285)
  File "parser.pxi", line 1617, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:93571)
  File "parser.pxi", line 1495, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:92370)
  File "parser.pxi", line 1011, in lxml.etree._BaseParser._parseDoc (src/lxml/lxml.etree.c:89010)
  File "parser.pxi", line 577, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:84711)
  File "parser.pxi", line 676, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:85816)
  File "parser.pxi", line 616, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:85138)
lxml.etree.XMLSyntaxError: Couldn't find end of Start Tag que line 1, line 1, column 19217

### output captured before 'get_reviews_from_choices_api' exited ###

RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 64 for reply 266547R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 88 for reply 280004R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 97 for reply 280005R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 134308 for reply 279996R - skipping

Followed by:

Traceback (most recent call last):
  File "./manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 443, in execute_from_command_line
    utility.execute()
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 382, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 196, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 232, in execute
    output = self.handle(*args, **options)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 371, in handle
    return self.handle_noargs(**options)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/management/commands/get_reviews_from_choices_api.py", line 39, in handle_noargs
    for review in reviews:
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 59, in next
    self.load_next_page()
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 215, in load_next_page
    reviews_from_xml = self.extract_reviews_from_xml(xml)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 170, in extract_reviews_from_xml
    root = ET.fromstring(xml)
  File "lxml.etree.pyx", line 2993, in lxml.etree.fromstring (src/lxml/lxml.etree.c:63285)
  File "parser.pxi", line 1617, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:93571)
  File "parser.pxi", line 1495, in lxml.etree._parseDoc (src/lxml/lxml.etree.c:92370)
  File "parser.pxi", line 1011, in lxml.etree._BaseParser._parseDoc (src/lxml/lxml.etree.c:89010)
  File "parser.pxi", line 577, in lxml.etree._ParserContext._handleParseResultDoc (src/lxml/lxml.etree.c:84711)
  File "parser.pxi", line 676, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:85816)
  File "parser.pxi", line 616, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:85138)
lxml.etree.XMLSyntaxError: AttValue: ' expected, line 1, column 20814

### output captured before 'get_reviews_from_choices_api' exited ###

RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 134971 for reply 282005R - skipping

RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 64 for reply 266547R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 88 for reply 280004R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 97 for reply 280005R - skipping
RepliedToReviewDoesNotExist: Could not find review with api_posting_id of 134308 for reply 279996R - skipping

And finally today:

Traceback (most recent call last):
  File "./manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 443, in execute_from_command_line
    utility.execute()
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/__init__.py", line 382, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 196, in run_from_argv
    self.execute(*args, **options.__dict__)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 232, in execute
    output = self.handle(*args, **options)
  File "/data/vhost/citizenconnect.mysociety.org/virtualenv-citizenconnect/lib/python2.6/site-packages/django/core/management/base.py", line 371, in handle
    return self.handle_noargs(**options)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/management/commands/get_reviews_from_choices_api.py", line 39, in handle_noargs
    for review in reviews:
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 59, in next
    self.load_next_page()
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 208, in load_next_page
    xml = self.fetch_from_api(self.next_page_url)
  File "/data/vhost/citizenconnect.mysociety.org/citizenconnect/reviews_display/reviews_api.py", line 82, in fetch_from_api
    raise e
urllib2.HTTPError: HTTP Error 503: Service Unavailable

### output captured before 'get_reviews_from_choices_api' exited ###
stevenday commented 10 years ago

Hmm, I ran it manually without any problems, so I can only assume it was a transient error. I'll wait 'til tonight to confirm.