datamade / bga-payroll

💰 How much do your public officials make?
4 stars 4 forks source link

Person reindex is timing out on staging #560

Closed hancush closed 2 years ago

hancush commented 2 years ago

Persistently getting timeouts when trying to build the Solr index:

SolrError: Connection to server 'http://127.0.0.1:8986/solr/bga/update/?commit=true' timed out: HTTPConnectionPool(host='127.0.0.1', port=8986): Read timed out. (read timeout=60)
  File "manage.py", line 15, in <module>
    execute_from_command_line(sys.argv)
  File "django/core/management/__init__.py", line 381, in execute_from_command_line
    utility.execute()
  File "django/core/management/__init__.py", line 375, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "django/core/management/base.py", line 323, in run_from_argv
    self.execute(*args, **cmd_options)
  File "django/core/management/base.py", line 364, in execute
    output = self.handle(*args, **options)
  File "payroll/management/commands/build_solr_index.py", line 95, in handle
    getattr(self, 'index_{}'.format(entity))()
  File "payroll/management/commands/build_solr_index.py", line 315, in index_people
    self.searcher.add(documents)
  File "pysolr.py", line 906, in add
    overwrite=overwrite, handler=handler)
  File "pysolr.py", line 488, in _update
    return self._send_request('post', path, message, {'Content-type': 'text/xml; charset=utf-8'})
  File "pysolr.py", line 380, in _send_request
    raise SolrError(error_message % (url, err))
hancush commented 2 years ago

Dunno if there was transient pressure on the server or what, but I teed off a new person index yesterday afternoon and it completed successfully. @deraj1013, the new data should be searchable on the staging site now. Can you let me know if you have any problems in this issue?

deraj1013 commented 2 years ago

Can do