Closed sraustein closed 11 years ago
sraustein
commented
11 years ago this seems to have put ca0.rpki.net in a state where nagios whines about ca0 being down. i have a running ssh session to it. and it seems ok.
thinking of rebooting
Trac comment by randy on 2013-03-07T03:05:03Z
sraustein
commented
11 years ago and it repeatedly logs
Traceback (most recent call last):
File "/usr/local/sbin/rpkigui-rcynic", line 57, in
Trac comment by randy on 2013-03-07T03:28:57Z
sraustein
commented
11 years ago looks as if that may have been a mysql crash. restart allows me to get to the gooey again.
randy
Trac comment by randy on 2013-03-07T03:30:23Z
sraustein
commented
11 years ago that could explain it. the gui was trying to connect to rpkid, but timed out.
Trac comment by melkins on 2013-03-07T04:13:15Z
sraustein
commented
11 years ago Closed with resolution invalid
error at /rpki/child/3/delete [Errno 60] Operation timed out Request Method: POST Request URL: https://ca0.rpki.net/rpki/child/3/delete Django Version: 1.4.5 Exception Type: error Exception Value:
[Errno 60] Operation timed out Exception Location: /usr/local/lib/python2.7/asyncore.py in handle_connect_event, line 449 Python Executable: /usr/local/bin/python Python Version: 2.7.3 Python Path:
['/usr/local/etc/rpki', '/usr/local/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg', '/usr/local/lib/python2.7/site-packages/python_dateutil-1.5-py2.7.egg', '/usr/local/lib/python2.7/site-packages/vobject-0.8.1c-py2.7.egg', '/usr/local/lib/python2.7/site-packages/MySQL_python-1.2.3-py2.7-freebsd-9.1-PRERELEASE-amd64.egg', '/usr/local/lib/python2.7/site-packages/lxml-3.0.1-py2.7-freebsd-9.1-PRERELEASE-amd64.egg', '/usr/local/lib/python2.7/site-packages/South-0.7.6-py2.7.egg', '/usr/local/lib/python2.7/site-packages/flup-1.0.2-py2.7.egg', '/usr/local/lib/python27.zip', '/usr/local/lib/python2.7', '/usr/local/lib/python2.7/plat-freebsd9', '/usr/local/lib/python2.7/lib-tk', '/usr/local/lib/python2.7/lib-old', '/usr/local/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/site-packages'] Server time: Thu, 7 Mar 2013 02:21:25 +0000 Traceback Switch to copy-and-paste view
/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py in get_response response = callback(request, _callback_args, _callback_kwargs) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/django/contrib/auth/decorators.py in _wrapped_view return view_func(request, _args, _kwargs) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/gui/decorators.py in _tls_required return f(request, _args, _kwargs) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/gui/app/views.py in wrapped_fn return f(request, _args, _kwargs) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/gui/app/views.py in child_delete z.synchronize(conf.handle) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/django/db/transaction.py in inner return func(_args, _kwargs) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/irdb/zookeeper.py in synchronize self.synchronize_rpkid_one_ca_core(ca, ca.handle in handles_to_poke) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/irdb/zookeeper.py in synchronize_rpkid_one_ca_core rpki.left_right.child_elt.make_pdu( action = "list", tag = "child", self_handle = ca.handle)) ... ▶ Local vars /usr/local/lib/python2.7/site-packages/rpki/irdb/zookeeper.py in call_rpkid return call_rpkid(pdus) ... ▶ Local vars /usr/local/lib/python2.7/asyncore.py in read obj.handle_read_event() ... ▶ Local vars /usr/local/lib/python2.7/asyncore.py in handle_read_event self.handle_connect_event() ... ▶ Local vars /usr/local/lib/python2.7/asyncore.py in handle_connect_event raise socket.error(err, _strerror(err)) ... ▶ Local vars Request information
GET No GET data POST Variable Value csrfmiddlewaretoken u'YWDeXR8HZpUEfI0dkNqWn6cLCXy3R8lh' FILES No FILES data COOKIES Variable Value csrftoken,
<type 'long'>: <function at 0x80e6cf488>,
<type 'dict'>: ,
<type 'NoneType'>: <function None2NULL at 0x80e6cf230>,
<type 'set'>: <function Set2Str at 0x80e6cf050>,
<type 'str'>: <function Thing2Literal at 0x80e6cf2a8>,
<type 'tuple'>: ,
<type 'object'>: <function Instance2Str at 0x80e6cf320>,
<type 'unicode'>: <function Unicode2Str at 0x80e6cf140>,
<type 'datetime.datetime'>: <function DateTime2literal at 0x80e6c5a28>,
<type 'datetime.timedelta'>: <function DateTimeDelta2literal at 0x80e6c5aa0>,
<type 'array.array'>: <function array2Str at 0x80e6cf410>},
'init_command': 'SET storageengine=INNODB'},
'PASSWORD': u'***',
'PORT': '',
'TEST_CHARSET': None,
'TEST_COLLATION': None,
'TEST_MIRROR': None,
'TEST_NAME': None,
'TIME_ZONE': 'UTC',
'USER': 'rpki'}}
SERVER_EMAIL
'YWDeXR8HZpUEfI0dkNqWn6cLCXy3R8lh' sessionid
'7b9fc3458057d0e746e08769a0e11c97' META Variable Value mod_wsgi.listener_port
'443' HTTP_REFERER
'https://ca0.rpki.net/rpki/child/3/delete' mod_wsgi.listener_host
'' SERVER_SOFTWARE 'Apache/2.2.23 (FreeBSD) mod_wsgi/3.4 Python/2.7.3 mod_ssl/2.2.24 OpenSSL/1.0.1e DAV/2' SCRIPT_NAME u'' mod_wsgi.enable_sendfile
'0' mod_wsgi.handler_script '' SERVER_SIGNATURE
'' REQUEST_METHOD
'POST' PATH_INFO
u'/rpki/child/3/delete' HTTP_ORIGIN 'https://ca0.rpki.net' SERVER_PROTOCOL 'HTTP/1.1' QUERY_STRING
'' SSL_TLS_SNI 'ca0.rpki.net' CONTENT_LENGTH
'52' HTTP_ACCEPTCHARSET 'ISO-8859-1,utf-8;q=0.7,;q=0.3' HTTP_USER_AGENT 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_8_2) AppleWebKit/537.22 (KHTML, like Gecko) Chrome/25.0.1364.152 Safari/537.22' HTTP_CONNECTION 'keep-alive' HTTP_COOKIE 'sessionid=7b9fc3458057d0e746e08769a0e11c97; csrftoken=YWDeXR8HZpUEfI0dkNqWn6cLCXy3R8lh' SERVER_NAME 'ca0.rpki.net' REMOTE_ADDR '2001:240:6a8:0:858:ad75:8696:82ed' mod_wsgi.queue_start
'1362622810261729' mod_wsgi.request_handler
'wsgi-script' wsgi.url_scheme 'https' PATH_TRANSLATED '/usr/local/share/rpki/wsgi/rpki.wsgi/rpki/child/3/delete' SERVER_PORT '443' wsgi.multiprocess
True mod_wsgi.input_chunked
'0' SERVER_ADDR '2001:418:1::85' DOCUMENT_ROOT
'/usr/local/www/apache22/data' mod_wsgi.process_group
'' SCRIPT_FILENAME '/usr/local/share/rpki/wsgi/rpki.wsgi' SERVER_ADMIN
'randy@psg.com' wsgi.input
<mod_wsgi.Input object at 0x812232e70> HTTP_DNT
'1' HTTP_HOST
'ca0.rpki.net' wsgi.multithread
False mod_wsgi.callable_object
'application' HTTP_CACHE_CONTROL
'max-age=0' REQUEST_URI '/rpki/child/3/delete' HTTPACCEPT 'text/html,application/xhtml+xml,application/xml;q=0.9,/_;q=0.8' wsgi.version
(1, 0) GATEWAY_INTERFACE
'CGI/1.1' wsgi.run_once
False wsgi.errors <mod_wsgi.Log object at 0x812232e30> REMOTE_PORT '58508' HTTP_ACCEPT_LANGUAGE
'en-US,en;q=0.8' mod_wsgi.version
(3, 4) CONTENT_TYPE
'application/x-www-form-urlencoded' mod_wsgi.application_group
'ca0.rpki.net|' mod_wsgi.script_reloading
'1' wsgi.file_wrapper
'' CSRF_COOKIE 'YWDeXR8HZpUEfI0dkNqWn6cLCXy3R8lh' HTTP_ACCEPT_ENCODING
'gzip,deflate,sdch' UNIQUE_ID
'UTf5WpMcAFUAATItFb4AAAAA' Settings Using settings module settings Setting Value USE_L10N
False USE_THOUSAND_SEPARATOR
False CSRF_COOKIE_SECURE
False LANGUAGE_CODE
'en-us' ROOT_URLCONF
'rpki.gui.urls' MANAGERS
() DEFAULT_CHARSET 'utf-8' STATIC_ROOT '/usr/local/share/rpki/media' ALLOWEDHOSTS
[''] MESSAGE_STORAGE 'django.contrib.messages.storage.fallback.FallbackStorage' EMAIL_SUBJECT_PREFIX
'[Django] ' FILE_UPLOAD_PERMISSIONS None URL_VALIDATOR_USER_AGENT
'Django/1.4.5 (https://www.djangoproject.com)' STATICFILES_FINDERS ('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder') SESSION_COOKIE_DOMAIN
None SESSION_COOKIE_NAME 'sessionid' ADMIN_FOR
() TIME_INPUT_FORMATS
('%H:%M:%S', '%H:%M') DATABASES
{'default': {'ENGINE': 'django.db.backends.mysql', 'HOST': '', 'NAME': 'irdbd', 'OPTIONS': {'conv': {0: <class 'decimal.Decimal'>, 1: <type 'int'>, 2: <type 'int'>, 3: <type 'long'>, 4: <type 'float'>, 5: <type 'float'>, 7: <function mysql_timestamp_converter at 0x80e6c5b18>, 8: <type 'long'>, 9: <type 'int'>, 10: <function Date_or_None at 0x80e6c59b0>, 11: <function TimeDelta_or_None at 0x80e6c58c0>, 12: <function DateTime_or_None at 0x80e6c5848>, 13: <type 'int'>, 15: [(128, <type 'str'>)], 246: <class 'decimal.Decimal'>, 248: <function Str2Set at 0x80e6c5f50>, 252: [(128, <type 'str'>)], 253: [(128, <type 'str'>)], 254: [(128, <type 'str'>)], <type 'bool'>: <function Bool2Str at 0x80e6c5ed8>, <type 'instance'>: <function Instance2Str at 0x80e6cf320>, <type 'float'>: <function Float2Str at 0x80e6cf1b8>, <type 'int'>: <function Thing2Str at 0x80e6cf0c8>, <type 'list'>:
'root@localhost' FILE_UPLOAD_HANDLERS
('django.core.files.uploadhandler.MemoryFileUploadHandler', 'django.core.files.uploadhandler.TemporaryFileUploadHandler') DEFAULT_CONTENT_TYPE
'text/html' APPEND_SLASH
True FIRST_DAY_OF_WEEK
0 DATABASE_ROUTERS
[] YEAR_MONTH_FORMAT
'F Y' STATICFILES_STORAGE 'django.contrib.staticfiles.storage.StaticFilesStorage' CACHES
{'default': {'BACKEND': 'django.core.cache.backends.locmem.LocMemCache', 'LOCATION': ''}} SESSION_COOKIE_PATH '/' USE_X_FORWARDED_HOST
False MIDDLEWARE_CLASSES
('django.middleware.common.CommonMiddleware', 'django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.http.ConditionalGetMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware') USE_I18N
True THOUSAND_SEPARATOR
',' SECRETKEY
u'******_' LANGUAGE_COOKIE_NAME
'django_language' DEFAULT_INDEX_TABLESPACE
'' TRANSACTIONS_MANAGED
False LOGGING_CONFIG
'django.utils.log.dictConfig' SEND_BROKEN_LINK_EMAILS False TEMPLATE_LOADERS
('django.template.loaders.filesystem.Loader', 'django.template.loaders.app_directories.Loader', 'django.template.loaders.eggs.Loader') WSGI_APPLICATION
None TEMPLATE_DEBUG
True X_FRAME_OPTIONS 'SAMEORIGIN' AUTHENTICATION_BACKENDS ('django.contrib.auth.backends.ModelBackend',) FORCE_SCRIPT_NAME
None CACHE_BACKEND
'locmem://' SIGNING_BACKEND 'django.core.signing.TimestampSigner' SESSION_COOKIE_SECURE
False CSRF_COOKIE_DOMAIN
None FILE_CHARSET
'utf-8' DEBUG
True SESSION_FILE_PATH
None DEFAULT_FILE_STORAGE
'django.core.files.storage.FileSystemStorage' INSTALLED_APPS
('django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.staticfiles', 'rpki.irdb', 'rpki.gui.app', 'rpki.gui.cacheview', 'rpki.gui.routeview', 'south') LANGUAGES
(('ar', 'Arabic'), ('az', 'Azerbaijani'), ('bg', 'Bulgarian'), ('bn', 'Bengali'), ('bs', 'Bosnian'), ('ca', 'Catalan'), ('cs', 'Czech'), ('cy', 'Welsh'), ('da', 'Danish'), ('de', 'German'), ('el', 'Greek'), ('en', 'English'), ('en-gb', 'British English'), ('eo', 'Esperanto'), ('es', 'Spanish'), ('es-ar', 'Argentinian Spanish'), ('es-mx', 'Mexican Spanish'), ('es-ni', 'Nicaraguan Spanish'), ('et', 'Estonian'), ('eu', 'Basque'), ('fa', 'Persian'), ('fi', 'Finnish'), ('fr', 'French'), ('fy-nl', 'Frisian'), ('ga', 'Irish'), ('gl', 'Galician'), ('he', 'Hebrew'), ('hi', 'Hindi'), ('hr', 'Croatian'), ('hu', 'Hungarian'), ('id', 'Indonesian'), ('is', 'Icelandic'), ('it', 'Italian'), ('ja', 'Japanese'), ('ka', 'Georgian'), ('kk', 'Kazakh'), ('km', 'Khmer'), ('kn', 'Kannada'), ('ko', 'Korean'), ('lt', 'Lithuanian'), ('lv', 'Latvian'), ('mk', 'Macedonian'), ('ml', 'Malayalam'), ('mn', 'Mongolian'), ('nb', 'Norwegian Bokmal'), ('ne', 'Nepali'), ('nl', 'Dutch'), ('nn', 'Norwegian Nynorsk'), ('pa', 'Punjabi'), ('pl', 'Polish'), ('pt', 'Portuguese'), ('pt-br', 'Brazilian Portuguese'), ('ro', 'Romanian'), ('ru', 'Russian'), ('sk', 'Slovak'), ('sl', 'Slovenian'), ('sq', 'Albanian'), ('sr', 'Serbian'), ('sr-latn', 'Serbian Latin'), ('sv', 'Swedish'), ('sw', 'Swahili'), ('ta', 'Tamil'), ('te', 'Telugu'), ('th', 'Thai'), ('tr', 'Turkish'), ('tt', 'Tatar'), ('uk', 'Ukrainian'), ('ur', 'Urdu'), ('vi', 'Vietnamese'), ('zh-cn', 'Simplified Chinese'), ('zh-tw', 'Traditional Chinese')) COMMENTS_ALLOW_PROFANITIES
False STATICFILES_DIRS
() PREPEND_WWW False SECURE_PROXY_SSL_HEADER None SESSION_COOKIE_HTTPONLY True DEBUG_PROPAGATE_EXCEPTIONS
False MONTH_DAY_FORMAT
'F j' LOGIN_URL
'/accounts/login/' SESSION_EXPIRE_AT_BROWSER_CLOSE False TIME_FORMAT 'P' DATE_INPUT_FORMATS
('%Y-%m-%d', '%m/%d/%Y', '%m/%d/%y', '%b %d %Y', '%b %d, %Y', '%d %b %Y', '%d %b, %Y', '%B %d %Y', '%B %d, %Y', '%d %B %Y', '%d %B, %Y') CSRF_COOKIE_NAME
'csrftoken' EMAIL_HOSTPASSWORD u'******_' PASSWORD_RESET_TIMEOUTDAYS u'******_' CACHE_MIDDLEWARE_ALIAS
'default' SESSION_SAVE_EVERY_REQUEST
False NUMBER_GROUPING 0 SESSION_ENGINE
'django.contrib.sessions.backends.db' CSRF_FAILURE_VIEW
'django.views.csrf.csrf_failure' CSRF_COOKIE_PATH
'/' LOGIN_REDIRECT_URL
'/accounts/profile/' LOGGING {'disable_existing_loggers': False, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}, 'handlers': {'mail_admins': {'class': 'django.utils.log.AdminEmailHandler', 'filters': ['require_debug_false'], 'level': 'ERROR'}}, 'loggers': {'django.request': {'handlers': ['mail_admins'], 'level': 'ERROR', 'propagate': True}}, 'version': 1} IGNORABLE_404_URLS
() LOCALE_PATHS
() TEMPLATE_STRING_IF_INVALID
'' LOGOUT_URL
'/accounts/logout/' EMAIL_USE_TLS
False FIXTURE_DIRS
() EMAIL_HOST
'localhost' DATE_FORMAT 'N j, Y' MEDIA_ROOT
'' DEFAULT_EXCEPTION_REPORTER_FILTER
'django.views.debug.SafeExceptionReporterFilter' ADMINS
() FORMAT_MODULE_PATH
None DEFAULT_FROM_EMAIL
'webmaster@localhost' MEDIA_URL
'' DATETIME_FORMAT 'N j, Y, P' TEMPLATE_DIRS
() DISALLOWED_USER_AGENTS
() ALLOWED_INCLUDE_ROOTS
() DECIMAL_SEPARATOR
'.' SHORT_DATE_FORMAT
'm/d/Y' TEST_RUNNER 'django.test.simple.DjangoTestSuiteRunner' CACHE_MIDDLEWARE_KEYPREFIX u'******_' TIME_ZONE
'UTC' FILE_UPLOAD_MAX_MEMORY_SIZE 2621440 EMAIL_BACKEND
'django.core.mail.backends.smtp.EmailBackend' DEFAULT_TABLESPACE
'' TEMPLATE_CONTEXT_PROCESSORS ('django.contrib.auth.context_processors.auth', 'django.core.context_processors.debug', 'django.core.context_processors.i18n', 'django.core.context_processors.media', 'django.contrib.messages.context_processors.messages', 'django.core.context_processors.request', 'django.core.context_processors.static') SESSION_COOKIE_AGE
1209600 SETTINGS_MODULE 'settings' USE_ETAGS
False LANGUAGES_BIDI
('he', 'ar', 'fa') FILE_UPLOAD_TEMP_DIR
None INTERNAL_IPS
() STATIC_URL
'/media/' EMAIL_PORT
25 USE_TZ
False SHORT_DATETIME_FORMAT
'm/d/Y P' PASSWORDHASHERS
u'******_' ABSOLUTE_URL_OVERRIDES
{} CACHE_MIDDLEWARE_SECONDS
600 DATETIME_INPUT_FORMATS
('%Y-%m-%d %H:%M:%S', '%Y-%m-%d %H:%M:%S.%f', '%Y-%m-%d %H:%M', '%Y-%m-%d', '%m/%d/%Y %H:%M:%S', '%m/%d/%Y %H:%M:%S.%f', '%m/%d/%Y %H:%M', '%m/%d/%Y', '%m/%d/%y %H:%M:%S', '%m/%d/%y %H:%M:%S.%f', '%m/%d/%y %H:%M', '%m/%d/%y') EMAIL_HOST_USER '' PROFANITIESLIST
u'*******' You're seeing this error because you have DEBUG = True in your Django settings file. Change that to False, and Django will display a standard 500 page.
Trac ticket #452 component gui priority major, owner melkins, created by randy on 2013-03-07T02:27:20Z, last modified 2013-03-11T16:13:55Z