search

SETI / rms-opus

PDS OPUS - Outer Planets Data Search Tool
Apache License 2.0
9 stars 7 forks source link

/api/fields.json exceeds memcached allowed size #1294

Closed rfrenchseti closed 1 year ago

rfrenchseti commented 1 year ago

Calling /api/fields.json results in an internal server error (500) and the following error log:

[Tue Feb 14 00:10:06.968157 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638] [14/Feb/2023 00:10:06] ERROR [django.request:241] Internal Server Error: /opus/api/fields.json
[Tue Feb 14 00:10:06.968180 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638] Traceback (most recent call last):
[Tue Feb 14 00:10:06.968184 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner
[Tue Feb 14 00:10:06.968186 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     response = get_response(request)
[Tue Feb 14 00:10:06.968189 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]                ^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968192 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response
[Tue Feb 14 00:10:06.968195 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     response = wrapped_callback(request, *callback_args, **callback_kwargs)
[Tue Feb 14 00:10:06.968198 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968200 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/django/views/decorators/cache.py", line 62, in _wrapped_view_func
[Tue Feb 14 00:10:06.968203 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     response = view_func(request, *args, **kwargs)
[Tue Feb 14 00:10:06.968205 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968208 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/src/pds-opus/opus/application/apps/metadata/views.py", line 656, in api_get_fields
[Tue Feb 14 00:10:06.968210 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     ret = get_fields_info(fmt, request, api_code, slug=slug, collapse=collapse)
[Tue Feb 14 00:10:06.968213 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968215 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/src/pds-opus/opus/application/apps/metadata/views.py", line 837, in get_fields_info
[Tue Feb 14 00:10:06.968218 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     cache.set(cache_key, return_obj)
[Tue Feb 14 00:10:06.968220 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/django/core/cache/backends/memcached.py", line 79, in set
[Tue Feb 14 00:10:06.968223 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     if not self._cache.set(key, value, self.get_backend_timeout(timeout)):
[Tue Feb 14 00:10:06.968225 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968227 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/hash.py", line 344, in set
[Tue Feb 14 00:10:06.968230 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     return self._run_cmd("set", key, False, *args, **kwargs)
[Tue Feb 14 00:10:06.968232 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968235 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/hash.py", line 322, in _run_cmd
[Tue Feb 14 00:10:06.968237 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     return self._safely_run_func(client, func, default_val, *args, **kwargs)
[Tue Feb 14 00:10:06.968240 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968242 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/hash.py", line 211, in _safely_run_func
[Tue Feb 14 00:10:06.968245 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     result = func(*args, **kwargs)
[Tue Feb 14 00:10:06.968247 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]              ^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968250 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/base.py", line 475, in set
[Tue Feb 14 00:10:06.968252 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     return self._store_cmd(b"set", {key: value}, expire, noreply, flags=flags)[key]
[Tue Feb 14 00:10:06.968255 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Feb 14 00:10:06.968257 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/base.py", line 1247, in _store_cmd
[Tue Feb 14 00:10:06.968260 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     self._raise_errors(line, name)
[Tue Feb 14 00:10:06.968262 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]   File "/opus/opus_venv/lib/python3.11/site-packages/pymemcache/client/base.py", line 1042, in _raise_errors
[Tue Feb 14 00:10:06.968265 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638]     raise MemcacheServerError(error)
[Tue Feb 14 00:10:06.968267 2023] [wsgi:error] [pid 1583321:tid 139751262271232] [remote 10.1.10.1:44638] pymemcache.exceptions.MemcacheServerError: b'object too large for cache'