search

ceph / teuthology-api

A REST API to execute teuthology commands.
MIT License
2 stars 10 forks source link

suite: t-api unable to reach paddles after scheduling #38

Closed VallariAg closed 12 months ago

VallariAg commented 1 year ago

when scheduling something on /suite route, the response is:

{
  "detail": "HTTPException(status_code=500, detail='InvalidSchema(\"No connection adapters were found for \\'None/runs/vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode/\\'\")')"
}

Server logs:

$ gunicorn -c gunicorn_config.py teuthology_api.main:app
[2023-11-09 00:07:40 +0530] [28863] [INFO] Starting gunicorn 21.2.0
[2023-11-09 00:07:40 +0530] [28863] [INFO] Listening at: http://0.0.0.0:8083 (28863)
[2023-11-09 00:07:40 +0530] [28863] [INFO] Using worker: uvicorn.workers.UvicornWorker
[2023-11-09 00:07:40 +0530] [28864] [INFO] Booting worker with pid: 28864
/Users/vallari/Documents/work/teuthology-api/venv/lib/python3.9/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2.0 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020
  warnings.warn(
[2023-11-09 00:07:41 +0530] [28864] [INFO] Started server process [28864]
[2023-11-09 00:07:41 +0530] [28864] [INFO] Waiting for application startup.
[2023-11-09 00:07:41 +0530] [28864] [INFO] Application startup complete.
2023-11-09 00:07:48,460.460 INFO:teuthology.suite:Using random seed=4806
2023-11-09 00:07:48,461.461 INFO:teuthology.suite.run:kernel sha1: distro
2023-11-09 00:07:49,252.252 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci.git main -> 23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:49,255.255 INFO:teuthology.suite.run:ceph sha1: 23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:49,256.256 DEBUG:teuthology.suite.util:Defaults for machine_type testnode distro centos: arch=x86_64, release=centos/7, pkg_type=rpm
2023-11-09 00:07:49,256.256 INFO:teuthology.suite.util:container build centos/8, checking for build_complete
2023-11-09 00:07:49,256.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:52,214.214 DEBUG:teuthology.packaging:looking for centos/8 x86_64 default
2023-11-09 00:07:52,215.215 DEBUG:teuthology.packaging:build: centos/8 arm64 default
2023-11-09 00:07:52,216.216 DEBUG:teuthology.packaging:build: ubuntu/20.04 x86_64 default
2023-11-09 00:07:52,217.217 DEBUG:teuthology.packaging:build: ubuntu/22.04 x86_64 default
2023-11-09 00:07:52,217.217 DEBUG:teuthology.packaging:build: centos/8 x86_64 default
2023-11-09 00:07:52,224.224 INFO:teuthology.suite.run:ceph version: 18.0.0-7037.g23776148
2023-11-09 00:07:53,115.115 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci.git main -> 23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:53,116.116 INFO:teuthology.suite.run:ceph-ci branch: main 23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:53,116.116 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph-ci.git
2023-11-09 00:07:53,140.140 INFO:teuthology.repo_utils:Fetching main from origin
2023-11-09 00:07:54,250.250 INFO:teuthology.repo_utils:Resetting repo at /Users/vallari/src/github.com_ceph_ceph-c_main to origin/main
2023-11-09 00:07:55,085.085 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/teuthology main -> 6899cd26fceddb2fec83dc1a1349394b28c8998e
2023-11-09 00:07:55,086.086 INFO:teuthology.suite.run:teuthology branch: main 6899cd26fceddb2fec83dc1a1349394b28c8998e
2023-11-09 00:07:55,119.119 DEBUG:teuthology.suite.run:Suite teuthology:no-ceph in /Users/vallari/src/github.com_ceph_ceph-c_main/qa/suites/teuthology/no-ceph
2023-11-09 00:07:55,120.120 DEBUG:teuthology.suite.run:subset = None
2023-11-09 00:07:55,120.120 DEBUG:teuthology.suite.run:no_nested_subset = False
2023-11-09 00:07:55,121.121 INFO:teuthology.suite.run:Suite teuthology:no-ceph in /Users/vallari/src/github.com_ceph_ceph-c_main/qa/suites/teuthology/no-ceph generated 1 jobs (not yet filtered or merged)
2023-11-09 00:07:55,121.121 DEBUG:teuthology.suite.merge:merging config {clusters/single tasks/teuthology}
2023-11-09 00:07:55,124.124 DEBUG:teuthology.suite.merge:postmerge script running:

2023-11-09 00:07:55,126.126 DEBUG:teuthology.suite.util:Defaults for machine_type smithi distro centos: arch=x86_64, release=centos/7, pkg_type=rpm
2023-11-09 00:07:55,127.127 INFO:teuthology.suite.util:container build centos/8, checking for build_complete
2023-11-09 00:07:55,127.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=23776148d05fd5bbb0eae6dde0ebb81fe2ceda46
2023-11-09 00:07:58,234.234 DEBUG:teuthology.packaging:looking for centos/8 x86_64 default
2023-11-09 00:07:58,235.235 DEBUG:teuthology.packaging:build: centos/8 arm64 default
2023-11-09 00:07:58,236.236 DEBUG:teuthology.packaging:build: ubuntu/20.04 x86_64 default
2023-11-09 00:07:58,237.237 DEBUG:teuthology.packaging:build: ubuntu/22.04 x86_64 default
2023-11-09 00:07:58,238.238 DEBUG:teuthology.packaging:build: centos/8 x86_64 default
/Users/vallari/Documents/work/teuthology-api/venv/lib/python3.9/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2.0 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020
  warnings.warn(
Job scheduled with name vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode and ID 4
2023-11-09 00:07:58,722.722 INFO:teuthology.suite.run:Scheduling teuthology:no-ceph/{clusters/single tasks/teuthology}
/Users/vallari/Documents/work/teuthology-api/venv/lib/python3.9/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2.0 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020
  warnings.warn(
Job scheduled with name vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode and ID 5
2023-11-09 00:07:59,290.290 INFO:teuthology.suite.run:Suite teuthology:no-ceph in /Users/vallari/src/github.com_ceph_ceph-c_main/qa/suites/teuthology/no-ceph scheduled 1 jobs.
2023-11-09 00:07:59,291.291 INFO:teuthology.suite.run:0/1 jobs were filtered out.
2023-11-09 00:07:59,291.291 INFO:teuthology.suite.run:Scheduled 1 jobs in total.
/Users/vallari/Documents/work/teuthology-api/venv/lib/python3.9/site-packages/urllib3/__init__.py:34: NotOpenSSLWarning: urllib3 v2.0 only supports OpenSSL 1.1.1+, currently the 'ssl' module is compiled with 'LibreSSL 2.8.3'. See: https://github.com/urllib3/urllib3/issues/3020
  warnings.warn(
Job scheduled with name vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode and ID 6
2023-11-09 00:07:59,769.769 INFO:teuthology.suite.run:Test results viewable at http://pulpito.ceph.com/vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode/
2023-11-09 00:07:59,771.771 ERROR:teuthology_api.services.helpers:No connection adapters were found for 'None/runs/vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode/'
2023-11-09 00:07:59,771.771 ERROR:teuthology_api.services.suite:teuthology.suite.main failed with the error: HTTPException(status_code=500, detail='InvalidSchema("No connection adapters were found for \'None/runs/vallariag-2023-11-09_00:07:48-teuthology:no-ceph-main-distro-default-testnode/\'")')

Reason: this is because PADDLES_URL is empty in services/helpers.py: https://github.com/ceph/teuthology-api/blob/f92d3f3fc874a719ba9f1f52eb9c75e5180cd34a/src/teuthology_api/services/helpers.py#L14

A simple solution would be to call load_env() in config.py instead of calling it in each module.

Other solution would be to import all env variables as config settings (according to fastapi docs: https://fastapi.tiangolo.com/advanced/settings/#reading-a-env-file

This PR does the second solution: https://github.com/ceph/teuthology-api/pull/34