search

permitio / opal

Policy and data administration, distribution, and real-time updates on top of Policy Agents (OPA, Cedar, ...)
https://opal.ac
Apache License 2.0
4.14k stars 157 forks source link

ValueError: Reference at 'refs/heads/master' does not exist #140

Closed hongbo-miao closed 2 years ago

hongbo-miao commented 2 years ago

Hi @asafc based on https://github.com/authorizon/opal/discussions/139#discussioncomment-1303934

it works well, it can pull the pricate repo successfully if you search Clone succeeded in the log. However, it also has some error logs inside like

ValueError: Reference at 'refs/heads/master' does not exist

Here is the full log:

Click to expand! ```shell ➜ docker compose up --force-recreate [+] Running 4/4 ⠿ Container opal-fetcher-postgres_example_db_1 Recreated 0.2s ⠿ Container opal-fetcher-postgres_broadcast_channel_1 Recreated 0.2s ⠿ Container opal-fetcher-postgres_opal_server_1 Recreated 0.1s ⠿ Container opal-fetcher-postgres_opal_client_1 Recreated 0.1s Attaching to broadcast_channel_1, example_db_1, opal_client_1, opal_server_1 broadcast_channel_1 | broadcast_channel_1 | PostgreSQL Database directory appears to contain a database; Skipping initialization broadcast_channel_1 | broadcast_channel_1 | 2021-09-10 20:12:20.222 UTC [1] LOG: starting PostgreSQL 13.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 10.3.1_git20210424) 10.3.1 20210424, 64-bit broadcast_channel_1 | 2021-09-10 20:12:20.222 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 broadcast_channel_1 | 2021-09-10 20:12:20.222 UTC [1] LOG: listening on IPv6 address "::", port 5432 broadcast_channel_1 | 2021-09-10 20:12:20.231 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" broadcast_channel_1 | 2021-09-10 20:12:20.237 UTC [22] LOG: database system was shut down at 2021-09-10 20:11:56 UTC broadcast_channel_1 | 2021-09-10 20:12:20.242 UTC [1] LOG: database system is ready to accept connections example_db_1 | example_db_1 | PostgreSQL Database directory appears to contain a database; Skipping initialization example_db_1 | example_db_1 | 2021-09-10 20:12:20.377 UTC [1] LOG: starting PostgreSQL 13.4 (Debian 13.4-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit example_db_1 | 2021-09-10 20:12:20.377 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 example_db_1 | 2021-09-10 20:12:20.377 UTC [1] LOG: listening on IPv6 address "::", port 5432 example_db_1 | 2021-09-10 20:12:20.382 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" example_db_1 | 2021-09-10 20:12:20.389 UTC [28] LOG: database system was shut down at 2021-09-10 20:11:55 UTC example_db_1 | 2021-09-10 20:12:20.396 UTC [1] LOG: database system is ready to accept connections opal_server_1 | [2021-09-10 20:12:21 +0000] [1] [INFO] Starting gunicorn 20.1.0 opal_server_1 | [2021-09-10 20:12:21 +0000] [1] [INFO] Listening at: http://0.0.0.0:7002 (1) opal_server_1 | [2021-09-10 20:12:21 +0000] [1] [INFO] Using worker: uvicorn.workers.UvicornWorker opal_server_1 | [2021-09-10 20:12:21 +0000] [9] [INFO] Booting worker with pid: 9 opal_server_1 | [2021-09-10 20:12:21 +0000] [10] [INFO] Booting worker with pid: 10 opal_server_1 | [2021-09-10 20:12:21 +0000] [11] [INFO] Booting worker with pid: 11 opal_server_1 | [2021-09-10 20:12:21 +0000] [12] [INFO] Booting worker with pid: 12 opal_server_1 | 2021-09-10T20:12:22.469124+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-10T20:12:22.469185+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-10T20:12:22.469414+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-10T20:12:22.475916+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-10T20:12:22.531102+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-10T20:12:22.531362+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-10T20:12:22.531265+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-10T20:12:22.531640+0000 |opal_server.server | INFO | leadership lock acquired, leader pid: 11 opal_server_1 | 2021-09-10T20:12:22.531774+0000 |opal_server.server | INFO | listening on webhook topic: 'webhook' opal_server_1 | 2021-09-10T20:12:22.531738+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-10T20:12:22.531933+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-10T20:12:22.532309+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-10T20:12:22.532634+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '598b3711bd6b458392bd973d3ac3b41d', 'subscriber_id': 'd8043eb8ebd046b186a03558f3407340', 'topic': 'webhook', 'callback': functools.partial(, ), 'notifier_id': None} opal_server_1 | 2021-09-10T20:12:22.532820+0000 |opal_server.policy.watcher.task | INFO | Launching repo watcher opal_server_1 | 2021-09-10T20:12:22.533394+0000 |opal_common.git.repo_cloner | INFO | Cloning repo from 'git@github.com:Hongbo-Miao/test-opa-policy.git' to '/regoclone' opal_server_1 | 2021-09-10T20:12:22.535781+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-10T20:12:22.535975+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_client_1 | [2021-09-10 20:12:22 +0000] [11] [INFO] Starting gunicorn 20.1.0 opal_client_1 | [2021-09-10 20:12:22 +0000] [11] [INFO] Listening at: http://0.0.0.0:7000 (11) opal_client_1 | [2021-09-10 20:12:22 +0000] [11] [INFO] Using worker: uvicorn.workers.UvicornWorker opal_client_1 | [2021-09-10 20:12:22 +0000] [13] [INFO] Booting worker with pid: 13 opal_client_1 | 2021-09-10T20:12:23.331080+0000 |opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: opal_client_1 | 2021-09-10T20:12:23.331600+0000 |opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: opal_client_1 | 2021-09-10T20:12:23.358514+0000 |opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'PostgresFetchProvider' found at: opal_client_1 | 2021-09-10T20:12:23.358800+0000 |opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded opal_client_1 | 2021-09-10T20:12:23.387910+0000 |opal_client.opa.runner | INFO | Launching opa runner opal_client_1 | 2021-09-10T20:12:23.389526+0000 |opal_client.opa.runner | INFO | Running OPA inline: opa run --server --addr=:8181 --authentication=off --authorization=off --log-level=info opal_client_1 | 2021-09-10T20:12:23.406463+0000 |opal_client.opa.logger | INFO | Initializing server. {'addrs': [':8181'], 'diagnostic-addrs': [], 'time': '2021-09-10T20:12:23Z'} opal_client_1 | 2021-09-10T20:12:24.396792+0000 |opal_client.opa.runner | INFO | Running OPA initial start callbacks opal_client_1 | 2021-09-10T20:12:24.397314+0000 |opal_client.data.updater | INFO | Launching data updater opal_client_1 | 2021-09-10T20:12:24.397560+0000 |opal_client.policy.updater | INFO | Launching policy updater opal_client_1 | 2021-09-10T20:12:24.397728+0000 |opal_client.data.updater | INFO | Subscribing to topics: ['policy_data'] opal_client_1 | 2021-09-10T20:12:24.397961+0000 |opal_client.policy.updater | INFO | Subscribing to topics: ['policy:.'] opal_client_1 | 2021-09-10T20:12:24.398360+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal_server:7002/ws opal_client_1 | 2021-09-10T20:12:24.399210+0000 |fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal_server:7002/ws opal_client_1 | 2021-09-10T20:12:24.403194+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal_server:7002/ws opal_client_1 | 2021-09-10T20:12:24.403589+0000 |fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal_server:7002/ws opal_server_1 | 2021-09-10T20:12:24.411522+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Listening for incoming events from broadcast channel (first listener started) opal_server_1 | 2021-09-10T20:12:24.412121+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Spawning broadcast listen task opal_server_1 | 2021-09-10T20:12:24.413270+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Listening for incoming events from broadcast channel (first listener started) opal_server_1 | 2021-09-10T20:12:24.413571+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Spawning broadcast listen task opal_server_1 | 2021-09-10T20:12:24.446157+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Subscribing to ALL TOPICS, and sharing messages with broadcast channel opal_server_1 | 2021-09-10T20:12:24.447245+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': 'ffb64af922b3454f97c741c3d8d50190', 'subscriber_id': 'ef97ec8a954f4fcb9c270e234afcb49b', 'topic': '__EventNotifier_ALL_TOPICS__', 'callback': >, 'notifier_id': None} opal_server_1 | 2021-09-10T20:12:24.447584+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Subscribing to ALL TOPICS, and sharing messages with broadcast channel opal_server_1 | 2021-09-10T20:12:24.447863+0000 |fastapi_websocket_rpc.websocket_rpc_e...| INFO | Client connected opal_server_1 | 2021-09-10T20:12:24.448284+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '0c55f3933ba54872b9491d756608c300', 'subscriber_id': 'd900f3bc5cb14831bd619fb5df4c687e', 'topic': '__EventNotifier_ALL_TOPICS__', 'callback': >, 'notifier_id': None} opal_server_1 | 2021-09-10T20:12:24.448205+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Starting broadcaster listener opal_server_1 | 2021-09-10T20:12:24.448578+0000 |fastapi_websocket_rpc.websocket_rpc_e...| INFO | Client connected opal_server_1 | 2021-09-10T20:12:24.448857+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Starting broadcaster listener opal_server_1 | 2021-09-10T20:12:24.482818+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': 'c6b6ec203e7444c483aa02f4ae618253', 'subscriber_id': '9b62c07247884b85aae0d70bfda6e46d', 'topic': 'policy:.', 'callback': .callback at 0x7fb14392e700>, 'notifier_id': None} opal_server_1 | 2021-09-10T20:12:24.485300+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': 'c2f49cc15b2443cdac0704ccf75bd493', 'subscriber_id': '34c0d20eeaf049d1b799643ef07b54bc', 'topic': 'policy_data', 'callback': .callback at 0x7fb143923700>, 'notifier_id': None} opal_client_1 | 2021-09-10T20:12:24.487855+0000 |opal_client.policy.updater | INFO | Connected to server opal_client_1 | 2021-09-10T20:12:24.488128+0000 |opal_client.policy.updater | INFO | Refetching policy code (full bundle) opal_client_1 | 2021-09-10T20:12:24.492840+0000 |opal_client.data.updater | INFO | Connected to server opal_client_1 | 2021-09-10T20:12:24.493042+0000 |opal_client.data.updater | INFO | Performing data configuration, reason: Initial load opal_client_1 | 2021-09-10T20:12:24.493137+0000 |opal_client.data.updater | INFO | Getting data-sources configuration from 'http://opal_server:7002/data/config' opal_server_1 | 2021-09-10T20:12:24.497346+0000 |opal_server.data.api | INFO | Serving source configuration opal_server_1 | 2021-09-10T20:12:24.498632+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.25.0.5:49640 - "GET /data/config HTTP/1.1" 200 opal_client_1 | 2021-09-10T20:12:24.500526+0000 |opal_client.data.updater | INFO | Triggering data update with id: 915b4daab96f465f9338f5d84663faf5 opal_client_1 | 2021-09-10T20:12:24.500758+0000 |opal_client.data.updater | INFO | Fetching policy data opal_client_1 | 2021-09-10T20:12:24.500949+0000 |opal_client.data.fetcher | INFO | Fetching data from url: postgresql://postgres@example_db:5432/postgres opal_server_1 | 2021-09-10T20:12:24.496140+0000 |opal_common.middleware |ERROR | Uncaught server exception: Reference at 'refs/heads/master' does not exist opal_server_1 | Traceback (most recent call last): opal_server_1 | opal_server_1 | File "/root/.local/bin/gunicorn", line 8, in opal_server_1 | sys.exit(run()) opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 67, in run opal_server_1 | WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run() opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 231, in run opal_server_1 | super().run() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 72, in run opal_server_1 | Arbiter(self).run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 202, in run opal_server_1 | self.manage_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 551, in manage_workers opal_server_1 | self.spawn_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers opal_server_1 | self.spawn_worker() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker opal_server_1 | worker.init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 64, in init_process opal_server_1 | super(UvicornWorker, self).init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/workers/base.py", line 142, in init_process opal_server_1 | self.run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 77, in run opal_server_1 | loop.run_until_complete(server.serve(sockets=self.sockets)) opal_server_1 | │ │ │ │ │ └ [] opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.1'}, 'http_version': '1.1', 'server': ('172.25.0.4', 7002), 'c... opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | │ │ └ opal_server_1 | └ opal_server_1 | > File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | │ │ │ │ └ ._send at 0x7fb14392ec10> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ ._send at 0x7fb14392ec10> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | │ │ │ │ └ .sender at 0x7fb14392eca0> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7fb14392eca0> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7fb14392eca0> opal_server_1 | │ │ │ └ .app at 0x7fb143ec2ca0> opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | │ └ opal_server_1 | └ .app at 0x7fb143d680d0> opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | │ └ {'repo': , 'paths': ['.']} opal_server_1 | └ opal_server_1 | opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | │ │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_client_1 | 2021-09-10T20:12:24.518549+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal_server:7002/ws opal_server_1 | │ │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ │ └ opal_client_1 | 2021-09-10T20:12:24.519709+0000 |opal_client.policy.fetcher |WARNING | Unexpected response code 500: {'error': 'Uncaught server exception'} opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | └ 'refs/heads/master' opal_server_1 | opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-10T20:12:24.511752+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.25.0.5:49638 - "GET /policy?path=. HTTP/1.1" 500 opal_server_1 | Exception in ASGI application opal_server_1 | Traceback (most recent call last): opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/applications.py", line 112, in __call__ opal_server_1 | await self.middleware_stack(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 181, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_client_1 | 2021-09-10T20:12:24.535320+0000 |opal_client.data.updater | INFO | Saving fetched data to policy-store: source url='postgresql://postgres@example_db:5432/postgres', destination path='/cities' opal_client_1 | 2021-09-10T20:12:24.540133+0000 |opal_client.opa.logger | INFO | Received request. PUT /v1/data/cities opal_client_1 | 2021-09-10T20:12:24.540594+0000 |opal_client.opa.logger | INFO | Sent response. PUT /v1/data/cities -> 204 opal_server_1 | 2021-09-10T20:12:25.521378+0000 |opal_common.middleware |ERROR | Uncaught server exception: Reference at 'refs/heads/master' does not exist opal_server_1 | Traceback (most recent call last): opal_server_1 | opal_server_1 | File "/root/.local/bin/gunicorn", line 8, in opal_server_1 | sys.exit(run()) opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 67, in run opal_server_1 | WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run() opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 231, in run opal_server_1 | super().run() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 72, in run opal_server_1 | Arbiter(self).run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 202, in run opal_server_1 | self.manage_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 551, in manage_workers opal_server_1 | self.spawn_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers opal_server_1 | self.spawn_worker() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker opal_server_1 | worker.init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 64, in init_process opal_server_1 | super(UvicornWorker, self).init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/workers/base.py", line 142, in init_process opal_server_1 | self.run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 77, in run opal_server_1 | loop.run_until_complete(server.serve(sockets=self.sockets)) opal_server_1 | │ │ │ │ │ └ [] opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.1'}, 'http_version': '1.1', 'server': ('172.25.0.4', 7002), 'c... opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | │ │ └ opal_server_1 | └ opal_server_1 | > File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_client_1 | 2021-09-10T20:12:25.537716+0000 |opal_client.policy.fetcher |WARNING | Unexpected response code 500: {'error': 'Uncaught server exception'} opal_server_1 | │ │ │ │ └ ._send at 0x7fb143cadc10> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ ._send at 0x7fb143cadc10> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | │ │ │ │ └ .sender at 0x7fb143cade50> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7fb143cade50> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7fb143cade50> opal_server_1 | │ │ │ └ .app at 0x7fb143f00d30> opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | │ └ opal_server_1 | └ .app at 0x7fb143efc940> opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | │ └ {'repo': , 'paths': ['.']} opal_server_1 | └ opal_server_1 | opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | │ │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | │ │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | └ 'refs/heads/master' opal_server_1 | opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-10T20:12:25.536392+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.25.0.5:49646 - "GET /policy?path=. HTTP/1.1" 500 opal_server_1 | Exception in ASGI application opal_server_1 | Traceback (most recent call last): opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/applications.py", line 112, in __call__ opal_server_1 | await self.middleware_stack(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 181, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-10T20:12:26.376926+0000 |opal_common.git.repo_cloner | INFO | Clone succeeded opal_server_1 | 2021-09-10T20:12:26.384872+0000 |opal_common.git.repo_watcher | INFO | Launching polling task, interval: 30 seconds opal_server_1 | 2021-09-10T20:12:27.399577+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.25.0.5:49648 - "GET /policy?path=. HTTP/1.1" 200 opal_client_1 | 2021-09-10T20:12:27.401184+0000 |opal_client.policy.updater | INFO | got policy bundle, commit hash: '6d849b1ce92bae05c31146470e66e07c3c41b164' opal_client_1 | 2021-09-10T20:12:27.404390+0000 |opal_client.opa.logger | INFO | Received request. GET /v1/policies opal_client_1 | 2021-09-10T20:12:27.404678+0000 |opal_client.opa.logger | INFO | Sent response. GET /v1/policies -> 200 opal_client_1 | 2021-09-10T20:12:27.407538+0000 |opal_client.opa.logger | INFO | Received request. PUT /v1/data opal_client_1 | 2021-09-10T20:12:27.408493+0000 |opal_client.opa.logger | INFO | Sent response. PUT /v1/data -> 204 opal_client_1 | 2021-09-10T20:12:27.410862+0000 |opal_client.opa.logger | INFO | Received request. PUT /v1/policies/rbac.rego opal_client_1 | 2021-09-10T20:12:27.415721+0000 |opal_client.opa.logger | INFO | Sent response. PUT /v1/policies/rbac.rego -> 200 opal_client_1 | 2021-09-10T20:12:27.418303+0000 |opal_client.opa.logger | INFO | Received request. PUT /v1/policies/utils.rego opal_client_1 | 2021-09-10T20:12:27.420669+0000 |opal_client.opa.logger | INFO | Sent response. PUT /v1/policies/utils.rego -> 200 opal_client_1 | 2021-09-10T20:12:27.421790+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal_server:7002/ws ```
asafc commented 2 years ago

Hi @Hongbo-Miao, silly question - but can you make sure the master branch indeed exists on the repo?

Github changed the default branch name to "main" a while back, so it could be that your branch name should be "main".

In that case you should set:

OPAL_POLICY_REPO_MAIN_BRANCH=<your_branch_name>
hongbo-miao commented 2 years ago

Oh, it is exact same repo with https://github.com/authorizon/opal-example-policy-repo but private. master branch does exist:

image

As long as I change the repo to public, the error

ValueError: Reference at 'refs/heads/master' does not exist

will be gone.

For private repo, after this error shows a few times, it will eventually show Clone succeeded, and seems all function well.

If only main branch exists without OPAL_POLICY_REPO_MAIN_BRANCH=main, it will fail without Clone succeeded.

asafc commented 2 years ago

Hey @Hongbo-Miao , i sent you a docker compose file privately on slack. Can you please try to run it?

You will need this command:

docker compose -f ./docker-compose-example.yml up --force-recreate

It has a private key and uses our own private repo.

If my compose file works for you, then something in your docker compose or repo is not configured correctly. You are welcome to give me permissions on your repo and i can help you debug :)

hongbo-miao commented 2 years ago

I replaced https://github.com/authorizon/opal/blob/3e04a8e185bb8b0894c56c06ab919c5de8fefd06/docker/docker-compose-example.yml to the file you sent me.

Still got same error

Click here to see logs ```shell opal/docker on  master [!] on 🐳 v20.10.8 via 🅒 base at ☸️ k3d-west ➜ docker compose -f ./docker-compose-example.yml up --force-recreate [+] Running 3/3 ⠿ Container docker_broadcast_channel_1 Recreated 0.4s ⠿ Container docker_opal_server_1 Recreated 0.2s ⠿ Container docker_opal_client_1 Recreated 4.8s Attaching to broadcast_channel_1, opal_client_1, opal_server_1 broadcast_channel_1 | broadcast_channel_1 | PostgreSQL Database directory appears to contain a database; Skipping initialization broadcast_channel_1 | broadcast_channel_1 | 2021-09-15 22:04:51.479 UTC [1] LOG: starting PostgreSQL 13.4 on x86_64-pc-linux-musl, compiled by gcc (Alpine 10.3.1_git20210424) 10.3.1 20210424, 64-bit broadcast_channel_1 | 2021-09-15 22:04:51.480 UTC [1] LOG: listening on IPv4 address "0.0.0.0", port 5432 broadcast_channel_1 | 2021-09-15 22:04:51.480 UTC [1] LOG: listening on IPv6 address "::", port 5432 broadcast_channel_1 | 2021-09-15 22:04:51.482 UTC [1] LOG: listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432" broadcast_channel_1 | 2021-09-15 22:04:51.487 UTC [22] LOG: database system was shut down at 2021-09-15 22:04:45 UTC broadcast_channel_1 | 2021-09-15 22:04:51.491 UTC [1] LOG: database system is ready to accept connections opal_server_1 | [2021-09-15 22:04:52 +0000] [1] [INFO] Starting gunicorn 20.1.0 opal_server_1 | [2021-09-15 22:04:52 +0000] [1] [INFO] Listening at: http://0.0.0.0:7002 (1) opal_server_1 | [2021-09-15 22:04:52 +0000] [1] [INFO] Using worker: uvicorn.workers.UvicornWorker opal_server_1 | [2021-09-15 22:04:52 +0000] [9] [INFO] Booting worker with pid: 9 opal_server_1 | [2021-09-15 22:04:52 +0000] [10] [INFO] Booting worker with pid: 10 opal_server_1 | [2021-09-15 22:04:52 +0000] [11] [INFO] Booting worker with pid: 11 opal_server_1 | [2021-09-15 22:04:53 +0000] [12] [INFO] Booting worker with pid: 12 opal_server_1 | 2021-09-15T22:04:53.730151+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-15T22:04:53.767150+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-15T22:04:53.794752+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-15T22:04:53.798186+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-15T22:04:53.798476+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-15T22:04:53.798748+0000 |opal_server.server | INFO | leadership lock acquired, leader pid: 9 opal_server_1 | 2021-09-15T22:04:53.798912+0000 |opal_server.server | INFO | listening on webhook topic: 'webhook' opal_server_1 | 2021-09-15T22:04:53.799673+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '7f8b0a39c25242199366d245be75a740', 'subscriber_id': '807178e16b914b8990001d920627eaa5', 'topic': 'webhook', 'callback': functools.partial(, ), 'notifier_id': None} opal_server_1 | 2021-09-15T22:04:53.800061+0000 |opal_server.policy.watcher.task | INFO | Launching repo watcher opal_server_1 | 2021-09-15T22:04:53.801043+0000 |opal_common.git.repo_cloner | INFO | Cloning repo from 'git@github.com:authorizon/opal-example-private-policy-repo.git' to '/regoclone' opal_server_1 | 2021-09-15T22:04:53.844094+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-15T22:04:53.844338+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-15T22:04:53.861787+0000 |opal_common.authentication.signer | INFO | OPAL was not provided with JWT encryption keys, cannot verify api requests! opal_server_1 | 2021-09-15T22:04:53.878004+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-15T22:04:53.878210+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_server_1 | 2021-09-15T22:04:53.935712+0000 |opal_server.server | INFO | triggered startup event opal_server_1 | 2021-09-15T22:04:53.935997+0000 |opal_common.topics.publisher | INFO | started topic publisher opal_client_1 | [2021-09-15 22:04:54 +0000] [1] [INFO] Starting gunicorn 20.1.0 opal_client_1 | [2021-09-15 22:04:54 +0000] [1] [INFO] Listening at: http://0.0.0.0:7000 (1) opal_client_1 | [2021-09-15 22:04:54 +0000] [1] [INFO] Using worker: uvicorn.workers.UvicornWorker opal_client_1 | [2021-09-15 22:04:54 +0000] [18] [INFO] Booting worker with pid: 18 opal_client_1 | 2021-09-15T22:04:54.752140+0000 |opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: opal_client_1 | 2021-09-15T22:04:54.752454+0000 |opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: opal_client_1 | 2021-09-15T22:04:54.752569+0000 |opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded opal_client_1 | 2021-09-15T22:04:54.788816+0000 |opal_client.opa.runner | INFO | Launching opa runner opal_client_1 | 2021-09-15T22:04:54.790489+0000 |opal_client.opa.runner | INFO | Running OPA inline: opa run --server --addr=:8181 --authentication=off --authorization=off --log-level=info opal_client_1 | 2021-09-15T22:04:55.797072+0000 |opal_client.opa.runner | INFO | Running OPA initial start callbacks opal_client_1 | 2021-09-15T22:04:55.797882+0000 |opal_client.data.updater | INFO | Launching data updater opal_client_1 | 2021-09-15T22:04:55.798231+0000 |opal_client.policy.updater | INFO | Launching policy updater opal_client_1 | 2021-09-15T22:04:55.799022+0000 |opal_client.data.updater | INFO | Subscribing to topics: ['policy_data'] opal_client_1 | 2021-09-15T22:04:55.800088+0000 |opal_client.policy.updater | INFO | Subscribing to topics: ['policy:.'] opal_client_1 | 2021-09-15T22:04:55.800864+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal_server:7002/ws opal_client_1 | 2021-09-15T22:04:55.801738+0000 |fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal_server:7002/ws opal_client_1 | 2021-09-15T22:04:55.806567+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal_server:7002/ws opal_client_1 | 2021-09-15T22:04:55.807003+0000 |fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal_server:7002/ws opal_server_1 | 2021-09-15T22:04:55.813454+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Listening for incoming events from broadcast channel (first listener started) opal_server_1 | 2021-09-15T22:04:55.813861+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Spawning broadcast listen task opal_server_1 | 2021-09-15T22:04:55.826247+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Listening for incoming events from broadcast channel (first listener started) opal_server_1 | 2021-09-15T22:04:55.826448+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Spawning broadcast listen task opal_server_1 | 2021-09-15T22:04:55.844199+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Subscribing to ALL TOPICS, and sharing messages with broadcast channel opal_server_1 | 2021-09-15T22:04:55.845397+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '237e9a6f14fd469089fd27b18737ea1d', 'subscriber_id': '8f8599cae21c4efca117992fc300dc69', 'topic': '__EventNotifier_ALL_TOPICS__', 'callback': >, 'notifier_id': None} opal_server_1 | 2021-09-15T22:04:55.846054+0000 |fastapi_websocket_rpc.websocket_rpc_e...| INFO | Client connected opal_server_1 | 2021-09-15T22:04:55.846753+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Starting broadcaster listener opal_server_1 | 2021-09-15T22:04:55.857513+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Subscribing to ALL TOPICS, and sharing messages with broadcast channel opal_server_1 | 2021-09-15T22:04:55.858543+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': 'fa2fb262383745d1b565444380256a25', 'subscriber_id': 'cb9bd85216be466c86f7f7ec8abd1439', 'topic': '__EventNotifier_ALL_TOPICS__', 'callback': >, 'notifier_id': None} opal_server_1 | 2021-09-15T22:04:55.859363+0000 |fastapi_websocket_rpc.websocket_rpc_e...| INFO | Client connected opal_server_1 | 2021-09-15T22:04:55.860455+0000 |fastapi_websocket_pubsub.event_broadc...| INFO | Starting broadcaster listener opal_server_1 | 2021-09-15T22:04:55.879820+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '3dec923b30914808afb9b759cf1bdbc5', 'subscriber_id': 'dd2272819dc4426c97131ec874d982ee', 'topic': 'policy_data', 'callback': .callback at 0x7f45421a99d0>, 'notifier_id': None} opal_client_1 | 2021-09-15T22:04:55.885693+0000 |opal_client.data.updater | INFO | Connected to server opal_client_1 | 2021-09-15T22:04:55.886146+0000 |opal_client.data.updater | INFO | Performing data configuration, reason: Initial load opal_client_1 | 2021-09-15T22:04:55.886316+0000 |opal_client.data.updater | INFO | Getting data-sources configuration from 'http://opal_server:7002/data/config' opal_server_1 | 2021-09-15T22:04:55.897725+0000 |opal_server.data.api | INFO | Serving source configuration opal_server_1 | 2021-09-15T22:04:55.898839+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.20.0.4:46180 - "GET /data/config HTTP/1.1" 200 opal_server_1 | 2021-09-15T22:04:55.901180+0000 |fastapi_websocket_pubsub.event_notifier | INFO | New subscription {'id': '48acefdea9ba46378f09bf8d8d68bfef', 'subscriber_id': '93f75df216e944c1bb700ea3a6541b1a', 'topic': 'policy:.', 'callback': .callback at 0x7f45421a7af0>, 'notifier_id': None} opal_client_1 | 2021-09-15T22:04:55.903207+0000 |opal_client.data.updater | INFO | Triggering data update with id: 674b27e5015d4058b2db7ba51dd60680 opal_client_1 | 2021-09-15T22:04:55.903429+0000 |opal_client.data.updater | INFO | Fetching policy data opal_client_1 | 2021-09-15T22:04:55.903838+0000 |opal_client.data.fetcher | INFO | Fetching data from url: http://host.docker.internal:7002/policy-data opal_client_1 | 2021-09-15T22:04:55.906561+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal_server:7002/ws opal_client_1 | 2021-09-15T22:04:55.908756+0000 |opal_client.policy.updater | INFO | Connected to server opal_client_1 | 2021-09-15T22:04:55.909052+0000 |opal_client.policy.updater | INFO | Refetching policy code (full bundle) opal_server_1 | 2021-09-15T22:04:55.919853+0000 |opal_common.middleware |ERROR | Uncaught server exception: Reference at 'refs/heads/master' does not exist opal_server_1 | Traceback (most recent call last): opal_server_1 | opal_server_1 | File "/root/.local/bin/gunicorn", line 8, in opal_server_1 | sys.exit(run()) opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 67, in run opal_server_1 | WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run() opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 231, in run opal_server_1 | super().run() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 72, in run opal_server_1 | Arbiter(self).run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 202, in run opal_server_1 | self.manage_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 551, in manage_workers opal_server_1 | self.spawn_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers opal_server_1 | self.spawn_worker() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker opal_server_1 | worker.init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 64, in init_process opal_server_1 | super(UvicornWorker, self).init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/workers/base.py", line 142, in init_process opal_server_1 | self.run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 77, in run opal_server_1 | loop.run_until_complete(server.serve(sockets=self.sockets)) opal_server_1 | │ │ │ │ │ └ [] opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.1'}, 'http_version': '1.1', 'server': ('172.20.0.3', 7002), 'c... opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_client_1 | 2021-09-15T22:04:55.958798+0000 |opal_client.policy.fetcher |WARNING | Unexpected response code 500: {'error': 'Uncaught server exception'} opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | │ │ └ opal_server_1 | └ opal_server_1 | > File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | │ │ │ │ └ ._send at 0x7f45421a7f70> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ ._send at 0x7f45421a7f70> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | │ │ │ │ └ .sender at 0x7f45421d1040> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7f45421d1040> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7f45421d1040> opal_server_1 | │ │ │ └ .app at 0x7f454267be50> opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | │ └ opal_server_1 | └ .app at 0x7f454266da60> opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | │ └ {'repo': , 'paths': ['.']} opal_server_1 | └ opal_server_1 | opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | │ │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | │ │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | └ 'refs/heads/master' opal_server_1 | opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-15T22:04:55.956324+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.20.0.4:46182 - "GET /policy?path=. HTTP/1.1" 500 opal_server_1 | Exception in ASGI application opal_server_1 | Traceback (most recent call last): opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/applications.py", line 112, in __call__ opal_server_1 | await self.middleware_stack(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 181, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_client_1 | 2021-09-15T22:04:55.990890+0000 |opal_client.data.updater |ERROR | Failed to fetch url http://host.docker.internal:7002/policy-data, got response code 401 with error: {'detail': {'error': 'access token was not provided', 'token': None}} opal_server_1 | 2021-09-15T22:04:56.319101+0000 |opal_common.middleware |ERROR | Uncaught server exception: Reference at 'refs/heads/master' does not exist opal_server_1 | Traceback (most recent call last): opal_server_1 | opal_server_1 | File "/root/.local/bin/gunicorn", line 8, in opal_server_1 | sys.exit(run()) opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 67, in run opal_server_1 | WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run() opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 231, in run opal_server_1 | super().run() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/app/base.py", line 72, in run opal_server_1 | Arbiter(self).run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 202, in run opal_server_1 | self.manage_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 551, in manage_workers opal_server_1 | self.spawn_workers() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers opal_server_1 | self.spawn_worker() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker opal_server_1 | worker.init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 64, in init_process opal_server_1 | super(UvicornWorker, self).init_process() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/gunicorn/workers/base.py", line 142, in init_process opal_server_1 | self.run() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/workers.py", line 77, in run opal_server_1 | loop.run_until_complete(server.serve(sockets=self.sockets)) opal_server_1 | │ │ │ │ │ └ [] opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ {'type': 'http', 'asgi': {'version': '3.0', 'spec_version': '2.1'}, 'http_version': '1.1', 'server': ('172.20.0.3', 7002), 'c... opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | │ │ └ opal_server_1 | └ opal_server_1 | > File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | │ │ │ │ └ ._send at 0x7f45425109d0> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ ._send at 0x7f45425109d0> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | │ │ │ │ └ .sender at 0x7f4542510a60> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7f4542510a60> opal_server_1 | │ │ │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | │ │ │ │ └ .sender at 0x7f4542510a60> opal_server_1 | │ │ │ └ .app at 0x7f45426f6c10> opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_client_1 | 2021-09-15T22:04:56.345735+0000 |opal_client.policy.fetcher |WARNING | Unexpected response code 500: {'error': 'Uncaught server exception'} opal_server_1 | │ └ opal_server_1 | └ .app at 0x7f45426e18b0> opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | │ └ {'repo': , 'paths': ['.']} opal_server_1 | └ opal_server_1 | opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | │ │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ │ └ opal_server_1 | │ │ │ │ │ └ opal_server_1 | │ │ │ │ └ opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | │ │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ │ └ opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | │ │ │ └ 'refs/heads/master' opal_server_1 | │ │ └ opal_server_1 | │ └ opal_server_1 | └ opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | └ 'refs/heads/master' opal_server_1 | opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-15T22:04:56.342718+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.20.0.4:46214 - "GET /policy?path=. HTTP/1.1" 500 opal_server_1 | Exception in ASGI application opal_server_1 | Traceback (most recent call last): opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/protocols/http/httptools_impl.py", line 371, in run_asgi opal_server_1 | result = await app(self.scope, self.receive, self.send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 59, in __call__ opal_server_1 | return await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/applications.py", line 199, in __call__ opal_server_1 | await super().__call__(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/applications.py", line 112, in __call__ opal_server_1 | await self.middleware_stack(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 181, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/errors.py", line 159, in __call__ opal_server_1 | await self.app(scope, receive, _send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/middleware/cors.py", line 78, in __call__ opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 82, in __call__ opal_server_1 | raise exc from None opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/exceptions.py", line 71, in __call__ opal_server_1 | await self.app(scope, receive, sender) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 580, in __call__ opal_server_1 | await route.handle(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 241, in handle opal_server_1 | await self.app(scope, receive, send) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/starlette/routing.py", line 52, in app opal_server_1 | response = await func(request) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/routing.py", line 204, in app opal_server_1 | solved_result = await solve_dependencies( opal_server_1 | File "/root/.local/lib/python3.8/site-packages/fastapi/dependencies/utils.py", line 548, in solve_dependencies opal_server_1 | solved = await call(**sub_values) opal_server_1 | File "/opal_server/policy/bundles/api.py", line 43, in get_input_paths_or_throw opal_server_1 | with CommitViewer(repo.head.commit) as viewer: opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 197, in _get_commit opal_server_1 | obj = self._get_object() opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 190, in _get_object opal_server_1 | return Object.new_from_sha(self.repo, hex_to_bin(self.dereference_recursive(self.repo, self.path))) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 132, in dereference_recursive opal_server_1 | hexsha, ref_path = cls._get_ref_info(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 181, in _get_ref_info opal_server_1 | return cls._get_ref_info_helper(repo, ref_path) opal_server_1 | File "/root/.local/lib/python3.8/site-packages/git/refs/symbolic.py", line 164, in _get_ref_info_helper opal_server_1 | raise ValueError("Reference at %r does not exist" % ref_path) opal_server_1 | ValueError: Reference at 'refs/heads/master' does not exist opal_server_1 | 2021-09-15T22:04:56.738404+0000 |uvicorn.protocols.http.httptools_impl | INFO | 172.20.0.4:46218 - "GET /policy?path=. HTTP/1.1" 200 opal_client_1 | 2021-09-15T22:04:56.740514+0000 |opal_client.policy.updater | INFO | got policy bundle, commit hash: '6d849b1ce92bae05c31146470e66e07c3c41b164' opal_server_1 | 2021-09-15T22:04:56.798754+0000 |opal_common.git.repo_cloner | INFO | Clone succeeded opal_client_1 | 2021-09-15T22:04:56.799386+0000 |fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal_server:7002/ws opal_server_1 | 2021-09-15T22:04:56.807432+0000 |opal_common.git.repo_watcher | INFO | Launching polling task, interval: 30 seconds opal_server_1 | 2021-09-15T22:05:26.790094+0000 |opal_common.git.repo_watcher | INFO | Pulling changes from remote: 'origin' opal_server_1 | 2021-09-15T22:05:29.497925+0000 |opal_common.git.repo_watcher | INFO | No new commits: HEAD is at '6d849b1ce92bae05c31146470e66e07c3c41b164' ```

Yeah, need some help for debugging 😃

asafc commented 2 years ago

Sure, i am quite available tomorrow. How about we do a zoom call and debug together?

just book something through my calendly

hongbo-miao commented 2 years ago

Close for now as it is a little bit low priority. Will post back in future if find anything!

asafc commented 2 years ago

Hi @Hongbo-Miao :) Let's keep this open until we are sure we solved it.

What i think is happening is some race condition while opal server is still cloning the repo. i made a small fix in 0.1.14 that might fix this issue.

Can you please check if you get the same issue with 0.1.14?

asafc commented 2 years ago

Hey @Hongbo-Miao - i think this is fixed :) i am closing the issue for now. Feel free to reopen the issue if the error is happening again.