search

microsoft / fhir-server

A service that implements the FHIR standard
MIT License
1.2k stars 516 forks source link

Docker container does not run on Apple silicon #3648

Closed tigloo closed 6 months ago

tigloo commented 10 months ago

Describe the bug Trying to run the published docker container on an Apple M1 or M1 Max doesn't work. The server seems to start, then freezes. Latest when trying to access http://localhost:8080/metadata, CPU will go to 100%. The container stays in this state. Trying to restart it will throw an exception about corrupted data and invalid memory access. Deleting the container and recreating it will repeat the pattern: on first start it freezes, on subsequent restarts it will print a corrupted data exception.

FHIR Version? R4B

Data provider? SQL Server

To Reproduce

Use the docker-compose.yaml from the samples directory and run docker-compose up. The file is pasted in full below - the only change is pulling the FHIR server's container from Microsoft's container registry instead of building it directly (which doesn't work on Apple Silicon as well).

version: "3"
services:
  fhir-api:
    image: "mcr.microsoft.com/healthcareapis/r4b-fhir-server:latest"
    restart: on-failure
    environment:
      FHIRServer__Security__Enabled: "false"
      SqlServer__ConnectionString: "Server=tcp:sql,1433;Initial Catalog=FHIR;Persist Security Info=False;User ID=sa;Password=${SAPASSWORD};MultipleActiveResultSets=False;Connection Timeout=30;TrustServerCertificate=true;"
      SqlServer__AllowDatabaseCreation: "true"
      SqlServer__Initialize: "true"
      SqlServer__SchemaOptions__AutomaticUpdatesEnabled: "true"
      DataStore: "SqlServer"
    ports:     
      - "8080:8080"
    depends_on:
      - sql
  sql:
    image: "mcr.microsoft.com/mssql/server"
    environment:
      SA_PASSWORD: ${SAPASSWORD}
      ACCEPT_EULA: "Y"
    ports:
      - "1433:1433"
    healthcheck:
        test: ["CMD", "/opt/mssql-tools/bin/sqlcmd","-U sa -P ${SAPASSWORD} -Q 'SELECT * FROM INFORMATION_SCHEMA.TABLES'"]
        interval: 10s
        timeout: 10s
        retries: 6

I tried running the file above on an x86 Ubuntu VM and confirmed that it works just fine there. Server starts without issues.

Expected behavior The server starts normally and can be accessed at http://localhost:8080/metadata.

Actual behavior The server freezes on first attempt, eventually going to 100% CPU and staying in that state. On subsequent restarts, it immediately exits with a corrupted data exception.

AB#119536

mikaelweave commented 10 months ago

Hi @tigloo, we don't have any Apple Silicon devices on the team (I'm still rocking the last gen intel i9) so this will be a difficult issue for us.

I've done research on this in the past however. Usually it's been the SQL container that causes issues not the .NET container. Can you ensure that you have "Rosetta for x86/amd64 emulation" enabled in your Docker configuration?

tigloo commented 10 months ago

Thanks for the quick response! Rosetta is turned on in Docker. The SQL container seems to run fine, at least it prints the same log lines as on an Ubuntu x86 VM where everything works.

If there's anything I can do to troubleshoot, let me know. I cannot build the docker container on my system either - I'm not familiar with .NET at all so I don't know if it is something trivial or not. If I could at least build it, I would probably be able to pinpoint the area where it gets stuck in the debugger.

mikaelweave commented 10 months ago

Interesting, first time I've seen this. I think it could be due to our recent switch from alpine to mariner as our base container. In your compose file, can you change the tag of the FHIR container like below and try again?

mcr.microsoft.com/healthcareapis/r4b-fhir-server:3.4.303

tigloo commented 10 months ago

I'm pasting the logs for latest and 3.4.303 below. 3.4.303 seems to crash differently.

Log for latest:

➜  test git:(main) ✗ SAPASSWORD=SomeThingVeryComplex957385 docker-compose up
[+] Running 14/14
 ✔ fhir-api 13 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                   15.0s 
   ✔ b18c8828a59a Pull complete                                                                                                                                                 9.0s 
   ✔ 2de4b3128c17 Pull complete                                                                                                                                                 0.4s 
   ✔ 63dd77bab908 Pull complete                                                                                                                                                 4.1s 
   ✔ b6c40448c337 Pull complete                                                                                                                                                 7.6s 
   ✔ dee0ec1f7bd9 Pull complete                                                                                                                                                 4.7s 
   ✔ b79d46ea37bc Pull complete                                                                                                                                                 7.1s 
   ✔ 59f85be18ddb Pull complete                                                                                                                                                 8.8s 
   ✔ 3a1776eb7f97 Pull complete                                                                                                                                                 8.3s 
   ✔ a5b54fbc5d8b Pull complete                                                                                                                                                 9.0s 
   ✔ bbb05a50fdd5 Pull complete                                                                                                                                                 9.1s 
   ✔ 6489e3dc4047 Pull complete                                                                                                                                                 9.3s 
   ✔ a95c7e591351 Pull complete                                                                                                                                                13.4s 
   ✔ 44855c86c0b0 Pull complete                                                                                                                                                 9.5s 
[+] Running 5/2
 ✔ Network test_default                                                                                                                                    Created              0.0s 
 ✔ Container test-sql-1                                                                                                                                    Created              0.4s 
 ! sql The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                           0.0s 
 ✔ Container test-fhir-api-1                                                                                                                               Created              0.0s 
 ! fhir-api The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                      0.0s 
Attaching to fhir-api-1, sql-1
sql-1       | SQL Server 2022 will run as non-root by default.
sql-1       | This container is running as user mssql.
sql-1       | To learn more visit https://go.microsoft.com/fwlink/?linkid=2099216.
fhir-api-1  | warn: Microsoft.AspNetCore.DataProtection.Repositories.EphemeralXmlRepository[50]
fhir-api-1  |       Using an in-memory repository. Keys will not be persisted to storage.
fhir-api-1  | warn: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[59]
fhir-api-1  |       Neither user profile nor HKLM registry available. Using an ephemeral key repository. Protected data will be unavailable when application exits.
fhir-api-1  | warn: Microsoft.AspNetCore.DataProtection.KeyManagement.XmlKeyManager[35]
fhir-api-1  |       No XML encryptor configured. Key {c9c3983c-b1e1-41e7-b715-82c3f6672158} may be persisted to storage in unencrypted form.
sql-1       | 2023-12-24 08:11:47.03 Server      Setup step is copying system data file 'C:\templatedata\master.mdf' to '/var/opt/mssql/data/master.mdf'.
2023-12-24 08:11:47.07 Server      Did not find an existing master data file /var/opt/mssql/data/master.mdf, copying the missing default master and other system database files. If you have moved the database location, but not moved the database files, startup may fail. To repair: shutdown SQL Server, move the master database to configured location, and restart.
2023-12-24 08:11:47.07 Server      Setup step is copying system data file 'C:\templatedata\mastlog.ldf' to '/var/opt/mssql/data/mastlog.ldf'.
2023-12-24 08:11:47.08 Server      Setup step is copying system data file 'C:\templatedata\model.mdf' to '/var/opt/mssql/data/model.mdf'.
2023-12-24 08:11:47.08 Server      Setup step is copying system data file 'C:\templatedata\modellog.ldf' to '/var/opt/mssql/data/modellog.ldf'.
2023-12-24 08:11:47.09 Server      Setup step is copying system data file 'C:\templatedata\msdbdata.mdf' to '/var/opt/mssql/data/msdbdata.mdf'.
2023-12-24 08:11:47.11 Server      Setup step is copying system data file 'C:\templatedata\msdblog.ldf' to '/var/opt/mssql/data/msdblog.ldf'.
2023-12-24 08:11:47.11 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_replicatedmaster.mdf' to '/var/opt/mssql/data/model_replicatedmaster.mdf'.
2023-12-24 08:11:47.12 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_replicatedmaster.ldf' to '/var/opt/mssql/data/model_replicatedmaster.ldf'.
2023-12-24 08:11:47.12 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_msdbdata.mdf' to '/var/opt/mssql/data/model_msdbdata.mdf'.
2023-12-24 08:11:47.14 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_msdblog.ldf' to '/var/opt/mssql/data/model_msdblog.ldf'.
2023-12-24 08:11:47.16 Server      Microsoft SQL Server 2022 (RTM-CU10) (KB5031778) - 16.0.4095.4 (X64) 
sql-1   Oct 30 2023 16:12:44 
sql-1   Copyright (C) 2022 Microsoft Corporation
sql-1   Developer Edition (64-bit) on Linux (Ubuntu 22.04.3 LTS) <X64>
2023-12-24 08:11:47.17 Server      UTC adjustment: 0:00
2023-12-24 08:11:47.17 Server      (c) Microsoft Corporation.
2023-12-24 08:11:47.17 Server      All rights reserved.
2023-12-24 08:11:47.17 Server      Server process ID is 472.
2023-12-24 08:11:47.17 Server      Logging SQL Server messages in file '/var/opt/mssql/log/errorlog'.
2023-12-24 08:11:47.17 Server      Registry startup parameters: 
sql-1    -d /var/opt/mssql/data/master.mdf
sql-1    -l /var/opt/mssql/data/mastlog.ldf
sql-1    -e /var/opt/mssql/log/errorlog
2023-12-24 08:11:47.18 Server      SQL Server detected 1 sockets with 8 cores per socket and 8 logical processors per socket, 8 total logical processors; using 8 logical processors based on SQL Server licensing. This is an informational message; no user action is required.
2023-12-24 08:11:47.18 Server      SQL Server is starting at normal priority base (=7). This is an informational message only. No user action is required.
2023-12-24 08:11:47.18 Server      Detected 6277 MB of RAM. This is an informational message; no user action is required.
2023-12-24 08:11:47.18 Server      Using conventional memory in the memory manager.
2023-12-24 08:11:47.18 Server      Detected pause instruction latency: 0 cycles.
2023-12-24 08:11:47.19 Server      Page exclusion bitmap is enabled.
2023-12-24 08:11:47.23 Server      Buffer pool extension is not supported on Linux platform.
2023-12-24 08:11:47.23 Server      Buffer Pool: Allocating 1048576 bytes for 912148 hashPages.
2023-12-24 08:11:47.37 Server      Buffer pool extension is already disabled. No action is necessary.
2023-12-24 08:11:47.80 Server      Installing Client TLS certificates to the store.
2023-12-24 08:11:47.81 Server      Error searching first file in /var/opt/mssql/security/ca-certificates: 3(The system cannot find the path specified.)
2023-12-24 08:11:47.81 Server      CPU vectorization level(s) detected:  SSE SSE2 SSE3 SSSE3 SSE41 SSE42 POPCNT
2023-12-24 08:11:47.87 Server      Successfully initialized the TLS configuration. Allowed TLS protocol versions are ['1.0 1.1 1.2']. Allowed TLS ciphers are ['ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA:AES256-GCM-SHA384:AES128-GCM-SHA256:AES256-SHA256:AES128-SHA256:AES256-SHA:AES128-SHA:!DHE-RSA-AES256-GCM-SHA384:!DHE-RSA-AES128-GCM-SHA256:!DHE-RSA-AES256-SHA:!DHE-RSA-AES128-SHA'].
2023-12-24 08:11:47.92 Server      Query Store settings initialized with enabled = 1, 
SetThreadAffinity failed: 87
2023-12-24 08:11:47.95 Server      The maximum number of dedicated administrator connections for this instance is '1'
2023-12-24 08:11:47.95 Server      Node configuration: node 0: CPU mask: 0x00000000000000ff:0 Active CPU mask: 0x00000000000000ff:0. This message provides a description of the NUMA configuration for this computer. This is an informational message only. No user action is required.
2023-12-24 08:11:47.96 Server      Using dynamic lock allocation.  Initial allocation of 2500 Lock blocks and 5000 Lock Owner blocks per node.  This is an informational message only.  No user action is required.
2023-12-24 08:11:48.05 Server      In-Memory OLTP initialized on lowend machine.
2023-12-24 08:11:48.09 Server      CLR version v4.0.30319 loaded.
2023-12-24 08:11:48.15 Server      [INFO] Created Extended Events session 'hkenginexesession'
2023-12-24 08:11:48.16 Server      Database Instant File Initialization: enabled. For security and performance considerations see the topic 'Database Instant File Initialization' in SQL Server Books Online. This is an informational message only. No user action is required.
ForceFlush is enabled for this instance. 
2023-12-24 08:11:48.17 Server      Total Log Writer threads: 2. This is an informational message; no user action is required.
2023-12-24 08:11:48.18 Server      Software Usage Metrics is disabled.
2023-12-24 08:11:48.21 spid26s     [1]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:48.22 spid26s     Starting up database 'master'.
ForceFlush feature is enabled for log durability.
2023-12-24 08:11:48.38 spid26s     The tail of the log for database master is being rewritten to match the new sector size of 4096 bytes.  1024 bytes at offset 396288 in file /var/opt/mssql/data/mastlog.ldf will be written.
2023-12-24 08:11:48.58 spid26s     Converting database 'master' from version 927 to the current version 957.
2023-12-24 08:11:48.58 spid26s     Database 'master' running the upgrade step from version 927 to version 928.
2023-12-24 08:11:48.74 spid26s     Database 'master' running the upgrade step from version 928 to version 929.
2023-12-24 08:11:48.78 spid26s     Database 'master' running the upgrade step from version 929 to version 930.
2023-12-24 08:11:48.79 spid26s     Database 'master' running the upgrade step from version 930 to version 931.
2023-12-24 08:11:48.79 spid26s     Database 'master' running the upgrade step from version 931 to version 932.
2023-12-24 08:11:48.80 spid26s     Database 'master' running the upgrade step from version 932 to version 933.
2023-12-24 08:11:48.80 spid26s     Database 'master' running the upgrade step from version 933 to version 934.
2023-12-24 08:11:48.81 spid26s     Database 'master' running the upgrade step from version 934 to version 935.
2023-12-24 08:11:48.83 spid26s     Database 'master' running the upgrade step from version 935 to version 936.
2023-12-24 08:11:48.83 spid26s     Database 'master' running the upgrade step from version 936 to version 937.
2023-12-24 08:11:48.84 spid26s     Database 'master' running the upgrade step from version 937 to version 938.
2023-12-24 08:11:48.84 spid26s     Database 'master' running the upgrade step from version 938 to version 939.
2023-12-24 08:11:48.85 spid26s     Database 'master' running the upgrade step from version 939 to version 940.
2023-12-24 08:11:48.85 spid26s     Database 'master' running the upgrade step from version 940 to version 941.
2023-12-24 08:11:48.86 spid26s     Database 'master' running the upgrade step from version 941 to version 942.
2023-12-24 08:11:48.86 spid26s     Database 'master' running the upgrade step from version 942 to version 943.
2023-12-24 08:11:48.88 Server      External governance manager initialized
2023-12-24 08:11:48.90 spid26s     Database 'master' running the upgrade step from version 943 to version 944.
2023-12-24 08:11:48.90 spid26s     Database 'master' running the upgrade step from version 944 to version 945.
2023-12-24 08:11:48.92 spid26s     Database 'master' running the upgrade step from version 945 to version 946.
2023-12-24 08:11:48.93 spid26s     Database 'master' running the upgrade step from version 946 to version 947.
2023-12-24 08:11:48.93 spid26s     Database 'master' running the upgrade step from version 947 to version 948.
2023-12-24 08:11:48.94 spid26s     Database 'master' running the upgrade step from version 948 to version 949.
2023-12-24 08:11:48.95 spid26s     Database 'master' running the upgrade step from version 949 to version 950.
2023-12-24 08:11:48.95 spid26s     Database 'master' running the upgrade step from version 950 to version 951.
2023-12-24 08:11:48.96 spid26s     Database 'master' running the upgrade step from version 951 to version 952.
2023-12-24 08:11:48.97 spid26s     Database 'master' running the upgrade step from version 952 to version 953.
2023-12-24 08:11:48.97 spid26s     Database 'master' running the upgrade step from version 953 to version 954.
2023-12-24 08:11:48.98 spid26s     Database 'master' running the upgrade step from version 954 to version 955.
2023-12-24 08:11:48.98 spid26s     Database 'master' running the upgrade step from version 955 to version 956.
2023-12-24 08:11:49.01 spid26s     Database 'master' running the upgrade step from version 956 to version 957.
2023-12-24 08:11:49.12 spid28s     [32767]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.13 spid28s     Starting up database 'mssqlsystemresource'.
2023-12-24 08:11:49.14 spid28s     The resource database build version is 16.00.4095. This is an informational message only. No user action is required.
2023-12-24 08:11:49.15 spid37s     Password policy update was successful.
2023-12-24 08:11:49.17 spid28s     [3]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.17 spid28s     Starting up database 'model'.
2023-12-24 08:11:49.18 spid26s     [32762]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.18 spid26s     Starting up database 'model_replicatedmaster'.
2023-12-24 08:11:49.19 spid28s     The tail of the log for database model is being rewritten to match the new sector size of 4096 bytes.  2048 bytes at offset 75776 in file /var/opt/mssql/data/modellog.ldf will be written.
2023-12-24 08:11:49.20 spid26s     The tail of the log for database model_replicatedmaster is being rewritten to match the new sector size of 4096 bytes.  2560 bytes at offset 99840 in file /var/opt/mssql/data/model_replicatedmaster.ldf will be written.
2023-12-24 08:11:49.21 spid28s     Converting database 'model' from version 927 to the current version 957.
2023-12-24 08:11:49.21 spid28s     Database 'model' running the upgrade step from version 927 to version 928.
2023-12-24 08:11:49.21 spid28s     Database 'model' running the upgrade step from version 928 to version 929.
2023-12-24 08:11:49.23 spid26s     Converting database 'model_replicatedmaster' from version 927 to the current version 957.
2023-12-24 08:11:49.23 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 927 to version 928.
2023-12-24 08:11:49.23 spid28s     Database 'model' running the upgrade step from version 929 to version 930.
2023-12-24 08:11:49.24 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 928 to version 929.
2023-12-24 08:11:49.24 spid28s     Database 'model' running the upgrade step from version 930 to version 931.
2023-12-24 08:11:49.25 spid28s     Database 'model' running the upgrade step from version 931 to version 932.
2023-12-24 08:11:49.25 spid28s     Database 'model' running the upgrade step from version 932 to version 933.
2023-12-24 08:11:49.26 spid28s     Database 'model' running the upgrade step from version 933 to version 934.
2023-12-24 08:11:49.26 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 929 to version 930.
2023-12-24 08:11:49.26 spid28s     Database 'model' running the upgrade step from version 934 to version 935.
2023-12-24 08:11:49.27 spid28s     Database 'model' running the upgrade step from version 935 to version 936.
2023-12-24 08:11:49.27 Server      Common language runtime (CLR) functionality initialized.
2023-12-24 08:11:49.27 spid28s     Database 'model' running the upgrade step from version 936 to version 937.
2023-12-24 08:11:49.27 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 930 to version 931.
2023-12-24 08:11:49.28 spid28s     Database 'model' running the upgrade step from version 937 to version 938.
2023-12-24 08:11:49.28 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 931 to version 932.
2023-12-24 08:11:49.28 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 932 to version 933.
2023-12-24 08:11:49.28 spid28s     Database 'model' running the upgrade step from version 938 to version 939.
2023-12-24 08:11:49.29 spid28s     Database 'model' running the upgrade step from version 939 to version 940.
2023-12-24 08:11:49.29 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 933 to version 934.
2023-12-24 08:11:49.29 spid28s     Database 'model' running the upgrade step from version 940 to version 941.
2023-12-24 08:11:49.29 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 934 to version 935.
2023-12-24 08:11:49.30 spid28s     Database 'model' running the upgrade step from version 941 to version 942.
2023-12-24 08:11:49.30 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 935 to version 936.
2023-12-24 08:11:49.30 spid28s     Database 'model' running the upgrade step from version 942 to version 943.
2023-12-24 08:11:49.30 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 936 to version 937.
2023-12-24 08:11:49.31 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 937 to version 938.
2023-12-24 08:11:49.31 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 938 to version 939.
2023-12-24 08:11:49.32 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 939 to version 940.
2023-12-24 08:11:49.32 spid28s     Database 'model' running the upgrade step from version 943 to version 944.
2023-12-24 08:11:49.32 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 940 to version 941.
2023-12-24 08:11:49.32 spid28s     Database 'model' running the upgrade step from version 944 to version 945.
2023-12-24 08:11:49.32 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 941 to version 942.
2023-12-24 08:11:49.33 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 942 to version 943.
2023-12-24 08:11:49.33 spid28s     Database 'model' running the upgrade step from version 945 to version 946.
2023-12-24 08:11:49.34 spid28s     Database 'model' running the upgrade step from version 946 to version 947.
2023-12-24 08:11:49.34 spid28s     Database 'model' running the upgrade step from version 947 to version 948.
2023-12-24 08:11:49.35 spid28s     Database 'model' running the upgrade step from version 948 to version 949.
2023-12-24 08:11:49.35 spid28s     Database 'model' running the upgrade step from version 949 to version 950.
2023-12-24 08:11:49.35 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 943 to version 944.
2023-12-24 08:11:49.36 spid28s     Database 'model' running the upgrade step from version 950 to version 951.
2023-12-24 08:11:49.36 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 944 to version 945.
2023-12-24 08:11:49.37 spid28s     Database 'model' running the upgrade step from version 951 to version 952.
2023-12-24 08:11:49.37 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 945 to version 946.
2023-12-24 08:11:49.37 spid28s     Database 'model' running the upgrade step from version 952 to version 953.
2023-12-24 08:11:49.37 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 946 to version 947.
2023-12-24 08:11:49.38 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 947 to version 948.
2023-12-24 08:11:49.38 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 948 to version 949.
2023-12-24 08:11:49.38 spid28s     Database 'model' running the upgrade step from version 953 to version 954.
2023-12-24 08:11:49.39 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 949 to version 950.
2023-12-24 08:11:49.39 spid28s     Database 'model' running the upgrade step from version 954 to version 955.
2023-12-24 08:11:49.39 spid28s     Database 'model' running the upgrade step from version 955 to version 956.
2023-12-24 08:11:49.39 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 950 to version 951.
2023-12-24 08:11:49.40 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 951 to version 952.
2023-12-24 08:11:49.40 spid28s     Database 'model' running the upgrade step from version 956 to version 957.
2023-12-24 08:11:49.40 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 952 to version 953.
2023-12-24 08:11:49.41 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 953 to version 954.
2023-12-24 08:11:49.42 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 954 to version 955.
2023-12-24 08:11:49.42 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 955 to version 956.
2023-12-24 08:11:49.44 spid26s     Database 'model_replicatedmaster' running the upgrade step from version 956 to version 957.
2023-12-24 08:11:49.47 spid26s     [32761]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.47 spid26s     Starting up database 'model_msdb'.
2023-12-24 08:11:49.50 spid26s     Converting database 'model_msdb' from version 927 to the current version 957.
2023-12-24 08:11:49.50 spid26s     Database 'model_msdb' running the upgrade step from version 927 to version 928.
2023-12-24 08:11:49.51 spid26s     Database 'model_msdb' running the upgrade step from version 928 to version 929.
2023-12-24 08:11:49.52 spid26s     Database 'model_msdb' running the upgrade step from version 929 to version 930.
2023-12-24 08:11:49.53 spid26s     Database 'model_msdb' running the upgrade step from version 930 to version 931.
2023-12-24 08:11:49.53 spid26s     Database 'model_msdb' running the upgrade step from version 931 to version 932.
2023-12-24 08:11:49.54 spid26s     Database 'model_msdb' running the upgrade step from version 932 to version 933.
2023-12-24 08:11:49.55 spid26s     Database 'model_msdb' running the upgrade step from version 933 to version 934.
2023-12-24 08:11:49.55 spid26s     Database 'model_msdb' running the upgrade step from version 934 to version 935.
2023-12-24 08:11:49.55 spid26s     Database 'model_msdb' running the upgrade step from version 935 to version 936.
2023-12-24 08:11:49.56 spid26s     Database 'model_msdb' running the upgrade step from version 936 to version 937.
2023-12-24 08:11:49.56 spid26s     Database 'model_msdb' running the upgrade step from version 937 to version 938.
2023-12-24 08:11:49.56 spid26s     Database 'model_msdb' running the upgrade step from version 938 to version 939.
2023-12-24 08:11:49.57 spid26s     Database 'model_msdb' running the upgrade step from version 939 to version 940.
2023-12-24 08:11:49.57 spid26s     Database 'model_msdb' running the upgrade step from version 940 to version 941.
2023-12-24 08:11:49.57 spid26s     Database 'model_msdb' running the upgrade step from version 941 to version 942.
2023-12-24 08:11:49.58 spid26s     Database 'model_msdb' running the upgrade step from version 942 to version 943.
2023-12-24 08:11:49.60 spid26s     Database 'model_msdb' running the upgrade step from version 943 to version 944.
2023-12-24 08:11:49.60 spid26s     Database 'model_msdb' running the upgrade step from version 944 to version 945.
2023-12-24 08:11:49.61 spid26s     Database 'model_msdb' running the upgrade step from version 945 to version 946.
2023-12-24 08:11:49.62 spid26s     Database 'model_msdb' running the upgrade step from version 946 to version 947.
2023-12-24 08:11:49.62 spid26s     Database 'model_msdb' running the upgrade step from version 947 to version 948.
2023-12-24 08:11:49.63 spid26s     Database 'model_msdb' running the upgrade step from version 948 to version 949.
2023-12-24 08:11:49.63 spid26s     Database 'model_msdb' running the upgrade step from version 949 to version 950.
2023-12-24 08:11:49.63 spid26s     Database 'model_msdb' running the upgrade step from version 950 to version 951.
2023-12-24 08:11:49.64 spid26s     Database 'model_msdb' running the upgrade step from version 951 to version 952.
2023-12-24 08:11:49.65 spid26s     Database 'model_msdb' running the upgrade step from version 952 to version 953.
2023-12-24 08:11:49.65 spid26s     Database 'model_msdb' running the upgrade step from version 953 to version 954.
2023-12-24 08:11:49.66 spid26s     Database 'model_msdb' running the upgrade step from version 954 to version 955.
2023-12-24 08:11:49.66 spid26s     Database 'model_msdb' running the upgrade step from version 955 to version 956.
2023-12-24 08:11:49.67 spid26s     Database 'model_msdb' running the upgrade step from version 956 to version 957.
2023-12-24 08:11:49.70 spid40s     Attribute synchronization initialized
2023-12-24 08:11:49.71 spid26s     Resource governor reconfiguration succeeded.
2023-12-24 08:11:49.71 spid40s     Attribute synchronization manager initialized
2023-12-24 08:11:49.71 spid26s     SQL Server Audit is starting the audits. This is an informational message. No user action is required.
2023-12-24 08:11:49.71 spid26s     SQL Server Audit has started the audits. This is an informational message. No user action is required.
2023-12-24 08:11:49.71 spid26s     XE session 'system_health' started.
2023-12-24 08:11:49.73 spid26s     SQL Trace ID 1 was started by login "sa".
2023-12-24 08:11:49.74 spid26s     Server name is '8131a33dc30b'. This is an informational message only. No user action is required.
2023-12-24 08:11:49.76 spid28s     Clearing tempdb database.
2023-12-24 08:11:49.76 spid46s     Always On: The availability replica manager is starting. This is an informational message only. No user action is required.
2023-12-24 08:11:49.76 spid47s     [4]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.77 spid47s     Starting up database 'msdb'.
2023-12-24 08:11:49.77 spid46s     Always On: The availability replica manager is waiting for the instance of SQL Server to allow client connections. This is an informational message only. No user action is required.
2023-12-24 08:11:49.81 spid47s     Converting database 'msdb' from version 927 to the current version 957.
2023-12-24 08:11:49.81 spid47s     Database 'msdb' running the upgrade step from version 927 to version 928.
2023-12-24 08:11:49.82 spid47s     Database 'msdb' running the upgrade step from version 928 to version 929.
2023-12-24 08:11:49.83 spid28s     [2]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:11:49.83 spid28s     Starting up database 'tempdb'.
2023-12-24 08:11:49.84 spid47s     Database 'msdb' running the upgrade step from version 929 to version 930.
2023-12-24 08:11:49.85 spid47s     Database 'msdb' running the upgrade step from version 930 to version 931.
2023-12-24 08:11:49.85 spid47s     Database 'msdb' running the upgrade step from version 931 to version 932.
2023-12-24 08:11:49.86 spid47s     Database 'msdb' running the upgrade step from version 932 to version 933.
2023-12-24 08:11:49.86 spid28s     The tempdb database has 1 data file(s).
2023-12-24 08:11:49.87 spid48s     The Service Broker endpoint is in disabled or stopped state.
2023-12-24 08:11:49.87 spid48s     The Database Mirroring endpoint is in disabled or stopped state.
2023-12-24 08:11:49.87 spid47s     Database 'msdb' running the upgrade step from version 933 to version 934.
2023-12-24 08:11:49.88 spid47s     Database 'msdb' running the upgrade step from version 934 to version 935.
2023-12-24 08:11:49.88 spid48s     Service Broker manager has started.
2023-12-24 08:11:49.88 spid47s     Database 'msdb' running the upgrade step from version 935 to version 936.
2023-12-24 08:11:49.89 spid47s     Database 'msdb' running the upgrade step from version 936 to version 937.
2023-12-24 08:11:49.89 spid47s     Database 'msdb' running the upgrade step from version 937 to version 938.
2023-12-24 08:11:49.89 spid47s     Database 'msdb' running the upgrade step from version 938 to version 939.
2023-12-24 08:11:49.90 spid47s     Database 'msdb' running the upgrade step from version 939 to version 940.
2023-12-24 08:11:49.90 spid47s     Database 'msdb' running the upgrade step from version 940 to version 941.
2023-12-24 08:11:49.91 spid47s     Database 'msdb' running the upgrade step from version 941 to version 942.
2023-12-24 08:11:49.91 spid47s     Database 'msdb' running the upgrade step from version 942 to version 943.
2023-12-24 08:11:49.93 spid47s     Database 'msdb' running the upgrade step from version 943 to version 944.
2023-12-24 08:11:49.93 spid47s     Database 'msdb' running the upgrade step from version 944 to version 945.
2023-12-24 08:11:49.94 spid47s     Database 'msdb' running the upgrade step from version 945 to version 946.
2023-12-24 08:11:49.94 spid47s     Database 'msdb' running the upgrade step from version 946 to version 947.
2023-12-24 08:11:49.95 spid47s     Database 'msdb' running the upgrade step from version 947 to version 948.
2023-12-24 08:11:49.95 spid47s     Database 'msdb' running the upgrade step from version 948 to version 949.
2023-12-24 08:11:49.96 spid47s     Database 'msdb' running the upgrade step from version 949 to version 950.
2023-12-24 08:11:49.96 spid47s     Database 'msdb' running the upgrade step from version 950 to version 951.
2023-12-24 08:11:49.97 spid47s     Database 'msdb' running the upgrade step from version 951 to version 952.
2023-12-24 08:11:49.98 spid47s     Database 'msdb' running the upgrade step from version 952 to version 953.
2023-12-24 08:11:49.98 spid47s     Database 'msdb' running the upgrade step from version 953 to version 954.
2023-12-24 08:11:49.99 spid47s     Database 'msdb' running the upgrade step from version 954 to version 955.
2023-12-24 08:11:49.99 spid47s     Database 'msdb' running the upgrade step from version 955 to version 956.
2023-12-24 08:11:50.01 spid47s     Database 'msdb' running the upgrade step from version 956 to version 957.
2023-12-24 08:11:50.13 spid37s     A self-generated certificate was successfully loaded for encryption.
2023-12-24 08:11:50.13 spid37s     Server is listening on [ 'any' <ipv6> 1433] accept sockets 1.
2023-12-24 08:11:50.13 spid37s     Server is listening on [ 'any' <ipv4> 1433] accept sockets 1.
2023-12-24 08:11:50.14 Server      Server is listening on [ ::1 <ipv6> 1434] accept sockets 1.
2023-12-24 08:11:50.14 Server      Server is listening on [ 127.0.0.1 <ipv4> 1434] accept sockets 1.
2023-12-24 08:11:50.14 Server      Dedicated admin connection support was established for listening locally on port 1434.
2023-12-24 08:11:50.14 spid37s     Server is listening on [ ::1 <ipv6> 1431] accept sockets 1.
2023-12-24 08:11:50.14 spid37s     Server is listening on [ 127.0.0.1 <ipv4> 1431] accept sockets 1.
2023-12-24 08:11:50.15 spid37s     Recovery is complete. This is an informational message only. No user action is required.
2023-12-24 08:11:50.15 spid37s     SQL Server is now ready for client connections. This is an informational message; no user action is required.
2023-12-24 08:11:50.60 spid35s     The default language (LCID 0) has been set for engine and full-text services.
2023-12-24 08:11:50.77 spid35s     The tempdb database has 8 data file(s).
2023-12-24 08:16:50.59 spid76      XE session 'telemetry_xevents' started.

Logs for 3.4.303

➜  test git:(main) ✗ SAPASSWORD=SomeThingVeryComplex957385 docker-compose up
[+] Running 13/13
 ✔ sql 3 layers [⣿⣿⣿]      0B/0B      Pulled                                                                                                                                   60.2s 
   ✔ 25fa6962a0ca Pull complete                                                                                                                                                 6.8s 
   ✔ 0083be717a79 Pull complete                                                                                                                                                52.8s 
   ✔ 37a64be4aeab Pull complete                                                                                                                                                15.1s 
 ✔ fhir-api 8 layers [⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                         24.0s 
   ✔ 7264a8db6415 Pull complete                                                                                                                                                 7.8s 
   ✔ ce5d3d660e59 Pull complete                                                                                                                                                 9.1s 
   ✔ 45cf031eabf1 Pull complete                                                                                                                                                14.4s 
   ✔ 241156c56da8 Pull complete                                                                                                                                                15.8s 
   ✔ 60ac2c5509c9 Pull complete                                                                                                                                                16.7s 
   ✔ 869e827c6692 Pull complete                                                                                                                                                16.4s 
   ✔ e942090779c8 Pull complete                                                                                                                                                22.7s 
   ✔ a793a98edb75 Pull complete                                                                                                                                                17.1s 
[+] Running 5/4
 ✔ Network test_default                                                                                                                                    Created              0.0s 
 ✔ Container test-sql-1                                                                                                                                    Created              0.7s 
 ! sql The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                           0.0s 
 ✔ Container test-fhir-api-1                                                                                                                               Created              0.1s 
 ! fhir-api The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested                      0.0s 
Attaching to fhir-api-1, sql-1
sql-1       | SQL Server 2022 will run as non-root by default.
sql-1       | This container is running as user mssql.
sql-1       | To learn more visit https://go.microsoft.com/fwlink/?linkid=2099216.
fhir-api-1  | Application startup exception: Hl7.Fhir.ElementModel.StructuralTypeException: Type checking the data: Element 'resource' should contain a resource, but does not actually contain one (at Bundle.entry[912].resource[0])
fhir-api-1  |    at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |    at Hl7.Fhir.ElementModel.ScopedNode.<.ctor>b__3_0(Object o, ExceptionNotification a)
fhir-api-1  |    at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.raiseTypeError(String message, Object source, Boolean warning, String location)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.deriveInstanceType(ISourceNode current, IElementDefinitionSummary info)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.enumerateElements(Dictionary`2 dis, ISourceNode parent, String name)+MoveNext()
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.runAdditionalRules(IEnumerable`1 children)+MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.SelectEnumerableIterator`2.MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.SelectManySingleSelectorIterator`2.MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
fhir-api-1  |    at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable`1 source)
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.<>c__DisplayClass1_0.<.ctor>b__0() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 22
fhir-api-1  |    at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
fhir-api-1  |    at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
fhir-api-1  |    at System.Lazy`1.CreateValue()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.get_Resource() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 27
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager.<>c.<.ctor>b__5_0(BundleEntryWrapper e) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 64
fhir-api-1  |    at System.Linq.Enumerable.SelectArrayIterator`2.ToList()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager..ctor(IModelInfoProvider modelInfoProvider, IMediator mediator, Func`1 searchServiceFactory, ILogger`1 logger) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 63
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |    at System.Reflection.ConstructorInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |    at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(IEnumerableCallSite enumerableCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitDisposeCache(ServiceCallSite transientCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.MvcApplicationBuilderExtensions.UseMvc(IApplicationBuilder app, Action`1 configureRoutes)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.FhirServerApplicationBuilderExtensions.UseFhirServer(IApplicationBuilder app, Func`2 predicate) in /repo/src/Microsoft.Health.Fhir.Api/Registration/FhirServerApplicationBuilderExtensions.cs:line 43
fhir-api-1  |    at Microsoft.Health.Fhir.Web.Startup.Configure(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Web/Startup.cs:line 204
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |    at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConfigureBuilder.Invoke(Object instance, IApplicationBuilder builder)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConventionBasedStartup.Configure(IApplicationBuilder app)
fhir-api-1  |    at Microsoft.Health.Api.Modules.InitializationModule.<>c__DisplayClass1_0.<Configure>b__0(IApplicationBuilder builder)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.FhirServerServiceCollectionExtensions.FhirServerStartupFilter.<>c__DisplayClass0_0.<Configure>b__0(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Api/Registration/FhirServerServiceCollectionExtensions.cs:line 223
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost.BuildApplication()
fhir-api-1  | crit: Microsoft.AspNetCore.Hosting.Diagnostics[6]
fhir-api-1  |       Application startup exception
fhir-api-1  |       Hl7.Fhir.ElementModel.StructuralTypeException: Type checking the data: Element 'resource' should contain a resource, but does not actually contain one (at Bundle.entry[912].resource[0])
fhir-api-1  |          at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |          at Hl7.Fhir.ElementModel.ScopedNode.<.ctor>b__3_0(Object o, ExceptionNotification a)
fhir-api-1  |          at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |          at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.raiseTypeError(String message, Object source, Boolean warning, String location)
fhir-api-1  |          at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.deriveInstanceType(ISourceNode current, IElementDefinitionSummary info)
fhir-api-1  |          at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.enumerateElements(Dictionary`2 dis, ISourceNode parent, String name)+MoveNext()
fhir-api-1  |          at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.runAdditionalRules(IEnumerable`1 children)+MoveNext()
fhir-api-1  |          at System.Linq.Enumerable.SelectEnumerableIterator`2.MoveNext()
fhir-api-1  |          at System.Linq.Enumerable.SelectManySingleSelectorIterator`2.MoveNext()
fhir-api-1  |          at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
fhir-api-1  |          at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable`1 source)
fhir-api-1  |          at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.<>c__DisplayClass1_0.<.ctor>b__0() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 22
fhir-api-1  |          at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
fhir-api-1  |          at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
fhir-api-1  |          at System.Lazy`1.CreateValue()
fhir-api-1  |          at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.get_Resource() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 27
fhir-api-1  |          at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager.<>c.<.ctor>b__5_0(BundleEntryWrapper e) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 64
fhir-api-1  |          at System.Linq.Enumerable.SelectArrayIterator`2.ToList()
fhir-api-1  |          at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager..ctor(IModelInfoProvider modelInfoProvider, IMediator mediator, Func`1 searchServiceFactory, ILogger`1 logger) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 63
fhir-api-1  |          at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |          at System.Reflection.ConstructorInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |          at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(IEnumerableCallSite enumerableCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitDisposeCache(ServiceCallSite transientCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |          at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
fhir-api-1  |          at Microsoft.AspNetCore.Builder.MvcApplicationBuilderExtensions.UseMvc(IApplicationBuilder app, Action`1 configureRoutes)
fhir-api-1  |          at Microsoft.AspNetCore.Builder.FhirServerApplicationBuilderExtensions.UseFhirServer(IApplicationBuilder app, Func`2 predicate) in /repo/src/Microsoft.Health.Fhir.Api/Registration/FhirServerApplicationBuilderExtensions.cs:line 43
fhir-api-1  |          at Microsoft.Health.Fhir.Web.Startup.Configure(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Web/Startup.cs:line 204
fhir-api-1  |          at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |          at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |          at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |          at Microsoft.AspNetCore.Hosting.ConfigureBuilder.Invoke(Object instance, IApplicationBuilder builder)
fhir-api-1  |          at Microsoft.AspNetCore.Hosting.ConventionBasedStartup.Configure(IApplicationBuilder app)
fhir-api-1  |          at Microsoft.Health.Api.Modules.InitializationModule.<>c__DisplayClass1_0.<Configure>b__0(IApplicationBuilder builder)
fhir-api-1  |          at Microsoft.Extensions.DependencyInjection.FhirServerServiceCollectionExtensions.FhirServerStartupFilter.<>c__DisplayClass0_0.<Configure>b__0(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Api/Registration/FhirServerServiceCollectionExtensions.cs:line 223
fhir-api-1  |          at Microsoft.AspNetCore.Hosting.WebHost.BuildApplication()
fhir-api-1  | Unhandled exception. Hl7.Fhir.ElementModel.StructuralTypeException: Type checking the data: Element 'resource' should contain a resource, but does not actually contain one (at Bundle.entry[912].resource[0])
fhir-api-1  |    at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |    at Hl7.Fhir.ElementModel.ScopedNode.<.ctor>b__3_0(Object o, ExceptionNotification a)
fhir-api-1  |    at Hl7.Fhir.Utility.ExceptionSourceExtensions.NotifyOrThrow(ExceptionNotificationHandler handler, Object source, ExceptionNotification args)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.raiseTypeError(String message, Object source, Boolean warning, String location)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.deriveInstanceType(ISourceNode current, IElementDefinitionSummary info)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.enumerateElements(Dictionary`2 dis, ISourceNode parent, String name)+MoveNext()
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.runAdditionalRules(IEnumerable`1 children)+MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.SelectEnumerableIterator`2.MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.SelectManySingleSelectorIterator`2.MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
fhir-api-1  |    at System.Linq.Enumerable.FirstOrDefault[TSource](IEnumerable`1 source)
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.<>c__DisplayClass1_0.<.ctor>b__0() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 22
fhir-api-1  |    at System.Lazy`1.ViaFactory(LazyThreadSafetyMode mode)
fhir-api-1  |    at System.Lazy`1.ExecutionAndPublication(LazyHelper executionAndPublication, Boolean useDefaultConstructor)
fhir-api-1  |    at System.Lazy`1.CreateValue()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.get_Resource() in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/BundleWrappers/BundleEntryWrapper.cs:line 27
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager.<>c.<.ctor>b__5_0(BundleEntryWrapper e) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 64
fhir-api-1  |    at System.Linq.Enumerable.SelectArrayIterator`2.ToList()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager..ctor(IModelInfoProvider modelInfoProvider, IMediator mediator, Func`1 searchServiceFactory, ILogger`1 logger) in /repo/src/Microsoft.Health.Fhir.Core/Features/Definition/SearchParameterDefinitionManager.cs:line 63
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |    at System.Reflection.ConstructorInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |    at System.Reflection.RuntimeConstructorInfo.Invoke(BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(IServiceProvider provider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(IEnumerableCallSite enumerableCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitDisposeCache(ServiceCallSite transientCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(ConstructorCallSite constructorCallSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSiteMain(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(ServiceCallSite callSite, RuntimeResolverContext context)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2.VisitCallSite(ServiceCallSite callSite, TArgument argument)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(ServiceCallSite callSite, ServiceProviderEngineScope scope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(Type serviceType)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(Type serviceType, ServiceProviderEngineScope serviceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(IServiceProvider provider, Type serviceType)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[T](IServiceProvider provider)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.MvcApplicationBuilderExtensions.UseMvc(IApplicationBuilder app, Action`1 configureRoutes)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.FhirServerApplicationBuilderExtensions.UseFhirServer(IApplicationBuilder app, Func`2 predicate) in /repo/src/Microsoft.Health.Fhir.Api/Registration/FhirServerApplicationBuilderExtensions.cs:line 43
fhir-api-1  |    at Microsoft.Health.Fhir.Web.Startup.Configure(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Web/Startup.cs:line 204
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
fhir-api-1  |    at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
fhir-api-1  |    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConfigureBuilder.Invoke(Object instance, IApplicationBuilder builder)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConventionBasedStartup.Configure(IApplicationBuilder app)
fhir-api-1  |    at Microsoft.Health.Api.Modules.InitializationModule.<>c__DisplayClass1_0.<Configure>b__0(IApplicationBuilder builder)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.FhirServerServiceCollectionExtensions.FhirServerStartupFilter.<>c__DisplayClass0_0.<Configure>b__0(IApplicationBuilder app) in /repo/src/Microsoft.Health.Fhir.Shared.Api/Registration/FhirServerServiceCollectionExtensions.cs:line 223
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost.BuildApplication()
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost.StartAsync(CancellationToken cancellationToken)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.RunAsync(IWebHost host, CancellationToken token, String startupMessage)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.RunAsync(IWebHost host, CancellationToken token, String startupMessage)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.RunAsync(IWebHost host, CancellationToken token)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.Run(IWebHost host)
fhir-api-1  |    at Microsoft.Health.Fhir.Web.Program.Main(String[] args) in /repo/src/Microsoft.Health.Fhir.Shared.Web/Program.cs:line 40
sql-1       | 2023-12-24 08:21:08.61 Server      Setup step is copying system data file 'C:\templatedata\master.mdf' to '/var/opt/mssql/data/master.mdf'.
2023-12-24 08:21:08.65 Server      Did not find an existing master data file /var/opt/mssql/data/master.mdf, copying the missing default master and other system database files. If you have moved the database location, but not moved the database files, startup may fail. To repair: shutdown SQL Server, move the master database to configured location, and restart.
2023-12-24 08:21:08.65 Server      Setup step is copying system data file 'C:\templatedata\mastlog.ldf' to '/var/opt/mssql/data/mastlog.ldf'.
2023-12-24 08:21:08.65 Server      Setup step is copying system data file 'C:\templatedata\model.mdf' to '/var/opt/mssql/data/model.mdf'.
2023-12-24 08:21:08.66 Server      Setup step is copying system data file 'C:\templatedata\modellog.ldf' to '/var/opt/mssql/data/modellog.ldf'.
2023-12-24 08:21:08.66 Server      Setup step is copying system data file 'C:\templatedata\msdbdata.mdf' to '/var/opt/mssql/data/msdbdata.mdf'.
2023-12-24 08:21:08.67 Server      Setup step is copying system data file 'C:\templatedata\msdblog.ldf' to '/var/opt/mssql/data/msdblog.ldf'.
2023-12-24 08:21:08.68 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_replicatedmaster.mdf' to '/var/opt/mssql/data/model_replicatedmaster.mdf'.
2023-12-24 08:21:08.68 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_replicatedmaster.ldf' to '/var/opt/mssql/data/model_replicatedmaster.ldf'.
2023-12-24 08:21:08.68 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_msdbdata.mdf' to '/var/opt/mssql/data/model_msdbdata.mdf'.
2023-12-24 08:21:08.69 Server      Setup step is FORCE copying system data file 'C:\templatedata\model_msdblog.ldf' to '/var/opt/mssql/data/model_msdblog.ldf'.
2023-12-24 08:21:08.72 Server      Microsoft SQL Server 2022 (RTM-CU10) (KB5031778) - 16.0.4095.4 (X64) 
sql-1   Oct 30 2023 16:12:44 
sql-1   Copyright (C) 2022 Microsoft Corporation
sql-1   Developer Edition (64-bit) on Linux (Ubuntu 22.04.3 LTS) <X64>
2023-12-24 08:21:08.72 Server      UTC adjustment: 0:00
2023-12-24 08:21:08.72 Server      (c) Microsoft Corporation.
2023-12-24 08:21:08.72 Server      All rights reserved.
2023-12-24 08:21:08.72 Server      Server process ID is 468.
2023-12-24 08:21:08.72 Server      Logging SQL Server messages in file '/var/opt/mssql/log/errorlog'.
2023-12-24 08:21:08.72 Server      Registry startup parameters: 
sql-1    -d /var/opt/mssql/data/master.mdf
sql-1    -l /var/opt/mssql/data/mastlog.ldf
sql-1    -e /var/opt/mssql/log/errorlog
2023-12-24 08:21:08.73 Server      SQL Server detected 1 sockets with 8 cores per socket and 8 logical processors per socket, 8 total logical processors; using 8 logical processors based on SQL Server licensing. This is an informational message; no user action is required.
2023-12-24 08:21:08.73 Server      SQL Server is starting at normal priority base (=7). This is an informational message only. No user action is required.
2023-12-24 08:21:08.73 Server      Detected 6277 MB of RAM. This is an informational message; no user action is required.
2023-12-24 08:21:08.73 Server      Using conventional memory in the memory manager.
2023-12-24 08:21:08.73 Server      Detected pause instruction latency: 0 cycles.
2023-12-24 08:21:08.73 Server      Page exclusion bitmap is enabled.
2023-12-24 08:21:08.77 Server      Buffer pool extension is not supported on Linux platform.
2023-12-24 08:21:08.77 Server      Buffer Pool: Allocating 1048576 bytes for 912437 hashPages.
2023-12-24 08:21:08.91 Server      Buffer pool extension is already disabled. No action is necessary.
2023-12-24 08:21:09.35 Server      Installing Client TLS certificates to the store.
2023-12-24 08:21:09.36 Server      Error searching first file in /var/opt/mssql/security/ca-certificates: 3(The system cannot find the path specified.)
2023-12-24 08:21:09.36 Server      CPU vectorization level(s) detected:  SSE SSE2 SSE3 SSSE3 SSE41 SSE42 POPCNT
2023-12-24 08:21:09.41 Server      Successfully initialized the TLS configuration. Allowed TLS protocol versions are ['1.0 1.1 1.2']. Allowed TLS ciphers are ['ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-ECDSA-AES128-SHA:AES256-GCM-SHA384:AES128-GCM-SHA256:AES256-SHA256:AES128-SHA256:AES256-SHA:AES128-SHA:!DHE-RSA-AES256-GCM-SHA384:!DHE-RSA-AES128-GCM-SHA256:!DHE-RSA-AES256-SHA:!DHE-RSA-AES128-SHA'].
2023-12-24 08:21:09.46 Server      Query Store settings initialized with enabled = 1, 
SetThreadAffinity failed: 87
2023-12-24 08:21:09.48 Server      The maximum number of dedicated administrator connections for this instance is '1'
2023-12-24 08:21:09.48 Server      Node configuration: node 0: CPU mask: 0x00000000000000ff:0 Active CPU mask: 0x00000000000000ff:0. This message provides a description of the NUMA configuration for this computer. This is an informational message only. No user action is required.
2023-12-24 08:21:09.49 Server      Using dynamic lock allocation.  Initial allocation of 2500 Lock blocks and 5000 Lock Owner blocks per node.  This is an informational message only.  No user action is required.
2023-12-24 08:21:09.56 Server      In-Memory OLTP initialized on lowend machine.
2023-12-24 08:21:09.61 Server      CLR version v4.0.30319 loaded.
2023-12-24 08:21:09.62 Server      [INFO] Created Extended Events session 'hkenginexesession'
2023-12-24 08:21:09.62 Server      Database Instant File Initialization: enabled. For security and performance considerations see the topic 'Database Instant File Initialization' in SQL Server Books Online. This is an informational message only. No user action is required.
ForceFlush is enabled for this instance. 
2023-12-24 08:21:09.63 Server      Total Log Writer threads: 2. This is an informational message; no user action is required.
2023-12-24 08:21:09.65 Server      Software Usage Metrics is disabled.
2023-12-24 08:21:09.68 spid25s     [1]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:09.68 spid25s     Starting up database 'master'.
ForceFlush feature is enabled for log durability.
2023-12-24 08:21:09.85 spid25s     The tail of the log for database master is being rewritten to match the new sector size of 4096 bytes.  1024 bytes at offset 396288 in file /var/opt/mssql/data/mastlog.ldf will be written.
2023-12-24 08:21:10.08 spid25s     Converting database 'master' from version 927 to the current version 957.
2023-12-24 08:21:10.08 spid25s     Database 'master' running the upgrade step from version 927 to version 928.
2023-12-24 08:21:10.19 spid25s     Database 'master' running the upgrade step from version 928 to version 929.
2023-12-24 08:21:10.23 spid25s     Database 'master' running the upgrade step from version 929 to version 930.
2023-12-24 08:21:10.24 spid25s     Database 'master' running the upgrade step from version 930 to version 931.
2023-12-24 08:21:10.25 spid25s     Database 'master' running the upgrade step from version 931 to version 932.
2023-12-24 08:21:10.25 spid25s     Database 'master' running the upgrade step from version 932 to version 933.
2023-12-24 08:21:10.26 spid25s     Database 'master' running the upgrade step from version 933 to version 934.
2023-12-24 08:21:10.27 spid25s     Database 'master' running the upgrade step from version 934 to version 935.
2023-12-24 08:21:10.29 spid25s     Database 'master' running the upgrade step from version 935 to version 936.
2023-12-24 08:21:10.29 spid25s     Database 'master' running the upgrade step from version 936 to version 937.
2023-12-24 08:21:10.30 spid25s     Database 'master' running the upgrade step from version 937 to version 938.
2023-12-24 08:21:10.31 spid25s     Database 'master' running the upgrade step from version 938 to version 939.
2023-12-24 08:21:10.31 spid25s     Database 'master' running the upgrade step from version 939 to version 940.
2023-12-24 08:21:10.32 spid25s     Database 'master' running the upgrade step from version 940 to version 941.
2023-12-24 08:21:10.33 spid25s     Database 'master' running the upgrade step from version 941 to version 942.
2023-12-24 08:21:10.33 Server      External governance manager initialized
2023-12-24 08:21:10.33 spid25s     Database 'master' running the upgrade step from version 942 to version 943.
2023-12-24 08:21:10.35 spid25s     Database 'master' running the upgrade step from version 943 to version 944.
2023-12-24 08:21:10.36 spid25s     Database 'master' running the upgrade step from version 944 to version 945.
2023-12-24 08:21:10.37 spid25s     Database 'master' running the upgrade step from version 945 to version 946.
2023-12-24 08:21:10.39 spid25s     Database 'master' running the upgrade step from version 946 to version 947.
2023-12-24 08:21:10.39 spid25s     Database 'master' running the upgrade step from version 947 to version 948.
2023-12-24 08:21:10.40 spid25s     Database 'master' running the upgrade step from version 948 to version 949.
2023-12-24 08:21:10.41 spid25s     Database 'master' running the upgrade step from version 949 to version 950.
2023-12-24 08:21:10.42 spid25s     Database 'master' running the upgrade step from version 950 to version 951.
2023-12-24 08:21:10.43 spid25s     Database 'master' running the upgrade step from version 951 to version 952.
2023-12-24 08:21:10.43 spid25s     Database 'master' running the upgrade step from version 952 to version 953.
2023-12-24 08:21:10.44 spid25s     Database 'master' running the upgrade step from version 953 to version 954.
2023-12-24 08:21:10.44 spid25s     Database 'master' running the upgrade step from version 954 to version 955.
2023-12-24 08:21:10.45 spid25s     Database 'master' running the upgrade step from version 955 to version 956.
2023-12-24 08:21:10.47 spid25s     Database 'master' running the upgrade step from version 956 to version 957.
2023-12-24 08:21:10.59 spid28s     [32767]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:10.59 spid28s     Starting up database 'mssqlsystemresource'.
2023-12-24 08:21:10.60 spid28s     The resource database build version is 16.00.4095. This is an informational message only. No user action is required.
2023-12-24 08:21:10.61 spid37s     Password policy update was successful.
2023-12-24 08:21:10.63 spid28s     [3]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:10.64 spid28s     Starting up database 'model'.
2023-12-24 08:21:10.66 spid25s     [32762]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:10.66 spid25s     Starting up database 'model_replicatedmaster'.
2023-12-24 08:21:10.66 spid28s     The tail of the log for database model is being rewritten to match the new sector size of 4096 bytes.  2048 bytes at offset 75776 in file /var/opt/mssql/data/modellog.ldf will be written.
2023-12-24 08:21:10.68 spid25s     The tail of the log for database model_replicatedmaster is being rewritten to match the new sector size of 4096 bytes.  2560 bytes at offset 99840 in file /var/opt/mssql/data/model_replicatedmaster.ldf will be written.
2023-12-24 08:21:10.68 spid28s     Converting database 'model' from version 927 to the current version 957.
2023-12-24 08:21:10.69 spid28s     Database 'model' running the upgrade step from version 927 to version 928.
2023-12-24 08:21:10.69 Server      Common language runtime (CLR) functionality initialized.
2023-12-24 08:21:10.70 spid28s     Database 'model' running the upgrade step from version 928 to version 929.
2023-12-24 08:21:10.71 spid25s     Converting database 'model_replicatedmaster' from version 927 to the current version 957.
2023-12-24 08:21:10.71 spid28s     Database 'model' running the upgrade step from version 929 to version 930.
2023-12-24 08:21:10.71 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 927 to version 928.
2023-12-24 08:21:10.72 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 928 to version 929.
2023-12-24 08:21:10.72 spid28s     Database 'model' running the upgrade step from version 930 to version 931.
2023-12-24 08:21:10.73 spid28s     Database 'model' running the upgrade step from version 931 to version 932.
2023-12-24 08:21:10.73 spid28s     Database 'model' running the upgrade step from version 932 to version 933.
2023-12-24 08:21:10.73 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 929 to version 930.
2023-12-24 08:21:10.74 spid28s     Database 'model' running the upgrade step from version 933 to version 934.
2023-12-24 08:21:10.74 spid28s     Database 'model' running the upgrade step from version 934 to version 935.
2023-12-24 08:21:10.75 spid28s     Database 'model' running the upgrade step from version 935 to version 936.
2023-12-24 08:21:10.75 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 930 to version 931.
2023-12-24 08:21:10.75 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 931 to version 932.
2023-12-24 08:21:10.75 spid28s     Database 'model' running the upgrade step from version 936 to version 937.
2023-12-24 08:21:10.76 spid28s     Database 'model' running the upgrade step from version 937 to version 938.
2023-12-24 08:21:10.76 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 932 to version 933.
2023-12-24 08:21:10.76 spid28s     Database 'model' running the upgrade step from version 938 to version 939.
2023-12-24 08:21:10.76 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 933 to version 934.
2023-12-24 08:21:10.77 spid28s     Database 'model' running the upgrade step from version 939 to version 940.
2023-12-24 08:21:10.77 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 934 to version 935.
2023-12-24 08:21:10.77 spid28s     Database 'model' running the upgrade step from version 940 to version 941.
2023-12-24 08:21:10.77 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 935 to version 936.
2023-12-24 08:21:10.78 spid28s     Database 'model' running the upgrade step from version 941 to version 942.
2023-12-24 08:21:10.78 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 936 to version 937.
2023-12-24 08:21:10.78 spid28s     Database 'model' running the upgrade step from version 942 to version 943.
2023-12-24 08:21:10.78 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 937 to version 938.
2023-12-24 08:21:10.79 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 938 to version 939.
2023-12-24 08:21:10.79 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 939 to version 940.
2023-12-24 08:21:10.80 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 940 to version 941.
2023-12-24 08:21:10.80 spid28s     Database 'model' running the upgrade step from version 943 to version 944.
2023-12-24 08:21:10.80 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 941 to version 942.
2023-12-24 08:21:10.80 spid28s     Database 'model' running the upgrade step from version 944 to version 945.
2023-12-24 08:21:10.81 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 942 to version 943.
2023-12-24 08:21:10.82 spid28s     Database 'model' running the upgrade step from version 945 to version 946.
2023-12-24 08:21:10.82 spid28s     Database 'model' running the upgrade step from version 946 to version 947.
2023-12-24 08:21:10.83 spid28s     Database 'model' running the upgrade step from version 947 to version 948.
2023-12-24 08:21:10.83 spid28s     Database 'model' running the upgrade step from version 948 to version 949.
2023-12-24 08:21:10.83 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 943 to version 944.
2023-12-24 08:21:10.84 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 944 to version 945.
2023-12-24 08:21:10.84 spid28s     Database 'model' running the upgrade step from version 949 to version 950.
2023-12-24 08:21:10.85 spid28s     Database 'model' running the upgrade step from version 950 to version 951.
2023-12-24 08:21:10.85 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 945 to version 946.
2023-12-24 08:21:10.86 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 946 to version 947.
2023-12-24 08:21:10.86 spid28s     Database 'model' running the upgrade step from version 951 to version 952.
2023-12-24 08:21:10.86 spid28s     Database 'model' running the upgrade step from version 952 to version 953.
2023-12-24 08:21:10.86 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 947 to version 948.
2023-12-24 08:21:10.87 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 948 to version 949.
2023-12-24 08:21:10.87 spid28s     Database 'model' running the upgrade step from version 953 to version 954.
2023-12-24 08:21:10.87 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 949 to version 950.
2023-12-24 08:21:10.88 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 950 to version 951.
2023-12-24 08:21:10.88 spid28s     Database 'model' running the upgrade step from version 954 to version 955.
2023-12-24 08:21:10.89 spid28s     Database 'model' running the upgrade step from version 955 to version 956.
2023-12-24 08:21:10.89 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 951 to version 952.
2023-12-24 08:21:10.90 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 952 to version 953.
2023-12-24 08:21:10.90 spid28s     Database 'model' running the upgrade step from version 956 to version 957.
2023-12-24 08:21:10.91 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 953 to version 954.
2023-12-24 08:21:10.91 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 954 to version 955.
2023-12-24 08:21:10.92 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 955 to version 956.
2023-12-24 08:21:10.94 spid25s     Database 'model_replicatedmaster' running the upgrade step from version 956 to version 957.
2023-12-24 08:21:10.97 spid25s     [32761]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:10.97 spid25s     Starting up database 'model_msdb'.
2023-12-24 08:21:11.00 spid25s     Converting database 'model_msdb' from version 927 to the current version 957.
2023-12-24 08:21:11.00 spid25s     Database 'model_msdb' running the upgrade step from version 927 to version 928.
2023-12-24 08:21:11.01 spid25s     Database 'model_msdb' running the upgrade step from version 928 to version 929.
2023-12-24 08:21:11.02 spid25s     Database 'model_msdb' running the upgrade step from version 929 to version 930.
2023-12-24 08:21:11.03 spid25s     Database 'model_msdb' running the upgrade step from version 930 to version 931.
2023-12-24 08:21:11.03 spid25s     Database 'model_msdb' running the upgrade step from version 931 to version 932.
2023-12-24 08:21:11.04 spid25s     Database 'model_msdb' running the upgrade step from version 932 to version 933.
2023-12-24 08:21:11.05 spid25s     Database 'model_msdb' running the upgrade step from version 933 to version 934.
2023-12-24 08:21:11.05 spid25s     Database 'model_msdb' running the upgrade step from version 934 to version 935.
2023-12-24 08:21:11.05 spid25s     Database 'model_msdb' running the upgrade step from version 935 to version 936.
2023-12-24 08:21:11.06 spid25s     Database 'model_msdb' running the upgrade step from version 936 to version 937.
2023-12-24 08:21:11.06 spid25s     Database 'model_msdb' running the upgrade step from version 937 to version 938.
2023-12-24 08:21:11.06 spid25s     Database 'model_msdb' running the upgrade step from version 938 to version 939.
2023-12-24 08:21:11.07 spid25s     Database 'model_msdb' running the upgrade step from version 939 to version 940.
2023-12-24 08:21:11.07 spid25s     Database 'model_msdb' running the upgrade step from version 940 to version 941.
2023-12-24 08:21:11.07 spid25s     Database 'model_msdb' running the upgrade step from version 941 to version 942.
2023-12-24 08:21:11.08 spid25s     Database 'model_msdb' running the upgrade step from version 942 to version 943.
2023-12-24 08:21:11.09 spid25s     Database 'model_msdb' running the upgrade step from version 943 to version 944.
2023-12-24 08:21:11.10 spid25s     Database 'model_msdb' running the upgrade step from version 944 to version 945.
2023-12-24 08:21:11.11 spid25s     Database 'model_msdb' running the upgrade step from version 945 to version 946.
2023-12-24 08:21:11.11 spid25s     Database 'model_msdb' running the upgrade step from version 946 to version 947.
2023-12-24 08:21:11.12 spid25s     Database 'model_msdb' running the upgrade step from version 947 to version 948.
2023-12-24 08:21:11.12 spid25s     Database 'model_msdb' running the upgrade step from version 948 to version 949.
2023-12-24 08:21:11.13 spid25s     Database 'model_msdb' running the upgrade step from version 949 to version 950.
2023-12-24 08:21:11.13 spid25s     Database 'model_msdb' running the upgrade step from version 950 to version 951.
2023-12-24 08:21:11.14 spid25s     Database 'model_msdb' running the upgrade step from version 951 to version 952.
2023-12-24 08:21:11.14 spid25s     Database 'model_msdb' running the upgrade step from version 952 to version 953.
2023-12-24 08:21:11.15 spid25s     Database 'model_msdb' running the upgrade step from version 953 to version 954.
2023-12-24 08:21:11.15 spid25s     Database 'model_msdb' running the upgrade step from version 954 to version 955.
2023-12-24 08:21:11.15 spid25s     Database 'model_msdb' running the upgrade step from version 955 to version 956.
2023-12-24 08:21:11.17 spid25s     Database 'model_msdb' running the upgrade step from version 956 to version 957.
2023-12-24 08:21:11.19 spid40s     Attribute synchronization initialized
2023-12-24 08:21:11.19 spid40s     Attribute synchronization manager initialized
2023-12-24 08:21:11.19 spid25s     Resource governor reconfiguration succeeded.
2023-12-24 08:21:11.19 spid25s     SQL Server Audit is starting the audits. This is an informational message. No user action is required.
2023-12-24 08:21:11.20 spid25s     SQL Server Audit has started the audits. This is an informational message. No user action is required.
2023-12-24 08:21:11.20 spid25s     XE session 'system_health' started.
2023-12-24 08:21:11.22 spid25s     SQL Trace ID 1 was started by login "sa".
2023-12-24 08:21:11.23 spid25s     Server name is '989032ed74d1'. This is an informational message only. No user action is required.
2023-12-24 08:21:11.24 spid28s     Clearing tempdb database.
2023-12-24 08:21:11.24 spid45s     Always On: The availability replica manager is starting. This is an informational message only. No user action is required.
2023-12-24 08:21:11.25 spid47s     [4]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:11.25 spid47s     Starting up database 'msdb'.
2023-12-24 08:21:11.25 spid45s     Always On: The availability replica manager is waiting for the instance of SQL Server to allow client connections. This is an informational message only. No user action is required.
2023-12-24 08:21:11.29 spid47s     Converting database 'msdb' from version 927 to the current version 957.
2023-12-24 08:21:11.29 spid47s     Database 'msdb' running the upgrade step from version 927 to version 928.
2023-12-24 08:21:11.30 spid47s     Database 'msdb' running the upgrade step from version 928 to version 929.
2023-12-24 08:21:11.32 spid28s     [2]. Feature Status: PVS: 0. CTR: 0. ConcurrentPFSUpdate: 1. ConcurrentGAMUpdate: 1. ConcurrentSGAMUpdate: 1, CleanupUnderUserTransaction: 0. TranLevelPVS: 0
2023-12-24 08:21:11.33 spid28s     Starting up database 'tempdb'.
2023-12-24 08:21:11.33 spid47s     Database 'msdb' running the upgrade step from version 929 to version 930.
2023-12-24 08:21:11.34 spid47s     Database 'msdb' running the upgrade step from version 930 to version 931.
2023-12-24 08:21:11.35 spid47s     Database 'msdb' running the upgrade step from version 931 to version 932.
2023-12-24 08:21:11.35 spid37s     A self-generated certificate was successfully loaded for encryption.
2023-12-24 08:21:11.35 spid37s     Server is listening on [ 'any' <ipv6> 1433] accept sockets 1.
2023-12-24 08:21:11.36 spid47s     Database 'msdb' running the upgrade step from version 932 to version 933.
2023-12-24 08:21:11.36 spid37s     Server is listening on [ 'any' <ipv4> 1433] accept sockets 1.
2023-12-24 08:21:11.37 spid28s     The tempdb database has 1 data file(s).
2023-12-24 08:21:11.37 Server      Server is listening on [ ::1 <ipv6> 1434] accept sockets 1.
2023-12-24 08:21:11.37 Server      Server is listening on [ 127.0.0.1 <ipv4> 1434] accept sockets 1.
2023-12-24 08:21:11.37 Server      Dedicated admin connection support was established for listening locally on port 1434.
2023-12-24 08:21:11.37 spid47s     Database 'msdb' running the upgrade step from version 933 to version 934.
2023-12-24 08:21:11.37 spid49s     The Service Broker endpoint is in disabled or stopped state.
2023-12-24 08:21:11.38 spid49s     The Database Mirroring endpoint is in disabled or stopped state.
2023-12-24 08:21:11.38 spid47s     Database 'msdb' running the upgrade step from version 934 to version 935.
2023-12-24 08:21:11.38 spid37s     Server is listening on [ ::1 <ipv6> 1431] accept sockets 1.
2023-12-24 08:21:11.38 spid37s     Server is listening on [ 127.0.0.1 <ipv4> 1431] accept sockets 1.
2023-12-24 08:21:11.38 spid47s     Database 'msdb' running the upgrade step from version 935 to version 936.
2023-12-24 08:21:11.38 spid37s     SQL Server is now ready for client connections. This is an informational message; no user action is required.
2023-12-24 08:21:11.39 spid47s     Database 'msdb' running the upgrade step from version 936 to version 937.
2023-12-24 08:21:11.39 spid49s     Service Broker manager has started.
2023-12-24 08:21:11.39 spid47s     Database 'msdb' running the upgrade step from version 937 to version 938.
2023-12-24 08:21:11.40 spid47s     Database 'msdb' running the upgrade step from version 938 to version 939.
2023-12-24 08:21:11.40 spid47s     Database 'msdb' running the upgrade step from version 939 to version 940.
2023-12-24 08:21:11.40 spid47s     Database 'msdb' running the upgrade step from version 940 to version 941.
2023-12-24 08:21:11.41 spid47s     Database 'msdb' running the upgrade step from version 941 to version 942.
2023-12-24 08:21:11.41 spid47s     Database 'msdb' running the upgrade step from version 942 to version 943.
2023-12-24 08:21:11.43 spid47s     Database 'msdb' running the upgrade step from version 943 to version 944.
2023-12-24 08:21:11.43 spid47s     Database 'msdb' running the upgrade step from version 944 to version 945.
2023-12-24 08:21:11.44 spid47s     Database 'msdb' running the upgrade step from version 945 to version 946.
2023-12-24 08:21:11.45 spid47s     Database 'msdb' running the upgrade step from version 946 to version 947.
2023-12-24 08:21:11.45 spid47s     Database 'msdb' running the upgrade step from version 947 to version 948.
2023-12-24 08:21:11.46 spid47s     Database 'msdb' running the upgrade step from version 948 to version 949.
2023-12-24 08:21:11.46 spid47s     Database 'msdb' running the upgrade step from version 949 to version 950.
2023-12-24 08:21:11.47 spid47s     Database 'msdb' running the upgrade step from version 950 to version 951.
2023-12-24 08:21:11.48 spid47s     Database 'msdb' running the upgrade step from version 951 to version 952.
2023-12-24 08:21:11.48 spid47s     Database 'msdb' running the upgrade step from version 952 to version 953.
2023-12-24 08:21:11.49 spid47s     Database 'msdb' running the upgrade step from version 953 to version 954.
2023-12-24 08:21:11.49 spid47s     Database 'msdb' running the upgrade step from version 954 to version 955.
2023-12-24 08:21:11.49 spid47s     Database 'msdb' running the upgrade step from version 955 to version 956.
2023-12-24 08:21:11.51 spid47s     Database 'msdb' running the upgrade step from version 956 to version 957.
2023-12-24 08:21:11.54 spid25s     Recovery is complete. This is an informational message only. No user action is required.
2023-12-24 08:21:11.86 spid35s     The default language (LCID 0) has been set for engine and full-text services.
2023-12-24 08:21:12.04 spid35s     The tempdb database has 8 data file(s).
2023-12-24 08:26:11.88 spid54      XE session 'telemetry_xevents' started.
2023-12-24 08:27:38.19 spid54      Attempting to load library 'xplog70.dll' into memory. This is an informational message only. No user action is required.
2023-12-24 08:27:38.21 spid54      Using 'xplog70.dll' version '2022.160.4095' to execute extended stored procedure 'xp_msver'. This is an informational message only; no user action is required.
2023-12-24 08:31:50.47 spid54      Using 'dbghelp.dll' version '4.0.5'

Edit:

I thought that the exception that the fhir server throws could be related to a race condition with the SQL server starting at the same time, so I tried restarting it (while the SQL server is still running). It then shows the corrupted memory crash below. This crash will only go away when deleting the container from Docker and redownloading it.

fhir-api-1 exited with code 0
fhir-api-1 exited with code 0
fhir-api-1  | Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
fhir-api-1  |    at System.Collections.Generic.Dictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].FindValue(System.__Canon)
fhir-api-1  |    at System.Collections.Generic.Dictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].TryGetValue(System.__Canon, System.__Canon ByRef)
fhir-api-1  |    at Newtonsoft.Json.Linq.JPropertyKeyedCollection.TryGetValue(System.String, Newtonsoft.Json.Linq.JToken ByRef)
fhir-api-1  |    at Newtonsoft.Json.Linq.JObject.Property(System.String, System.StringComparison)
fhir-api-1  |    at Newtonsoft.Json.Linq.JObject.Property(System.String)
fhir-api-1  |    at Hl7.Fhir.Serialization.JTokenExtensions.GetResourceTypePropertyFromObject(Newtonsoft.Json.Linq.JObject, System.String)
fhir-api-1  |    at Hl7.Fhir.Serialization.FhirJsonNode.get_ResourceType()
fhir-api-1  |    at Hl7.Fhir.ElementModel.SourceNodeExtensions.GetResourceTypeIndicator(Hl7.Fhir.ElementModel.ISourceNode)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode.deriveInstanceType(Hl7.Fhir.ElementModel.ISourceNode, Hl7.Fhir.Specification.IElementDefinitionSummary)
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode+<enumerateElements>d__34.MoveNext()
fhir-api-1  |    at Hl7.Fhir.ElementModel.TypedElementOnSourceNode+<runAdditionalRules>d__36.MoveNext()
fhir-api-1  |    at System.Linq.Enumerable+SelectEnumerableIterator`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].MoveNext()
fhir-api-1  |    at System.Linq.Enumerable+SelectManySingleSelectorIterator`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].MoveNext()
fhir-api-1  |    at System.Linq.Enumerable.TryGetFirst[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](System.Collections.Generic.IEnumerable`1<System.__Canon>, Boolean ByRef)
fhir-api-1  |    at System.Linq.Enumerable.FirstOrDefault[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](System.Collections.Generic.IEnumerable`1<System.__Canon>)
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper+<>c__DisplayClass1_0.<.ctor>b__0()
fhir-api-1  |    at System.Lazy`1[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].ViaFactory(System.Threading.LazyThreadSafetyMode)
fhir-api-1  |    at System.Lazy`1[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].ExecutionAndPublication(System.LazyHelper, Boolean)
fhir-api-1  |    at System.Lazy`1[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].CreateValue()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper.get_Resource()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager+<>c.<.ctor>b__5_0(Microsoft.Health.Fhir.Core.Features.Definition.BundleWrappers.BundleEntryWrapper)
fhir-api-1  |    at System.Linq.Enumerable+SelectArrayIterator`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].ToList()
fhir-api-1  |    at Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager..ctor(Microsoft.Health.Fhir.Core.Models.IModelInfoProvider, MediatR.IMediator, System.Func`1<Microsoft.Health.Extensions.DependencyInjection.IScoped`1<Microsoft.Health.Fhir.Core.Features.Search.ISearchService>>, Microsoft.Extensions.Logging.ILogger`1<Microsoft.Health.Fhir.Core.Features.Definition.SearchParameterDefinitionManager>)
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(System.Object, Void**, System.Signature, Boolean)
fhir-api-1  |    at System.Reflection.ConstructorInvoker.Invoke(System.Object, IntPtr*, System.Reflection.BindingFlags)
fhir-api-1  |    at System.Reflection.RuntimeConstructorInfo.Invoke(System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(System.IServiceProvider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(System.IServiceProvider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(System.IServiceProvider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(System.IServiceProvider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Health.Extensions.DependencyInjection.TypeRegistrationBuilder.<SetupRootRegistration>b__19_0(System.IServiceProvider)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitIEnumerable(Microsoft.Extensions.DependencyInjection.ServiceLookup.IEnumerableCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitDisposeCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitConstructor(Microsoft.Extensions.DependencyInjection.ServiceLookup.ConstructorCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSiteMain(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.VisitRootCache(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteVisitor`2[[Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext, Microsoft.Extensions.DependencyInjection, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].VisitCallSite(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.RuntimeResolverContext)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceLookup.CallSiteRuntimeResolver.Resolve(Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceCallSite, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.CreateServiceAccessor(System.Type)
fhir-api-1  |    at System.Collections.Concurrent.ConcurrentDictionary`2[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].GetOrAdd(System.__Canon, System.Func`2<System.__Canon,System.__Canon>)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProvider.GetService(System.Type, Microsoft.Extensions.DependencyInjection.ServiceLookup.ServiceProviderEngineScope)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService(System.IServiceProvider, System.Type)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.ServiceProviderServiceExtensions.GetRequiredService[[System.__Canon, System.Private.CoreLib, Version=7.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](System.IServiceProvider)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.MvcApplicationBuilderExtensions.UseMvc(Microsoft.AspNetCore.Builder.IApplicationBuilder, System.Action`1<Microsoft.AspNetCore.Routing.IRouteBuilder>)
fhir-api-1  |    at Microsoft.AspNetCore.Builder.FhirServerApplicationBuilderExtensions.UseFhirServer(Microsoft.AspNetCore.Builder.IApplicationBuilder, System.Func`2<Microsoft.Extensions.Diagnostics.HealthChecks.HealthCheckRegistration,Boolean>)
fhir-api-1  |    at Microsoft.Health.Fhir.Web.Startup.Configure(Microsoft.AspNetCore.Builder.IApplicationBuilder)
fhir-api-1  |    at System.RuntimeMethodHandle.InvokeMethod(System.Object, Void**, System.Signature, Boolean)
fhir-api-1  |    at System.Reflection.MethodInvoker.Invoke(System.Object, IntPtr*, System.Reflection.BindingFlags)
fhir-api-1  |    at System.Reflection.RuntimeMethodInfo.Invoke(System.Object, System.Reflection.BindingFlags, System.Reflection.Binder, System.Object[], System.Globalization.CultureInfo)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConfigureBuilder.Invoke(System.Object, Microsoft.AspNetCore.Builder.IApplicationBuilder)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.ConventionBasedStartup.Configure(Microsoft.AspNetCore.Builder.IApplicationBuilder)
fhir-api-1  |    at Microsoft.Health.Api.Modules.InitializationModule+<>c__DisplayClass1_0.<Configure>b__0(Microsoft.AspNetCore.Builder.IApplicationBuilder)
fhir-api-1  |    at Microsoft.Extensions.DependencyInjection.FhirServerServiceCollectionExtensions+FhirServerStartupFilter+<>c__DisplayClass0_0.<Configure>b__0(Microsoft.AspNetCore.Builder.IApplicationBuilder)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost.BuildApplication()
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost+<StartAsync>d__27.MoveNext()
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Microsoft.AspNetCore.Hosting.WebHost+<StartAsync>d__27, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<StartAsync>d__27 ByRef)
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Microsoft.AspNetCore.Hosting.WebHost+<StartAsync>d__27, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<StartAsync>d__27 ByRef)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHost.StartAsync(System.Threading.CancellationToken)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__5.MoveNext()
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__5, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<RunAsync>d__5 ByRef)
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__5, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<RunAsync>d__5 ByRef)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.RunAsync(Microsoft.AspNetCore.Hosting.IWebHost, System.Threading.CancellationToken, System.String)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__4.MoveNext()
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__4, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<RunAsync>d__4 ByRef)
fhir-api-1  |    at System.Runtime.CompilerServices.AsyncTaskMethodBuilder.Start[[Microsoft.AspNetCore.Hosting.WebHostExtensions+<RunAsync>d__4, Microsoft.AspNetCore.Hosting, Version=7.0.0.0, Culture=neutral, PublicKeyToken=adb9793829ddae60]](<RunAsync>d__4 ByRef)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.RunAsync(Microsoft.AspNetCore.Hosting.IWebHost, System.Threading.CancellationToken)
fhir-api-1  |    at Microsoft.AspNetCore.Hosting.WebHostExtensions.Run(Microsoft.AspNetCore.Hosting.IWebHost)
fhir-api-1  |    at Microsoft.Health.Fhir.Web.Program.Main(System.String[])
mikaelweave commented 10 months ago

I looked at the mariner image we are using for latest - it should support apple silicone. I was incorrect there my bad.

The corrupted data exception mentioned in the first post could be a SQL error - can you try the default image again and provide the exception?

Also you should be able to build the docker file on Apple Silicone. You need to

docker build -f build/docker/Dockerfile -t azure-fhir-api --build-arg FHIR_VERSION=R4B --build-arg ASSEMBLY_VER=1.0.0 .

liammoat commented 9 months ago

I also ran into an issue with fhir-server on Apple Silicon which seems related to a W^X (write & execute) setting that was introduced in .NET 7 - this manifests when emulating x86/64.

I was able to identity a workaround. If you add DOTNET_EnableWriteXorExecute=0 as an environment variable on the fhir-api container, it runs okay (probably not recommended for production, but okay for local dev).

My docker-compose.yaml looks something like this:

version: "3"
services:
  fhir-api:
    image: "mcr.microsoft.com/healthcareapis/r4-fhir-server"
    restart: on-failure
    environment:
      FHIRServer__Security__Enabled: "false"
      SqlServer__ConnectionString: "Server=tcp:sql,1433;Initial Catalog=FHIR;Persist Security Info=False;User ID=sa;Password=${SAPASSWORD};MultipleActiveResultSets=False;Connection Timeout=30;TrustServerCertificate=true;"
      SqlServer__AllowDatabaseCreation: "true"
      SqlServer__Initialize: "true"
      SqlServer__SchemaOptions__AutomaticUpdatesEnabled: "true"
      DataStore: "SqlServer"
      DOTNET_EnableWriteXorExecute: 0
    ports:     
      - "8080:8080"
    depends_on:
      - sql
  sql:
    image: "mcr.microsoft.com/mssql/server"
    environment:
      SA_PASSWORD: ${SAPASSWORD}
      ACCEPT_EULA: "Y"
    healthcheck:
        test: ["CMD", "/opt/mssql-tools/bin/sqlcmd","-U sa -P ${SAPASSWORD} -Q 'SELECT * FROM INFORMATION_SCHEMA.TABLES'"]
        interval: 10s
        timeout: 10s
        retries: 6

@mikaelweave I'd be happy to collaborate and work a fix into the project for ARM64 scenarios 👍

tigloo commented 9 months ago

Sorry for not responding earlier, lost track of this during New Year.

@liammoat , thank you very much for the docker-compose.yaml! With your change the server seems to start and I can download a capability statement. I will use your version for our CI/CD setup.

mikaelweave commented 9 months ago

Thanks so much @liammoat for finding this!! We're currently in discussions on how to make this capability native without modifications to the compose file.