Error: The evaluation period has expired.

[aaronzhongg]

I have just pulled the image and tried to run it but getting the error below:

Image: mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest

Error: 2022-11-15 15:06:02 Error: The evaluation period has expired. 2022-11-15 15:06:02 ./cosmosdb-emulator: ERROR: PAL initialization failed. Error: 104

The only reference to this I could find online is: https://stackoverflow.com/questions/68187668/cosmos-db-emulator-for-linux-docker-this-is-an-evaluation-version-there-are-1

I attempted to remove the containers/images and pull the latest image again to no avail

[peitschie]

Thanks @DrDonoso , I can confirm that works!

@YvesDup just to clarify, docker rmi deletes the existing image (you might need to delete the container as well?), and the subsequent docker run then re-downloads the image.

This fixed the issue for me.

[sajeetharan]

Hello. This is 10 days later, the problem is still not resolved (and seems to have been over a month now without a resolution).

The lack of rapid resolution of this is making it very high-risk to depend on the docker-based emulator for any purpose.

What's the ETA on a fix h ere?

Apologies for any inconvenience caused. we are currently investigating the issue and are working on implementing a fix. We anticipate that the issue will be resolved within the next couple of weeks, with a tentative completion date set for the end of this month. We appreciate your patience and understanding in this.

[ollie-airways]

"within the next couple of weeks" for something you've known will break for 6 months, and presumably 6 months before that? I'm currently tasked with looking at moving from MongoDB Atlas to CosmosDB for my team, so it's not a great look..

[sajeetharan]

"within the next couple of weeks" for something you've known will break for 6 months, and presumably 6 months before that? I'm currently tasked with looking at moving from MongoDB Atlas to CosmosDB for my team, so it's not a great look..

I understand your frustration, would like to understand in what scenarios you use the emulator ? have you tried the try cosmosdb free account ?

[skgsergio]

Dev teams use it constantly for destroying and re-creating the environment locally.

Each developer having to setup a free CosmosDB in Azure is not helpful, also requires more work to cleanup it between test while developing.

The emulator having an artificial time limit is just plain stupid.

[sajeetharan]

I understand, We are actively working on it to get it fixed, until we get it fixed, you can try this approach.

[klemmchr]

Besides the time limit it is basically impossible to use the emulator since you often get a 503 of load gets too high. The only solution is to recreate the emulator which defeats any purpose of an emulator. We did switch to the hosted version of CosmosDB but this is a ugly solution.

[sajeetharan]

Thank you for your valuable feedback. We truly understand your frustration and apologize for any inconvenience caused. We acknowledge that the emulator has been in maintenance mode for a while, but we want to assure you that we have now shifted our focus towards addressing customer concerns.

We have recently initiated efforts to improve the emulator and resolve the issues you have highlighted. Our dedicated team is actively working on implementing the necessary fixes and improvements. We are committed to delivering a better experience to our customers, and you can expect these enhancements to be available in the near future.

We appreciate your patience and understanding as we strive to make the necessary improvements. If you have any further suggestions or feedback, please don't hesitate to let us know.

[DrDonoso]

Dev teams use it constantly for destroying and re-creating the environment locally.

Each developer having to setup a free CosmosDB in Azure is not helpful, also requires more work to cleanup it between test while developing.

The emulator having an artificial time limit is just plain stupid.

@skgsergio Probably for local development you can use the Cosmos Db local emulator (not docker image). I used it in the past and was really fast to remove all data and have a clean environment.

I believe it meets your requirement for a local environment (probably not a CI environment. So the team can work while the docker image is fixed.

[skgsergio]

Dev teams use it constantly for destroying and re-creating the environment locally.

Each developer having to setup a free CosmosDB in Azure is not helpful, also requires more work to cleanup it between test while developing.

The emulator having an artificial time limit is just plain stupid.

@skgsergio Probably for local development you can use the Cosmos Db local emulator (not docker image). I used it in the past and was really fast to remove all data and have a clean environment.

I believe it meets your requirement for a local environment (probably not a CI environment. So the team can work while the docker image is fixed.

We rely on docker-compose for the full environment, having to install a separate emulator is not helpful. Also doing a full destroy and re-creation of the environment requires more steps with the external emulator.

Also people that use Linux can't use it.

I'm not in the dev team, I'm in the SRE team, but if it were my call we wouldn't be using CosmosDB local development is painful.

[BrianVallelunga]

We also rely on docker-compose for our development and testing. Besides just bringing it out of maintenance mode, please update it to be more in line with the current functionality. For example, there's no support for hierarchical partition keys in the explorer, which is now GA. We're about to start development and need that feature.

[ollie-airways]

I understand your frustration, would like to understand in what scenarios you use the emulator ? have you tried the try cosmosdb free account ?

For the local dev environment.. We need to be on Macs for some iOS development (unfortunate but not uncommon) and we have all our other devops with Azure, so the account is fine. We all need to be able to spin up our own db's locally with docker compose and mess around with it without affecting anyone else. We're not gonna add a dev cluster for each person as that's just throwing money away, and we're not gonna all set up our own free accounts because that's annoying and inconsistent.

I'm not that bothered about it, we can still spin up a MongoDB image locally and doesn't seem like there'll be much difference, it's just as an outsider to CosmosDB looking at migrating, this particular issue that was so obviously going to happen - a public logic bomb basically - and there's no effort to fix it beforehand, and it'll take 2 weeks to fix it from here.. That, to me, just says this particular product isn't well supported at all, not enough for a dev team to rely on.

[YvesDup]

I understand your frustration, would like to understand in what scenarios you use the emulator ? have you tried the try cosmosdb free account ?

CosmosDb Docker is used for unit and integration tests with Linux Mint dev machines. Each dev stores his conf in a cosmosdb database and his own I/O datas.

As suggest, using a remote connection is not acceptable when you run hundred of tests every day. You should had wasted too much time. And emulator works only on a Win machine, not the environment for us.

[YvesDup]

tok, tok, tok: sorry to insist, but is there someone here ?

[FingolfinTEK]

Can't believe that this is still broken...

[davidguidali]

Yeah seems like its still broken. Seems like it'll become a meme.

[corwestermaniddink]

@sajeetharan

I understand, We are actively working on it to get it fixed, until we get it fixed, you can try this approach.

Can we get a update?

[jdoof]

facing the same issue now also above steps have not helped

[sajeetharan]

@sajeetharan

I understand, We are actively working on it to get it fixed, until we get it fixed, you can try this approach.

Can we get a update?

Thank you for your understanding and patience. We are actively working to resolve the issue and We will provide you with a comprehensive update by next week.

[jimseiwert]

So last update was two weeks ago stating there will be an update in a week. What is the update? Should we not use this emulator for reliable local dev?

[sajeetharan]

Docker Fixes for Mongo are being tested internally and we are targeting by the end of October, which will cover two main issues.

• The Evaluation Timer Error would be fixed by extending the timer will not throw an error and get in the way of running Mongo images.
• Both NoSQL & Mongo Docker Images would run.

[BrianVallelunga]

@sajeetharan Will the container get the newer UI and features such as hierarchical partition keys as well?

[noocyte]

And the "new" deadline is approaching... I really hope you guys manage to get it fixed in time! @sajeetharan

[sajeetharan]

@sajeetharan Will the container get the newer UI and features such as hierarchical partition keys as well?

No there will not be any new features in the next release. We are mainly targeting the bug fixes

[noocyte]

One week out - is there a new image on the way? @sajeetharan

[FingolfinTEK]

Almost a 1-year anniversary of the issue, I hope we see it concluded before the mark

[paltaie]

Don't make me throw a birthday party for this issue, Microsoft!

[sajeetharan]

We've made the release of a fresh Docker image, which include fixes for Mongo & NoSQL APIs. We encourage you to update to the latest version to ensure you have access to the most current and reliable release.

FROM

mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:mongodb   Should you encounter any issues, kindly report them by creating a new issue and providing detailed steps for reproduction, which will greatly assist our team in resolving them. We sincerely appreciate your patience and support.

[darena-patrick]

@sajeetharan looking for this release cant find the manifest in MCR anymore - was this intentional? Searching for cosmos on https://mcr.microsoft.com/ comes back empty

[abkolant-MSFT]

for this release cant find the manifest in MCR anymore - was this intentional? Searching for cosmos on https://mcr.microsoft.com/ comes back empty

@darena-patrick - The MCR docs are not yet added for the Cosmos DB Emulator, due to which you cannot see the image on https://mcr.microsoft.com/ registry.

Adding MCR docs is on the list of things we are fixing this semester. The docker pull / docker run commands should run fine irrespective of that.

If you're looking for docs, this link has the details.

[fakhrulhilal]

Hi, Is it still the same issue? I am unable to run the docker cosmos image:

2023-11-27 09:18:51 Failed to create CoreCLR, HRESULT: 0x8007000E
2023-11-27 09:18:47 This is an evaluation version.  There are [153] days left in the evaluation period.
2023-11-27 09:18:51 Starting
2023-11-27 09:19:16 Started 1/4 partitions
2023-11-27 09:19:18 Started 2/4 partitions
2023-11-27 09:19:21 Started 3/4 partitions
2023-11-27 09:19:25 This is an evaluation version.  There are [153] days left in the evaluation period.
2023-11-27 09:19:28 Starting
2023-11-27 09:19:29 Failed to create CoreCLR, HRESULT: 0x8007000E
2023-11-27 09:19:50 Started 1/4 partitions
2023-11-27 09:19:50 Started 2/4 partitions
2023-11-27 09:19:50 Started 3/4 partitions
2023-11-27 09:20:03 Started 4/4 partitions
2023-11-27 09:20:03 Started
2023-11-27 09:20:22 
2023-11-27 09:20:22 Unhandled Exception: System.AggregateException: One or more errors occurred. ---> System.ComponentModel.Win32Exception: The system cannot find the file specified
2023-11-27 09:20:22    at System.Diagnostics.Process.StartWithCreateProcess(ProcessStartInfo startInfo)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Common.ProcessUtil.Run(String fileName, String args)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Common.EtwManifest.<>c__DisplayClass7_0.<UnInstallEtwManifest>b__0()
2023-11-27 09:20:22    at Microsoft.Azure.Documents.BackoffRetryUtility`1.<ExecuteRetryAsync>d__5`2.MoveNext()
2023-11-27 09:20:22 --- End of stack trace from previous location where exception was thrown ---
2023-11-27 09:20:22    at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
2023-11-27 09:20:22    at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.BackoffRetryUtility`1.<ExecuteRetryAsync>d__5`2.MoveNext()
2023-11-27 09:20:22    --- End of inner exception stack trace ---
2023-11-27 09:20:22    at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Common.EtwManifest.UnInstallEtwManifest(String manifestFile)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Common.EtwManifest.InstallEtwManifest(String manifestFile)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Services.StartupEntryPoint.ServiceSetupHelper.InstallRuntimeSourceManifest(String manifestPath)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand.GatewayInit(CodePackageActivationContext context)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Services.StartupEntryPoint.GatewayServiceSetupCommand.<>c.<AddCommand>b__3_1()
2023-11-27 09:20:22    at Microsoft.Extensions.CommandLineUtils.CommandLineApplication.Execute(String[] args)
2023-11-27 09:20:22    at Microsoft.Azure.Documents.Services.StartupEntryPoint.ServiceStartupEntryPoint.Main(String[] args)
2023-11-27 09:20:22 Failed to create CoreCLR, HRESULT: 0x8007000E

Below is my docker compose:

  persistentserver:
    image: mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest
    container_name: cosmos
    mem_limit: 3GB
    ports:
     - "8081:8081"
     - "10250-10255:10250-10255"        
    environment:
      AZURE_COSMOS_EMULATOR_PARTITION_COUNT: 3
      AZURE_COSMOS_EMULATOR_ENABLE_DATA_PERSISTENCE: true

[sajeetharan]

Hi @fakhrulhilal please check this thread, https://github.com/Azure/azure-cosmos-db-emulator-docker/issues/77

[fakhrulhilal]

Hi @fakhrulhilal please check this thread, #77

The cosmos container is able to run after increasing to 4GB memory. But my app isn't able to connect to the service at all. The same problem occurs. I haven't fill the database at all. It's still fresh database.

Unhandled exception. Microsoft.Azure.Cosmos.CosmosException : Response status code does not indicate success: ServiceUnavailable (503); Substatus: 20002; ActivityId: 5bce8d93-e625-44a9-a206-50c6cab4c791; Reason: (Service is currently unavailable. More info: https://aka.ms/cosmosdb-tsg-service-unavailable. Network timeout or connectivity failure. 
ActivityId: 5bce8d93-e625-44a9-a206-50c6cab4c791, Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, Windows/10.0.22621 cosmos-netstandard-sdk/3.31.5);
 ---> Microsoft.Azure.Documents.GoneException: The requested resource is no longer available at the server.
ActivityId: 5bce8d93-e625-44a9-a206-50c6cab4c791, Windows/10.0.22621 cosmos-netstandard-sdk/3.31.5
   at Microsoft.Azure.Documents.TimeoutHelper.ThrowGoneIfElapsed()
   at Microsoft.Azure.Documents.StoreReader.ReadMultipleReplicasInternalAsync(DocumentServiceRequest entity, Boolean includePrimary, Int32 replicaCountToRead, Boolean requiresValidLsn, Boolean useSessionToken, ReadMode readMode, Boolean checkMinLSN, Boolean forceReadAll)
   at Microsoft.Azure.Documents.StoreReader.ReadMultipleReplicaAsync(DocumentServiceRequest entity, Boolean includePrimary, Int32 replicaCountToRead, Boolean requiresValidLsn, Boolean useSessionToken, ReadMode readMode, Boolean checkMinLSN, Boolean forceReadAll)
   at Microsoft.Azure.Documents.QuorumReader.ReadQuorumAsync(DocumentServiceRequest entity, Int32 readQuorum, Boolean includePrimary, ReadMode readMode)
   at Microsoft.Azure.Documents.QuorumReader.ReadStrongAsync(DocumentServiceRequest entity, Int32 readQuorumValue, ReadMode readMode)
   at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass31_0.<<InvokeAsync>b__0>d.MoveNext()
--- End of stack trace from previous location ---
   at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)
   --- End of inner exception stack trace ---
   at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)
   at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)
   at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy)
   at Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken)
   at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)
--- Cosmos Diagnostics ---{"Summary":{"DirectCalls":{"(410, 20001)":13},"GatewayCalls":{"(200, 0)":3}},"name":"CreateDatabaseIfNotExistsAsync","start datetime":"2023-11-27T07:36:15.413Z","duration in milliseconds":41142.538,"data":{"Client Configuration":{"Client Cr
eated Time Utc":"2023-11-27T07:36:15.2921986Z","MachineId":"hashedMachineName:16b4a7bd-ec08-d514-16bd-b6ff1702d336","NumberOfClientsCreated":1,"NumberOfActiveClients":1,"ConnectionMode":"Direct","User Agent":"cosmos-netstandard-sdk/3.36.0|1|X64|Microsoft Windows 10.
0.22621|.NET 7.0.14|DN|F 00000010|","ConnectionConfig":{"gw":"(cps:50, urto:6, p:False, httpf: True)","rntbd":"(cto: 5, icto: -1, mrpc: 30, mcpe: 65535, erd: True, pr: ReuseUnicastPort)","other":"(ed:True, be:False)"},"ConsistencyConfig":"(consistency: NotSet, prgns
:[], apprgn: )","ProcessorCount":16}},"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RequestInvokerHandler","duration in milliseconds":41127.2484,"children":[{"name":"Waiting for Initialization of client to complete","duration in milliseconds":105.9429},{"name
":"Microsoft.Azure.Cosmos.Handlers.DiagnosticsHandler","duration in milliseconds":41012.3146,"data":{"System Info":{"systemHistory":[{"dateUtc":"2023-11-27T07:36:15.3485505Z","cpu":2.294,"memory":21039448.000,"threadInfo":{"isThreadStarving":"no info","availableThre
ads":32764,"minThreads":16,"maxThreads":32767},"numberOfOpenTcpConnection":0},{"dateUtc":"2023-11-27T07:36:25.3670846Z","cpu":0.517,"memory":21181300.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.4444,"availableThreads":32765,"minThreads":1
6,"maxThreads":32767},"numberOfOpenTcpConnection":0},{"dateUtc":"2023-11-27T07:36:35.3749719Z","cpu":0.975,"memory":21473212.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.1108,"availableThreads":32765,"minThreads":16,"maxThreads":32767},"nu
mberOfOpenTcpConnection":0},{"dateUtc":"2023-11-27T07:36:45.3784125Z","cpu":1.397,"memory":21385280.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0782,"availableThreads":32765,"minThreads":16,"maxThreads":32767},"numberOfOpenTcpConnection":
0},{"dateUtc":"2023-11-27T07:36:55.3800636Z","cpu":2.899,"memory":21183884.000,"threadInfo":{"isThreadStarving":"False","threadWaitIntervalInMs":0.0407,"availableThreads":32765,"minThreads":16,"maxThreads":32767},"numberOfOpenTcpConnection":0}]}},"children":[{"name"
:"Microsoft.Azure.Cosmos.Handlers.TelemetryHandler","duration in milliseconds":41011.1608,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RetryHandler","duration in milliseconds":41009.4929,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.RouterHandler","du
ration in milliseconds":40999.9792,"children":[{"name":"Microsoft.Azure.Cosmos.Handlers.TransportHandler","duration in milliseconds":40998.6784,"children":[{"name":"Microsoft.Azure.Documents.ServerStoreModel Transport Request","duration in milliseconds":40982.4632,"
data":{"Client Side Request Stats":{"Id":"AggregatedClientSideRequestStatistics","ContactedReplicas":[],"RegionsContacted":[],"FailedReplicas":["rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/
"],"AddressResolutionStatistics":[{"StartTimeUTC":"2023-11-27T07:36:15.5969574Z","EndTimeUTC":"2023-11-27T07:36:15.6038789Z","TargetEndpoint":"https://localhost:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd"},{"StartTimeUTC":"2023-11-27T07:36:21.5541252
Z","EndTimeUTC":"2023-11-27T07:36:21.5624158Z","TargetEndpoint":"https://localhost:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd"},{"StartTimeUTC":"2023-11-27T07:36:50.5332505Z","EndTimeUTC":"2023-11-27T07:36:50.5403001Z","TargetEndpoint":"https://local
host:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd"}],"StoreResponseStatistics":[{"ResponseTimeUTC":"2023-11-27T07:36:21.5453533Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":
"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"Current
ReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":nul
l,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:
15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | s
tatus: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTi
meline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:15.6410552Z", "durationInMs": 4.0284},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:15.6450836Z", "durationInMs": 5890.8395},{"event": "Failed", "startTimeUtc": "2023-11-27T07
:36:21.5359231Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T0
7:36:21.5328253Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTime
UTC":"2023-11-27T07:36:21.5556075Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,
"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251
/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | stat
us: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/
11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(p
ort: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:15.6576243Z", "durationInMs": 0.2808},{"even
t": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:15.6579051Z", "durationInMs": 5877.9701},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:21.5358752Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"con
nectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:21.5328253Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], ba
se error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:27.5266499Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"htt
ps://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"S
essionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestC
harge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port
: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unkn
own | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 
07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:21.5568052Z", "durationInMs": 0.0119},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:21.5568171Z", "durationInMs": 5969.6749},
{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:27.5264920Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The
 connection attempt timed out. (Time: 2023-11-27T07:36:27.5258212Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.
0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:27.5267063Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone"
,"SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":fals
e,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown
 | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:
36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 
| status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T
07:36:21.5598257Z", "durationInMs": 0.0076},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:21.5598333Z", "durationInMs": 5966.5161},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:27.5263494Z", "durationInMs": 0}],"serviceEndpointStat
s":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:27.5258212Z, activity ID: 5bce8d93-e625-44a9-a206-50c
6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:33.5300393Z","ResourceType":"Databa
se","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLS
N":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-3
8c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | s
tatus: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 
27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)",
"(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:27.5267411Z", "durationInMs": 0.0089},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-
27T07:36:27.5267500Z", "durationInMs": 6003.0469},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:33.5297969Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"Transport
Exception":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:33.5296539Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:1025
1/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:33.5300749Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d9
3-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaS
etSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"Repli
caHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(p
ort: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: U
nknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":
[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:27.5269147Z", "durationInMs": 0.0047},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:27.5269194Z", "durationInMs": 6003.0769},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:33.5
299963Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:33.
5296539Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"20
23-11-27T07:36:39.5271794Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"Partiti
onKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/Do
cDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unkn
own | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 
07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 102
51 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:33.5300963Z", "durationInMs": 0.0055},{"event": "Cha
nnelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:33.5301018Z", "durationInMs": 5996.9553},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:39.5270571Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionS
tats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:39.5267724Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error
: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:39.5272584Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://loc
alhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionTo
ken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0
,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 
| status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lk
t: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15
)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:33.5301392Z", "durationInMs": 0.0006},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:33.5301398Z", "durationInMs": 5996.9321},{"event"
: "Failed", "startTimeUtc": "2023-11-27T07:36:39.5270719Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connect
ion attempt timed out. (Time: 2023-11-27T07:36:39.5267724Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:1025
1/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:44.5287434Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubSta
tusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"Store
PhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 
27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)",
"(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status
: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:39
.5273070Z", "durationInMs": 0.0084},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:39.5273154Z", "durationInMs": 5001.3502},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:44.5286656Z", "durationInMs": 0}],"serviceEndpointStats":{"inf
lightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:44.5284245Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c79
1, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:44.5287920Z","ResourceType":"Database","Ope
rationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"U
singLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6
-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: U
nknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/20
23 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 
10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:39.5273902Z", "durationInMs": 0.0025},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36
:39.5273927Z", "durationInMs": 5001.2604},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:44.5286531Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportExceptio
n":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:44.5284245Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, conn
ection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:50.5159023Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-4
4a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":
-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealth
Statuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 102
51 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown |
 lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:15)"],"transportRequestTimeline":{"requestTimeline":[{"event
": "Created", "startTimeUtc": "2023-11-27T07:36:44.5289873Z", "durationInMs": 0.0206},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:44.5290079Z", "durationInMs": 5986.8229},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:50.5158308Z"
, "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:50.5156421Z
, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27
T07:36:56.5296715Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:8081/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRan
geId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/s
ervices/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAfterInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lk
t: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50
)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | sta
tus: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)"],"transportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:50.5410989Z", "durationInMs": 0.007},{"event": "ChannelAcqui
sitionStarted", "startTimeUtc": "2023-11-27T07:36:50.5411059Z", "durationInMs": 5988.2046},{"event": "Failed", "startTimeUtc": "2023-11-27T07:36:56.5293105Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":1,"openConnections":1},"connectionStats":{"w
aitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attempt timed out. (Time: 2023-11-27T07:36:56.5289565Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT
 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, payload sent: False)"}},{"ResponseTimeUTC":"2023-11-27T07:36:56.5297602Z","ResourceType":"Database","OperationType":"Read","LocationEndpoint":"https://localhost:80
81/","StoreResult":{"ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"Gone","SubStatusCode":"TransportGenerated410","LSN":-1,"PartitionKeyRangeId":null,"GlobalCommittedLSN":-1,"ItemLSN":-1,"UsingLocalLSN":false,"QuorumAckedLSN":-1,"SessionToken":null
,"CurrentWriteQuorum":-1,"CurrentReplicaSetSize":-1,"NumberOfReadRegions":-1,"IsValid":false,"StorePhysicalAddress":"rntbd://172.18.0.7:10251/apps/DocDbApp/services/DocDbMaster0/partitions/780e44f4-38c8-11e6-8106-8cdcd42c33be/replicas/1p/","RequestCharge":0,"RetryAf
terInMs":null,"BELatencyInMs":null,"ReplicaHealthStatuses":["(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status:
 Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/
2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)","(port: 10251 | status: Unknown | lkt: 27/11/2023 07:36:50)"],"tran
sportRequestTimeline":{"requestTimeline":[{"event": "Created", "startTimeUtc": "2023-11-27T07:36:50.5411754Z", "durationInMs": 0.0021},{"event": "ChannelAcquisitionStarted", "startTimeUtc": "2023-11-27T07:36:50.5411775Z", "durationInMs": 5988.3479},{"event": "Failed
", "startTimeUtc": "2023-11-27T07:36:56.5295254Z", "durationInMs": 0}],"serviceEndpointStats":{"inflightRequests":2,"openConnections":1},"connectionStats":{"waitforConnectionInit":"True"}},"TransportException":"A client transport error occurred: The connection attem
pt timed out. (Time: 2023-11-27T07:36:56.5289565Z, activity ID: 5bce8d93-e625-44a9-a206-50c6cab4c791, error code: ConnectTimeout [0x0006], base error: HRESULT 0x80131500, URI: rntbd://172.18.0.7:10251/, connection: <not connected> -> rntbd://172.18.0.7:10251/, paylo
ad sent: False)"}}],"HttpResponseStats":[{"StartTimeUTC":"2023-11-27T07:36:15.5985022Z","DurationInMs":4.1431,"RequestUri":"https://localhost:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd","ResourceType":"Database","HttpMethod":"GET","ActivityId":"5bce8
d93-e625-44a9-a206-50c6cab4c791","StatusCode":"OK"},{"StartTimeUTC":"2023-11-27T07:36:21.5541708Z","DurationInMs":3.9698,"RequestUri":"https://localhost:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd","ResourceType":"Database","HttpMethod":"GET","Activit
yId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"OK"},{"StartTimeUTC":"2023-11-27T07:36:50.5332849Z","DurationInMs":6.9258,"RequestUri":"https://localhost:8081//addresses/?$resolveFor=dbs&$filter=protocol eq rntbd","ResourceType":"Database","HttpMethod":"GE
T","ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","StatusCode":"OK"}]},"Point Operation Statistics":{"Id":"PointOperationStatistics","ActivityId":"5bce8d93-e625-44a9-a206-50c6cab4c791","ResponseTimeUtc":"2023-11-27T07:36:56.5401873Z","StatusCode":503,"SubStatus
Code":20002,"RequestCharge":0,"RequestUri":"dbs/eprocure","ErrorMessage":"Microsoft.Azure.Documents.ServiceUnavailableException: Service is currently unavailable. More info: https://aka.ms/cosmosdb-tsg-service-unavailable. Network timeout or connectivity failure. \r
\nActivityId: 5bce8d93-e625-44a9-a206-50c6cab4c791, Microsoft.Azure.Cosmos.Tracing.TraceData.ClientSideRequestStatisticsTraceDatum, Windows/10.0.22621 cosmos-netstandard-sdk/3.31.5\r\n ---> Microsoft.Azure.Documents.GoneException: The requested resource is no longer
 available at the server.\r\nActivityId: 5bce8d93-e625-44a9-a206-50c6cab4c791, Windows/10.0.22621 cosmos-netstandard-sdk/3.31.5\r\n   at Microsoft.Azure.Documents.TimeoutHelper.ThrowGoneIfElapsed()\r\n   at Microsoft.Azure.Documents.StoreReader.ReadMultipleReplicasI
nternalAsync(DocumentServiceRequest entity, Boolean includePrimary, Int32 replicaCountToRead, Boolean requiresValidLsn, Boolean useSessionToken, ReadMode readMode, Boolean checkMinLSN, Boolean forceReadAll)\r\n   at Microsoft.Azure.Documents.StoreReader.ReadMultiple
ReplicaAsync(DocumentServiceRequest entity, Boolean includePrimary, Int32 replicaCountToRead, Boolean requiresValidLsn, Boolean useSessionToken, ReadMode readMode, Boolean checkMinLSN, Boolean forceReadAll)\r\n   at Microsoft.Azure.Documents.QuorumReader.ReadQuorumA
sync(DocumentServiceRequest entity, Int32 readQuorum, Boolean includePrimary, ReadMode readMode)\r\n   at Microsoft.Azure.Documents.QuorumReader.ReadStrongAsync(DocumentServiceRequest entity, Int32 readQuorumValue, ReadMode readMode)\r\n   at Microsoft.Azure.Documen
ts.ReplicatedResourceClient.<>c__DisplayClass31_0.<<InvokeAsync>b__0>d.MoveNext()\r\n--- End of stack trace from previous location ---\r\n   at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1
 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\r\n   --- End of inner exception stack trace ---\r\n   at Microsoft.Azure.Documents.ShouldRetryRes
ult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)\r\n   at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancell
ationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)\r\n   at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy)\r\n   at
 Microsoft.Azure.Cosmos.Handlers.TransportHandler.ProcessMessageAsync(RequestMessage request, CancellationToken cancellationToken)\r\n   at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)","RequestSessionToken":null,"ResponseSessionToken":null,"BELatencyInMs":null}}}]}]}]}]}]}]}]}

[fakhrulhilal]

I'm seeing this error again today. Should we wait for the patch again?

docker run \
    --publish 8081:8081 \
    --publish 10250-10255:10250-10255 \
    --interactive \
    --tty \
    mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest
Error: The evaluation period has expired.
./cosmosdb-emulator: ERROR: PAL initialization failed. Error: 104

[v1k1]

Hey @fakhrulhilal, the Cosmos Db Linux docker image mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest has been published regularly for some time now. This seems to be a case of caching of stale images at your end.

Please delete any existing image at your workstation and do a fresh docker pull. If you cache these images in any internal container repository, please refresh that as well.

[fakhrulhilal]

Hey @fakhrulhilal, the Cosmos Db Linux docker image mcr.microsoft.com/cosmosdb/linux/azure-cosmos-emulator:latest has been published regularly for some time now. This seems to be a case of caching of stale images at your end.

Please delete any existing image at your workstation and do a fresh docker pull. If you cache these images in any internal container repository, please refresh that as well.

Alright, it looks like I have to refresh my docker cached image regularly now. I can confirm it's working, using the guide you provide. Thanks.