search

aneoconsulting / ArmoniK.Core

Task manager for ArmoniK (submission, scheduling, IO data, monitoring). Implements API located in https://github.com/aneoconsulting/ArmoniK.Api
https://aneoconsulting.github.io/ArmoniK.Core/
GNU Affero General Public License v3.0
10 stars 8 forks source link

Unable to deploy the control plane #367

Closed esoubiran-aneo closed 1 year ago

esoubiran-aneo commented 1 year ago

I trying to deploy ArmoniK (main branch) with control plane on version 0.14.0-SNAPSHOT.115.fe4acccb but I got this issue.

Running make deploy-all in infrastructure/quick-deploy/localhost.

Logs

``` {"@t":"2023-05-31T07:38:19.7790610Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Control.Submitter.Program","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Control.Submitter.Program, ArmoniK.Core.Control.Submitter, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:19.7936446Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Common.gRPC.Services.Submitter","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Common.gRPC.Services.Submitter, ArmoniK.Core.Common, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:19.7938628Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Base.HealthCheck","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Base.HealthCheck, ArmoniK.Core.Base, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:19.9873724Z","@mt":"MongoDB configuration complete","SourceContext":"root","host":"mongodb-0.armonik","port":27017,"MongoDB configuration.Scope":"e79f9cba-efae-47ee-b9e8-e282b11c5ec7","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:19.9897841Z","@mt":"Configure MongoDB Components","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:19.9947122Z","@mt":"Queue settings for loading adapter {@queueSettings}","queueSettings":{"AdapterAbsolutePath":"/adapters/queue/amqp/ArmoniK.Core.Adapters.Amqp.dll","ClassName":"ArmoniK.Core.Adapters.Amqp.QueueBuilder","$type":"AdapterSettings"},"SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.0047182Z","@mt":"Loaded assembly {assemblyName}","assemblyName":"ArmoniK.Core.Adapters.Amqp, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.0088062Z","@mt":"Configure Amqp client","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.0149402Z","@mt":"Amqp configuration complete","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.6752384Z","@mt":"Get address for session","SourceContext":"ArmoniK.Core.Adapters.Amqp.ConnectionAmqp","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.8001570Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.PartitionData already exists..\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"PartitionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.8621029Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.Result already exists..\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"Result","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.8822299Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.TaskData already exists..\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.8951305Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:20.8971254Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.SessionData already exists..\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"SessionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:21.8971552Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:23.9021461Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:26.8928857Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} {"@t":"2023-05-31T07:38:30.8993499Z","@mt":"Host terminated unexpectedly","@l":"Fatal","@x":"System.TimeoutException: Init Indexes for TaskData: Max retries reached\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 168\n at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.Init(CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 92\n at ArmoniK.Core.Control.Submitter.Program.Main(String[] args) in /src/Control/Submitter/src/Program.cs:line 223","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"} ```

esoubiran-aneo commented 1 year ago

@aneojgurhem it seems related to indexes. I will try to use a previous version.

esoubiran-aneo commented 1 year ago

It works fine with a previous version

0.14.0-SNAPSHOT.101.70abad83

esoubiran-aneo commented 1 year ago

try to update mongo in versions.tfvars.json (in infra) to 6.0.5

esoubiran-aneo commented 1 year ago

@aneojgurhem I update to version 6.0.5 in /infrastructure/quick-deploy/localhost/storage/parameters.tfvars and still get the error with 0.14.0-SNAPSHOT.115.fe4acccb

Error 

{"@t":"2023-06-02T09:54:11.6292382Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Control.Submitter.Program","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Control.Submitter.Program, ArmoniK.Core.Control.Submitter, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.6386597Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Common.gRPC.Services.Submitter","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Common.gRPC.Services.Submitter, ArmoniK.Core.Common, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.6388433Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Base.HealthCheck","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Base.HealthCheck, ArmoniK.Core.Base, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.7841528Z","@mt":"MongoDB configuration complete","SourceContext":"root","host":"mongodb-0.armonik","port":27017,"MongoDB configuration.Scope":"6be3715a-cfd6-470b-94a7-bedb6b51af5a","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.7877596Z","@mt":"Configure MongoDB Components","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.8029382Z","@mt":"Queue settings for loading adapter {@queueSettings}","queueSettings":{"AdapterAbsolutePath":"/adapters/queue/amqp/ArmoniK.Core.Adapters.Amqp.dll","ClassName":"ArmoniK.Core.Adapters.Amqp.QueueBuilder","$type":"AdapterSettings"},"SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.8150935Z","@mt":"Loaded assembly {assemblyName}","assemblyName":"ArmoniK.Core.Adapters.Amqp, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.8167162Z","@mt":"Configure Amqp client","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:11.8231012Z","@mt":"Amqp configuration complete","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.4751823Z","@mt":"Get address for session","SourceContext":"ArmoniK.Core.Adapters.Amqp.ConnectionAmqp","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.6086996Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.PartitionData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"PartitionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.6628904Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.TaskData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.7048265Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.7067499Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.Result already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"Result","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:12.7223729Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.SessionData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"SessionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:13.7108985Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:15.7259314Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T09:54:18.7254606Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
esoubiran-aneo commented 1 year ago

De même avec 0.14.0-SNAPSHOT.126.32935a6e

esoubiran-aneo commented 1 year ago

Ne fonctionne pas avec 0.14.0-SNAPSHOT.103.aa37cd02 (https://github.com/aneoconsulting/ArmoniK.Core/commit/cbe7cee914dc37260a5aaa2d5f783a1a49c910b9)

Details 

{"@t":"2023-06-02T10:09:39.5086498Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Control.Submitter.Program","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Control.Submitter.Program, ArmoniK.Core.Control.Submitter, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.5173561Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Common.gRPC.Services.Submitter","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Common.gRPC.Services.Submitter, ArmoniK.Core.Common, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.5174971Z","@mt":"Version of {class} is {version} ({qualifiedName})","class":"ArmoniK.Core.Base.HealthCheck","version":"0.14.0.0","qualifiedName":"ArmoniK.Core.Base.HealthCheck, ArmoniK.Core.Base, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6559722Z","@mt":"MongoDB configuration complete","SourceContext":"root","host":"mongodb-0.armonik","port":27017,"MongoDB configuration.Scope":"eb943372-0c37-48da-8c95-4c631b2288d1","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6587546Z","@mt":"Configure MongoDB Components","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6643171Z","@mt":"Queue settings for loading adapter {@queueSettings}","queueSettings":{"AdapterAbsolutePath":"/adapters/queue/amqp/ArmoniK.Core.Adapters.Amqp.dll","ClassName":"ArmoniK.Core.Adapters.Amqp.QueueBuilder","$type":"AdapterSettings"},"SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6745552Z","@mt":"Loaded assembly {assemblyName}","assemblyName":"ArmoniK.Core.Adapters.Amqp, Version=0.14.0.0, Culture=neutral, PublicKeyToken=null","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6756664Z","@mt":"Configure Amqp client","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:39.6796381Z","@mt":"Amqp configuration complete","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.3268140Z","@mt":"Get address for session","SourceContext":"ArmoniK.Core.Adapters.Amqp.ConnectionAmqp","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.4466882Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.PartitionData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"PartitionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.5573980Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.TaskData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.6159984Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.6178812Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.Result already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"Result","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:40.6348123Z","@mt":"Use already existing instance of Collection {CollectionName}","@x":"MongoDB.Driver.MongoCommandException: Command create failed: Collection database.SessionData already exists..\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateCollectionOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.ExecuteWriteOperationAsync[T](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.CreateCollectionAsync(IClientSessionHandle session, String name, CreateCollectionOptions options, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoDatabaseImpl.UsingImplicitSessionAsync(Func`2 funcAsync, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 111","CollectionName":"SessionData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:41.6218585Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:43.6273744Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:46.6290292Z","@mt":"Retrying to Initialize indexes for {CollectionName} collection","@x":"MongoDB.Driver.MongoCommandException: Command createIndexes failed: Index already exists with a different name: statusIndex.\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ProcessResponse(ConnectionId connectionId, CommandMessage responseMessage)\n   at MongoDB.Driver.Core.WireProtocol.CommandUsingCommandMessageWireProtocol`1.ExecuteAsync(IConnection connection, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Servers.Server.ServerChannel.ExecuteProtocolAsync[TResult](IWireProtocol`1 protocol, ICoreSession session, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CommandOperationBase`1.ExecuteProtocolAsync(IChannelSource channelSource, ICoreSessionHandle session, ReadPreference readPreference, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.WriteCommandOperation`1.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.Core.Operations.CreateIndexesOperation.ExecuteAsync(IWriteBinding binding, CancellationToken cancellationToken)\n   at MongoDB.Driver.OperationExecutor.ExecuteWriteOperationAsync[TResult](IWriteBinding binding, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.ExecuteWriteOperationAsync[TResult](IClientSessionHandle session, IWriteOperation`1 operation, CancellationToken cancellationToken)\n   at MongoDB.Driver.MongoCollectionImpl`1.MongoIndexManager.CreateManyAsync(IClientSessionHandle session, IEnumerable`1 models, CreateManyIndexesOptions options, CancellationToken cancellationToken)\n   at ArmoniK.Core.Adapters.MongoDB.Table.DataModel.TaskDataModelMapping.InitializeIndexesAsync(IClientSessionHandle sessionHandle, IMongoCollection`1 collection) in /src/Adaptors/MongoDB/src/Table/DataModel/TaskDataModelMapping.cs:line 205\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 150","CollectionName":"TaskData","SourceContext":"MongoDB.Driver.IMongoCollection","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
{"@t":"2023-06-02T10:09:50.6234419Z","@mt":"Host terminated unexpectedly","@l":"Fatal","@x":"System.TimeoutException: Init Indexes for TaskData: Max retries reached\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.InitializeAsync(MongoDB options, SessionProvider sessionProvider, IMongoDatabase mongoDatabase, ILogger`1 logger, CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 168\n   at ArmoniK.Core.Adapters.MongoDB.Common.MongoCollectionProvider`2.Init(CancellationToken cancellationToken) in /src/Adaptors/MongoDB/src/Common/MongoCollectionProvider.cs:line 92\n   at ArmoniK.Core.Control.Submitter.Program.Main(String[] args) in /src/Control/Submitter/src/Program.cs:line 223","SourceContext":"root","Application":"ArmoniK.Control.Submitter","CoreVersion":"0.14.0.0"}
melflitty-aneo commented 1 year ago

@esoubiran-aneo did you mean that you changed only the version of control plane? Control plane is 0.14.0-SNAPSHOT.115.fe4acccb and other components of Core are at 0.13.1?

esoubiran-aneo commented 1 year ago

I update control_plane and the worker!

dbrasseur-aneo commented 1 year ago

Has this been fixed ?

melflitty-aneo commented 1 year ago

No. But I got the same error when mixing versions: when I used the version 0.13.1 for the submitter and the polling agent and the other Components of Core are at 0.14.0-SNAPSHOT.103.aa37cd02 . It seems that there is a change between 0.13.1 and 0.14.0-SNAPSHOT.103.aa37cd02 that causes this incompatibility. For me, I avoided this problem by using the same version everywhere.

esoubiran-aneo commented 1 year ago

No. But I got the same error when mixing versions: when I used the version 0.13.1 for the submitter and the polling agent and the other Components of Core are at 0.14.0-SNAPSHOT.103.aa37cd02 . It seems that there is a change between 0.13.1 and 0.14.0-SNAPSHOT.103.aa37cd02 that causes this incompatibility. For me, I avoided this problem by using the same version everywhere.

Could you tell me more? In fact, I could miss some version to update. Currently, I update version of control_plane and worker in parameters.tfvars and there is only 2 versions to change.

melflitty-aneo commented 1 year ago

Did you change the version of Core in versions.tfvars.json(located at the root of the ArmoniK repository)?

No. But I got the same error when mixing versions: when I used the version 0.13.1 for the submitter and the polling agent and the other Components of Core are at 0.14.0-SNAPSHOT.103.aa37cd02 . It seems that there is a change between 0.13.1 and 0.14.0-SNAPSHOT.103.aa37cd02 that causes this incompatibility. For me, I avoided this problem by using the same version everywhere.

Could you tell me more? In fact, I could miss some version to update. Currently, I update version of control_plane and worker in parameters.tfvars and there is only 2 versions to change.

esoubiran-aneo commented 1 year ago

No, I did not. Should I?

melflitty-aneo commented 1 year ago

I think you should

esoubiran-aneo commented 1 year ago

I've try https://github.com/aneoconsulting/ArmoniK/pull/1163 and it seems it work fine now.

lemaitre-aneo commented 1 year ago

For information, this can happen if the core components have different versions and those versions have distinct index configurations. In particular, the following components must have the same version: