search

ProgrammeVitam / vitam

Digital Archives Management System developped by French government/Programme interministériel archives numériques ; core system.
CeCILL Free Software License Agreement v2.1
123 stars 41 forks source link

Erreur Storage S3 #15

Closed bxaxa closed 3 years ago

bxaxa commented 5 years ago

Bonjour, j'ai un soucis à l'installation quand j'essais d'utiliser un storage S3.

Traces Ansible

TASK [init_contexts_and_security_profiles : Import admin security profile to functionnal-administration] ******************************************************************************************************************************************************************
fatal: [small-vm-2]: FAILED! => {"changed": false, "connection": "close", "content": "{\"httpCode\":400,\"code\":\"400\",\"context\":\"ADMIN_MODULE\",\"state\":\"code_vitam\",\"message\":\"Bad Request\",\"description\":\"Internal Server Error\"}", "content_length": "137", "content_type": "application/json", "elapsed": 8, "json": {"code": "400", "context": "ADMIN_MODULE", "description": "Internal Server Error", "httpCode": 400, "message": "Bad Request", "state": "code_vitam"}, "msg": "Status code was 400 and not [200, 201]: HTTP Error 400: Bad Request", "redirected": false, "status": 400, "url": "http://10.64.54.7:18004/v1/admin/securityprofiles"}

mon hosts.small

##### Zone storage

[zone-storage:children]
hosts-storage-offer-default
hosts-mongodb-offer

[hosts-storage-offer-default]
small-vm-3 offer_conf=offer-s3-1

[hosts-mongodb-offer:children]
hosts-mongos-offer
hosts-mongoc-offer
hosts-mongod-offer

[hosts-mongos-offer]
small-vm-3    mongo_cluster_name=offer-s3-1

[hosts-mongoc-offer]
small-vm-3    mongo_cluster_name=offer-s3-1                       mongo_rs_bootstrap=true

[hosts-mongod-offer]
small-vm-3    mongo_cluster_name=offer-s3-1   mongo_shard_id=0    mongo_rs_bootstrap=true

mon offers_opts.yaml (les partie S3)

# This list is ordered. It can and has to be completed if more offers are necessary
# Strategy order (1st has to be the prefered one)
vitam_strategy:
  #- name: offer-fs-1
  #  referent: true
  - name: offer-s3-1
    referent: true

  offer-s3-1:
    # provider : can only be amazon-s3-v1 for Amazon SDK S3 V1
    provider: 'amazon-s3-v1'
    # s3Endpoint :  : URL of connection to S3
    s3Endpoint: https://vit.s3.fr-par.scw.cloud
    # s3RegionName (optional):  Region name (default value us-east-1)
    s3RegionName: fr-par
    #s3SignerType (optional):  Signing algorithm.
    #  - signature V4 : 'AWSS3V4SignerType'
    #     - signature V2 : 'S3SignerType'
    s3SignerType: AWSS3V4SignerType
    # s3PathStyleAccessEnabled (optional):  'true' to access bucket in "path-style", else "virtual-hosted-style" (false by default in java client, true by default in ansible scripts)
    s3PathStyleAccessEnabled: true
    # s3MaxConnections (optional): Max total connection (concurrent connections) (50 by default)
    s3MaxConnections: 50
    # s3ConnectionTimeout (optional): Max time (in milliseconds) for waiting to establish connection (10000 by default)
    s3ConnectionTimeout: 10000
    # s3SocketTimeout (optional): Max time (in milliseconds) for reading from a connected socket (50000 by default)
    s3SocketTimeout: 50000
    # s3RequestTimeout (optional): Max time (in milliseconds) for a request (0 by default, disabled)
    s3RequestTimeout: 0
    # s3ClientExecutionTimeout (optional): Max time (in milliseconds) for a request by java client (0 by default, disabled)
    s3ClientExecutionTimeout: 0

Dans consul tout est "vert" (je ne sais pas ou regarder pour trouver d'autre infos.

Auriez vous une idée ?

Merci

croftophile commented 5 years ago

Bonjour, L'import des "security profiles" fait fonctionner toute la chaîne sous-jacente (jusqu'aux offres). Il y a de fortes probabilités, effectivement, qu'il y ait un problème de "offer". Avez-vous bien renseigné le fichier deployment/group_vars/all/vault-vitam.yml (section vitam_offers,par défaut commentée). Pour analyser, nous vous recommandons également de regarder les log (/vitam/log//) des composants "storage" et "offer".

Merci d'avance de votre retour, Olivier

bxaxa commented 5 years ago

Bonjour, Voici quelques logs, de ce que je comprend, j'ai un socuis de certificat. Je n'ai pas le CA des API S3. Si c'est bien ça, je vais voir avec Scaleway pour essayer de le trouver.

environments/group_vars/all/vault-vitam.yml

vitam_offers:
  offer-s3-1:
    s3AccessKey: XXXXXXXXXXXXXXXXXXXXXXXXX
    s3SecretKey: YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY

/vitam/log/storage/storage-log# cat 8_20190823080041650_3a360d45-70a5-487b-84c9-008192ac32a3.log

root@vitam-test-small-vm-1:/vitam/log/storage/storage-log# cat 8_20190823080041650_3a360d45-70a5-487b-84c9-008192ac32a3.log
{"eventDateTime":"2019-08-23T08:00:42.004","tenantId":"8","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"storagelog","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.65.2.71","outcome":"KO"}
{"eventDateTime":"2019-08-23T08:00:42.369","tenantId":"8","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
{"eventDateTime":"2019-08-23T08:10:20.427","xRequestId":"aecaaaaabceb6ybeaaryualmxwdk22aaaaaq","tenantId":"8","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
{"eventDateTime":"2019-08-23T09:00:14.707","xRequestId":"aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq","tenantId":"8","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
{"eventDateTime":"2019-08-23T09:00:15.183","xRequestId":"aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq","tenantId":"8","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
root@vitam-test-small-vm-1:/vitam/log/storage/storage-log# cat 5_20190823074618105_0d1ea544-d658-4f51-8487-dbbfde73266d.log
{"eventDateTime":"2019-08-23T08:00:23.742","xRequestId":"aecaaaaaawgfpiaeaa7tgalmxv62e2yaaaaq","tenantId":"5","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
{"eventDateTime":"2019-08-23T08:00:24.483","tenantId":"5","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"storageaccesslog","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.65.2.71","outcome":"KO"}
{"eventDateTime":"2019-08-23T08:00:25.056","tenantId":"5","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}
{"eventDateTime":"2019-08-23T08:00:26.760","xRequestId":"aecaaaaaawgfpiaeaa7tgalmxv62e2yaaaaq","tenantId":"5","eventType":"CREATE","objectIdentifier":"objectRequest NA","dataCategory":"backup_operation","objectGroupIdentifier":"objGId NA","digest":"messageDigest NA","digestAlgorithm":"SHA-512","size":"Size NA","agentIdentifiers":"offer-s3-1.service.local.consul attempt 3 : KO","agentIdentifierRequester":"10.64.54.7","outcome":"KO"}

storage.2019-08-23.0.log

root@vitam-test-small-vm-1:/vitam/log/storage# tail -f  storage.2019-08-23.0.log
2019-08-23 09:00:15,191 [[vitam-thread-90]] [aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.buildStoreDataResponse(StorageDistributionImpl.java:662) : [vitam-test-small-vm-1:storage:136273956] [100505] Could not store object with id 'aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq' on offers 'offer-s3-1.service.local.consul'
2019-08-23 09:00:15,193 [[vitam-thread-90]] [aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq] ERROR fr.gouv.vitam.storage.engine.server.rest.StorageResource - Caller+1     at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1359) : [vitam-test-small-vm-1:storage:136273956]  fr.gouv.vitam.storage.engine.common.exception.StorageTechnicalException: [100505] Could not store object with id 'aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq' on offers 'offer-s3-1.service.local.consul'
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.buildStoreDataResponse(StorageDistributionImpl.java:664)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.storeDataInAllOffers(StorageDistributionImpl.java:449)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1349)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createOrUpdateBackupOperation(StorageResource.java:695)
        at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

offer.2019-08-23.0.log

root@vitam-test-small-vm-3:/vitam/log/offer# tail -f  offer.2019-08-23.0.log
2019-08-23 09:00:15,167 [[vitam-thread-98]] [aecaaaaabcgfpiaeaa7tgalmxw2g6giaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:139960356] Cannot create object sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
        at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
        at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)
        ... 94 common frames omitted
Wrapped by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)
        at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
        at sun.security.validator.Validator.validate(Validator.java:262)
        at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:330)
        at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:237)
        at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:132)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
        ... 88 common frames omitted
Wrapped by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
        at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
        at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
        at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)
        at sun.security.ssl.Handshaker.process_record(Handshaker.java:965)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:404)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:364)
        at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
        at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
        at com.amazonaws.http.conn.$Proxy20.connect(Unknown Source)
        at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1286)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        ... 63 common frames omitted
Wrapped by: com.amazonaws.SdkClientException: Unable to execute HTTP request: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1164)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1110)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.getAcl(AmazonS3Client.java:3835)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1216)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1206)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExistV2(AmazonS3Client.java:1342)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:202)
        ... 50 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to check existance of container
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:208)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:179)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
croftophile commented 5 years ago

Nous confirmons, il vous faut référencer la CA de votre fournisseur "stockage objet" pour que la connexion puisse fonctionner. Le fichier sera à positionner dans (deployment/environments/)certs/clien-storage/ca. Se référer à cette documentation : http://www.programmevitam.fr/ressources/DocCourante/html/installation/annexes/10-overview_certificats.html#description-de-l-arborescence-du-repertoire-deployment-environments-certs pour plus d'informations. Il faudra également repasser la PKI avant de relancer un déploiement.

bxaxa commented 5 years ago

Bonjour, j'ai reuçu le CA de scaleway, et la connexion semble OK. Par contre j'ai un autre soucis.

t fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:139960356] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: txad29f6ee0080414f8c2bd-005d5ff51b; S3 Extended Request ID: null)

Est-ce que le nom du bucket est défini en dur à "vitam" ?

croftophile commented 5 years ago

Re-, Sur le composant offer, avez-vous plus de log à nous communiquer ?

Le composant offer crée le "bucket", si celui-ci n'existe pas déjà, au moment de stocker de façon pérenne l'objet reçu, selon la nomenclature décrite dans le DAT (et prenant en compte les spécificités s3 ) : http://www.programmevitam.fr/ressources/DocCourante/html/archi/archi-exploit-infra/04-data-storage.html#offre-s3 . La liste des containers utilisés par VITAM est :http://www.programmevitam.fr/ressources/DocCourante/html/exploitation/include/storage/storage-offer-default/presentation.html?highlight=container#presentation, sachant que pour s3, les caractères non alphanumériques sont remplacés par des ".". Cordialement,

bxaxa commented 5 years ago

petite erreur de ma part entre temps dans mon nouveau test, quand j'ai modifié l'url dans la conf, j'ai oublié le S de https. J'ai toujours un soucis de certificat.

Scaleway m'a livré deux CA

J'ai du mal à comprendre la documentation sur ce sujet précis. Quel est le nom du fichier qui contient le CA . Est-ce que la version crypté only suffit ?

Les CA que j'ai reçu sont de la forme :

-----BEGIN CERTIFICATE-----
MIIF8DCCA9igAwIBAgICAQAwDQYJKoZIhvcNAQELBQAwcjELMAkGA1UEBhMCZnIx
DDAKBgNVBAgMA2lkZjEOMAwGA1UEBwwFcGFyaXMxDjAMBgNVBAoMBXZpdGFtMRQw
EgYDVQQLDAthdXRob3JpdGllczEfMB0GA1UEAwwWY2Ffcm9vdF9jbGllbnQtc3Rv
cmFnZTAeFw0xOTA4MjMxMzU4MzZaFw0yOTA4MjAxMzU4MzZaMHIxCzAJBgNVBAYT
AmZyMQwwCgYDVQQIDANpZGYxDjAMBgNVBAcMBXBhcmlzMQ4wDAYDVQQKDAV2aXRh
bTEUMBIGA1UECwwLYXV0aG9yaXRpZXMxHzAdBgNVBAMMFmNhX3Jvb3RfY2xpZW50
LXN0b3JhZ2UwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoICAQDY+Z8Bb5M/
UjiAP9zwJkzkC9upnRvnov+ebbpuH6mAdhKdvGRxNu4Ej6Knylm4LcERMcYrL1H4
pZC1J0VeVKA+Kvo2TIj1J3P3ke9YmWL/lTodhvDuDDjQ+xb3vJ6RAiuFaOyfqvrE
dQKiDuVHNVm6eaODlHVC8NBHM0SbMPQOWQmhYqOShRs8MYlV92o83YKfA5xh2gPQ
/CyGe4+HjjwOJ/KZCEHzl7M05cuheR0IvjiQhAvvpysowwTMma+8kMQ8hXrk5OZJ
nB8uoCjpcg8KqidKj56CP+J+tr+Tk9tlk2PR0yFy8bFHudlqYAZhFI9h1dyEC8Ri
7XQB0sVV/0kTi9FxOzfr5Dfjkux7bpz5MATHzwtuIrfCEwUXvsJYcw3ZnOuvhi6M
nqsxFBkK77Heq9p4plR4DFyKaQn8gw6k1aE6fu8Qe3gYss975LQb2Wyw1bFAzKCz
xo71WzpwWCpa1ITHrazezaeU8Ck36DfzOOi2NxHYq2NzZrBqZYNbjmPLFq3cTPjm5R
xYfy6VduQv+4D4UOJBfW1+3K7cBpD+SQA7qfkIIrD9bp4nlqgYl5Bk/a5PY1v82M
BexWIuHQbT53KNbpwUo25sVoz+Tr6oALhrP7Xw9c7VtSuvggbngLiliD9YJPz0jK
1vG8DGskv5uNj28s277efRLvbrPR9HoLsQIDAQABo4GPMIGMMBYGCWCGSAGG+EIB
DQQJFgdDQSBSb290MB0GA1UdDgQWBBR4PoJGinolkSfs2RHDLszX6AZpXzAfBgNV
HSMEGDAWgBR4PoJGinolkSfs2RHDLszX6AZpXzASBgNVHRMBAf8ECDAGAQH/AgEB
MAsGA1UdDwQEAwIBBjARBglghkgBhvhCAQEEBAMCAgQwDQYJKoZIhvcNAQELBQAD
ggIBACgulrke1nPNsIGgeG2/ofUZL27QITM7X1fjvw+rbEVHNCg1S3rzN83blGcR
BJPxQVU/9nSNoAazeazeaze3RszXtOEJyMXNxpo3CFBye3QUwQPRuXhZZK+TTwGS2I
S1ZGkD1mnd9KDW9+96tmV6N0WP1rlrIR32FhONpFipr7y9RxcqNEZvYN3YTXNS2d
40588/LN8DLrTIMD5Trw7fpgN024kxEmcQlPs803bOr2ahxlLCWmW7q8CeSHgfkE
L/XAPOxeLJo3jrdvFXl67F8+MpAnVspbvk+BjVQN266r/nyfumFAU0rrpRoF5F+6
HDrMPDXUxuCSazezaeazeLCEgQqdY2xVEdo8kmkBa+l2QCfAa3RvLb0LMVUC7ZRu
b6f1L+splRqJ3nnx2M5hIVLB530umF+wNMSGmgm4gghgD58S/2UFVPgDXFlvOMML
tkhBxfPra4/d7CdgSbNaS/FkYdlg3Q1QzavD6tBlrSM071z6IhZAit2i8ES9vik+
TnrwvgpQpv2heibI03VejA7JnuYtLkfi0/vsvIWOWhcFO8dklmg5WDPITDzkYS5u
M4pA5QfcBgnVTcQKHE4X8Gatezbk9uq2Q8MPChyQWs9I2Ns5WIvs8fZixpbFWI0v
TlJX4tRqx6bgfTWRqmkWX5dK/+bU2mDkUsnYg4x4HcFDaKfx
-----END CERTIFICATE-----

Voici mes logs actuels 

2019-08-23 15:29:36,390 [[main]] [] WARN  fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication - Caller+1         at fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication.clearAndconfigureMetrics(CommonBusinessApplication.java:111) : [vitam-test-small-vm-3:offer:139960356] No content to map due to end-of-input
 at [Source: (FileInputStream); line: 23, column: 1]
2019-08-23 15:29:36,410 [[main]] [] WARN  fr.gouv.vitam.common.metrics.VitamMetrics - Caller+1   at fr.gouv.vitam.common.metrics.VitamMetrics.<init>(VitamMetrics.java:88) : [vitam-test-small-vm-3:offer:139960356] VitamMetrics instanciated without reporter.
2019-08-23 15:32:43,327 [[vitam-thread-98]] [aeaaaaaaaagfpiaeabdowalmx4n3fhiaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:139960356] Cannot create object sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
        at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
        at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)
        ... 96 common frames omitted
Wrapped by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)
        at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
        at sun.security.validator.Validator.validate(Validator.java:262)
        at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:330)
        at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:237)
        at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:132)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
        ... 90 common frames omitted
Wrapped by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
        at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
        at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
        at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)
        at sun.security.ssl.Handshaker.process_record(Handshaker.java:965)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:404)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:364)
        at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
        at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
        at com.amazonaws.http.conn.$Proxy20.connect(Unknown Source)
        at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1286)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        ... 64 common frames omitted
Wrapped by: com.amazonaws.SdkClientException: Unable to execute HTTP request: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1164)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1110)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.getAcl(AmazonS3Client.java:3835)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1216)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1206)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExistV2(AmazonS3Client.java:1342)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:202)
        ... 51 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to check existance of container
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:208)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:179)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-23 15:32:43,790 [[vitam-thread-98]] [aeaaaaaaaagfpiaeabdowalmx4n3fhiaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:139960356] Cannot create object sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
        at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
        at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)
        ... 96 common frames omitted
Wrapped by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)
        at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
        at sun.security.validator.Validator.validate(Validator.java:262)
        at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:330)
        at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:237)
        at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:132)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
        ... 90 common frames omitted
Wrapped by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
        at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
        at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
        at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)
        at sun.security.ssl.Handshaker.process_record(Handshaker.java:965)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:404)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:364)
        at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
        at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
        at com.amazonaws.http.conn.$Proxy20.connect(Unknown Source)
        at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1286)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        ... 64 common frames omitted
Wrapped by: com.amazonaws.SdkClientException: Unable to execute HTTP request: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1164)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1110)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.getAcl(AmazonS3Client.java:3835)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1216)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1206)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExistV2(AmazonS3Client.java:1342)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:202)
        ... 51 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to check existance of container
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:208)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:179)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-23 15:32:44,365 [[vitam-thread-98]] [aeaaaaaaaagfpiaeabdowalmx4n3fhiaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:139960356] Cannot create object sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
        at sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
        at java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280)
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392)
        ... 96 common frames omitted
Wrapped by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397)
        at sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
        at sun.security.validator.Validator.validate(Validator.java:262)
        at sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:330)
        at sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:237)
        at sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:132)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
        ... 90 common frames omitted
Wrapped by: javax.net.ssl.SSLHandshakeException: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at sun.security.ssl.Alerts.getSSLException(Alerts.java:192)
        at sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316)
        at sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310)
        at sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
        at sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
        at sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037)
        at sun.security.ssl.Handshaker.process_record(Handshaker.java:965)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064)
        at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395)
        at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:404)
        at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:364)
        at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
        at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
        at com.amazonaws.http.conn.$Proxy20.connect(Unknown Source)
        at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
        at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
        at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
        at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
        at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
        at com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1286)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        ... 64 common frames omitted
Wrapped by: com.amazonaws.SdkClientException: Unable to execute HTTP request: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1164)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1110)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.getAcl(AmazonS3Client.java:3835)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1216)
        at com.amazonaws.services.s3.AmazonS3Client.getBucketAcl(AmazonS3Client.java:1206)
        at com.amazonaws.services.s3.AmazonS3Client.doesBucketExistV2(AmazonS3Client.java:1342)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:202)
        ... 51 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to check existance of container
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:208)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:179)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
bxaxa commented 5 years ago

Bonjour, définitivement, j'ai un soucis avec les certificats. Impossible de savoir, avec la documentation, quel nom donner au fichier et quoi mettre dedans exactement.

Quand je tente en mode HTTP (pas de SSL), à l'installation, VITAM me crée bien des bucket. Il en crée d'ailleurs beaucoup, plus de 39.

En HTTP sans SSL tout fonctionne nickel.

Sauriez vous me dire dans quel répertoire exactement créer quel fichier avec quel nom de fichier avec quel contenu précisément ?

Merci

nmenetrier commented 5 years ago

Bonjour, En effet le schéma de documentation sur le sujet n'est pas très clair, nous allons améliorer ce point. Il faut déposer les CA dans la partie deployment/environments/certs/server/ca/ puis régénérer les keystores, ainsi le serveur vitam-offer devrait disposer de la CA de scaleway au prochain déploiement. http://www.programmevitam.fr/ressources/DocCourante/html/installation/_images/arborescence_certs.svg Nous vous conseillons également de vérifier manuellement les buckets et de les purger avant de refaire votre déploiement, pour éviter tout potentiel conflit. Cdt

bxaxa commented 5 years ago

Bonjour, Tout fonctionne en HTTP

s3Endpoint: http://s3.fr-par.scw.cloud

mais si je passe en HTTPS (en changeant simplement le s3Endpoint avec https dans l'url)

s3Endpoint: https://s3.fr-par.scw.cloud

ça ne fonctionne plus.

Pourtant,

je viens de créer les fichiers scaleway.crt et letsencrypt.crt (fournis par Scaleway) dans le dossier

vitam/deployment/environments/certs/client-storage/ca/

ls -al vitam/deployment/environments/certs/client-storage/ca/

total 24
drwxrwxr-x 2 amapi amapi  115 Aug 27 10:51 .
drwxrwxr-x 4 amapi amapi   31 Aug 22 10:30 ..
-rw-rw-r-- 1 amapi amapi 7851 Aug 27 10:53 ca-intermediate.crt
-rw-rw-r-- 1 amapi amapi 7431 Aug 27 10:53 ca-root.crt
-rw-rw-r-- 1 amapi amapi 1647 Aug 27 10:51 letsencrypt.crt
-rw-rw-r-- 1 amapi amapi 1200 Aug 27 10:51 scaleway.crt

J'ai ensuite relancé un installation from scratch (destruction totale de mes vms), avec regénération pki , etc ...,

Je n'ai apparement plus d'erreur de certificat, malheureusement, ça ne fonctionne toujours pas.

root@vitam-test-small-vm-3:/vitam/log/offer# cat offer.2019-08-27.0.log
2019-08-27 09:11:47,151 [[main]] [] WARN  fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication - Caller+1         at fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication.clearAndconfigureMetrics(CommonBusinessApplication.java:111) : [vitam-test-small-vm-3:offer:137498694] No content to map due to end-of-input
 at [Source: (FileInputStream); line: 23, column: 1]
2019-08-27 09:11:47,209 [[main]] [] WARN  fr.gouv.vitam.common.metrics.VitamMetrics - Caller+1   at fr.gouv.vitam.common.metrics.VitamMetrics.<init>(VitamMetrics.java:88) : [vitam-test-small-vm-3:offer:137498694] VitamMetrics instanciated without reporter.
2019-08-27 09:18:19,703 [[vitam-thread-98]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] WARN  fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1   at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:181) : [vitam-test-small-vm-3:offer:137498694] Container local_1_backup_operation already exists
2019-08-27 09:18:19,770 [[vitam-thread-98]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:137498694] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 53 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to upload object
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:263)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,454 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] WARN  fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1   at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:181) : [vitam-test-small-vm-3:offer:137498694] Container local_1_backup_operation already exists
2019-08-27 09:18:20,480 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:137498694] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 53 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to upload object
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:263)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,739 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] WARN  fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1   at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:181) : [vitam-test-small-vm-3:offer:137498694] Container local_1_backup_operation already exists
2019-08-27 09:18:20,760 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1       at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:137498694] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 53 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to upload object
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:263)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
root@vitam-test-small-vm-1:/vitam/log/storage# cat storage.2019-08-27.0.log
2019-08-27 09:13:10,869 [[main]] [] WARN  fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication - Caller+1         at fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication.clearAndconfigureMetrics(CommonBusinessApplication.java:111) : [vitam-test-small-vm-1:storage:139960343] No content to map due to end-of-input
 at [Source: (FileInputStream); line: 23, column: 1]
2019-08-27 09:13:10,903 [[main]] [] WARN  fr.gouv.vitam.common.metrics.VitamMetrics - Caller+1   at fr.gouv.vitam.common.metrics.VitamMetrics.<init>(VitamMetrics.java:88) : [vitam-test-small-vm-1:storage:139960343] VitamMetrics instanciated without reporter.
2019-08-27 09:13:23,033 [[main]] [] WARN  fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication - Caller+1         at fr.gouv.vitam.common.serverv2.application.CommonBusinessApplication.clearAndconfigureMetrics(CommonBusinessApplication.java:111) : [vitam-test-small-vm-1:storage:139960343] No content to map due to end-of-input
 at [Source: (FileInputStream); line: 23, column: 1]
2019-08-27 09:13:23,057 [[main]] [] WARN  fr.gouv.vitam.common.metrics.VitamMetrics - Caller+1   at fr.gouv.vitam.common.metrics.VitamMetrics.<init>(VitamMetrics.java:88) : [vitam-test-small-vm-1:storage:139960343] VitamMetrics instanciated without reporter.
2019-08-27 09:13:23,094 [[main]] [] WARN  fr.gouv.vitam.storage.engine.server.storagelog.StorageLogFactory - Caller+1    at fr.gouv.vitam.storage.engine.server.storagelog.StorageLogFactory.checkExistingStorageLogFiles(StorageLogFactory.java:125) : [vitam-test-small-vm-1:storage:139960343] Existing storage log files found: [/vitam/log/storage/storage-log/2_20190827091310983_514a9472-4102-4dfc-a5ef-83283390708b.log, /vitam/log/storage/storage-log/1_20190827091310982_df69e746-3635-4bf9-9b73-c6039f62bbee.log, /vitam/log/storage/storage-log/6_20190827091310986_ee7dc1d8-2341-4350-bb4b-3ebc89689050.log, /vitam/log/storage/storage-log/9_20190827091310988_e320856c-8705-4dfb-8088-151828c6f216.log, /vitam/log/storage/storage-log/4_20190827091310984_dfc36462-bc68-4700-b4ed-9d38d2e3b5a1.log, /vitam/log/storage/storage-log/3_20190827091310984_72fb8232-3408-4894-92ad-5fdfb48c71ee.log, /vitam/log/storage/storage-log/7_20190827091310987_1211a05f-1658-46cf-88dc-584fec970d9f.log, /vitam/log/storage/storage-log/0_20190827091310954_bf1c3e91-3bf1-486f-aaa9-fbb1d670793d.log, /vitam/log/storage/storage-log/8_20190827091310988_5aa65afe-a6b7-4eca-8fd5-541a2fccadbe.log, /vitam/log/storage/storage-log/5_20190827091310986_b1ae8dbb-66a0-42a9-98f7-addc8dd0cef8.log]
2019-08-27 09:13:23,096 [[main]] [] WARN  fr.gouv.vitam.storage.engine.server.storagelog.StorageLogFactory - Caller+1    at fr.gouv.vitam.storage.engine.server.storagelog.StorageLogFactory.checkExistingStorageLogFiles(StorageLogFactory.java:125) : [vitam-test-small-vm-1:storage:139960343] Existing storage log files found: [/vitam/log/storage/access-log/1_20190827091310982_951d83a0-fae3-47bf-935d-6ff92ae98957.log, /vitam/log/storage/access-log/5_20190827091310986_3950620a-5633-4270-9c2d-7d93c0724173.log, /vitam/log/storage/access-log/7_20190827091310987_97d0e646-788f-43d0-bc79-691da0fb4c60.log, /vitam/log/storage/access-log/0_20190827091310981_61048ee2-919c-42c2-8612-1c2fa19923bb.log, /vitam/log/storage/access-log/4_20190827091310985_9a00256f-bf37-4d71-8cd8-f170fcbe13c0.log, /vitam/log/storage/access-log/6_20190827091310987_a8d74976-821f-4073-8a47-34ee39acfb0e.log, /vitam/log/storage/access-log/9_20190827091310989_e5441755-186f-4bd2-93c4-4bf7cbe4eff9.log, /vitam/log/storage/access-log/3_20190827091310984_d9253b9a-a1fd-4834-b41f-c55b8856778c.log, /vitam/log/storage/access-log/8_20190827091310988_f2274b89-b065-4008-9d0d-2dfb38472984.log, /vitam/log/storage/access-log/2_20190827091310983_ec901a5a-c217-44af-b2a6-6a84a33b9143.log]
2019-08-27 09:18:12,863 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] WARN  fr.gouv.vitam.storage.engine.server.spi.mapper.FileDriverMapper - Caller+1      at fr.gouv.vitam.storage.engine.server.spi.mapper.FileDriverMapper.getOffersFor(FileDriverMapper.java:93) : [vitam-test-small-vm-1:storage:139960343] Configuration file not found for fr.gouv.vitam.driver.fake.FakeDriverImpl, then return empty list
2019-08-27 09:18:19,792 [[vitam-thread-101]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl - Caller+1        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:413) : [vitam-test-small-vm-1:storage:139960343] [100517] Storage technical error
2019-08-27 09:18:19,806 [[vitam-thread-101]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:115) : [vitam-test-small-vm-1:storage:139960343] An error occurred during transfer to offer offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:19,817 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:574) : [vitam-test-small-vm-1:storage:139960343] Error on offer ID offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 4 common frames omitted
Wrapped by: java.util.concurrent.ExecutionException: fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:543)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffersWithRetries(StorageDistributionImpl.java:311)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.storeDataInAllOffers(StorageDistributionImpl.java:440)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1349)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createOrUpdateBackupOperation(StorageResource.java:695)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,495 [[vitam-thread-103]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl - Caller+1        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:413) : [vitam-test-small-vm-1:storage:139960343] [100517] Storage technical error
2019-08-27 09:18:20,499 [[vitam-thread-103]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:115) : [vitam-test-small-vm-1:storage:139960343] An error occurred during transfer to offer offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,502 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:574) : [vitam-test-small-vm-1:storage:139960343] Error on offer ID offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 4 common frames omitted
Wrapped by: java.util.concurrent.ExecutionException: fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:543)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffersWithRetries(StorageDistributionImpl.java:311)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.storeDataInAllOffers(StorageDistributionImpl.java:440)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1349)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createOrUpdateBackupOperation(StorageResource.java:695)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,768 [[vitam-thread-105]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl - Caller+1        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:413) : [vitam-test-small-vm-1:storage:139960343] [100517] Storage technical error
2019-08-27 09:18:20,770 [[vitam-thread-105]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:115) : [vitam-test-small-vm-1:storage:139960343] An error occurred during transfer to offer offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,774 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:574) : [vitam-test-small-vm-1:storage:139960343] Error on offer ID offer-s3-1.service.local.consul fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.handleResponseStatus(ConnectionImpl.java:414)
        at fr.gouv.vitam.storage.offers.workspace.driver.ConnectionImpl.putObject(ConnectionImpl.java:255)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.storeInOffer(TransferThread.java:143)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:113)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.TransferThread.call(TransferThread.java:55)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 4 common frames omitted
Wrapped by: java.util.concurrent.ExecutionException: fr.gouv.vitam.storage.driver.exception.StorageDriverException: An error occured for driver 'DefaultOfferDriver' with message :Internal Server Error
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffers(StorageDistributionImpl.java:543)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.sendDataToOffersWithRetries(StorageDistributionImpl.java:311)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.storeDataInAllOffers(StorageDistributionImpl.java:440)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1349)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createOrUpdateBackupOperation(StorageResource.java:695)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 09:18:20,798 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl - Caller+1        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.buildStoreDataResponse(StorageDistributionImpl.java:662) : [vitam-test-small-vm-1:storage:139960343] [100505] Could not store object with id 'aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq' on offers 'offer-s3-1.service.local.consul'
2019-08-27 09:18:20,800 [[vitam-thread-99]] [aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq] ERROR fr.gouv.vitam.storage.engine.server.rest.StorageResource - Caller+1     at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1359) : [vitam-test-small-vm-1:storage:139960343]  fr.gouv.vitam.storage.engine.common.exception.StorageTechnicalException: [100505] Could not store object with id 'aeaaaaaaaaecxuafabd3oalm2jpeu2qaaaaq' on offers 'offer-s3-1.service.local.consul'
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.buildStoreDataResponse(StorageDistributionImpl.java:664)
        at fr.gouv.vitam.storage.engine.server.distribution.impl.StorageDistributionImpl.storeDataInAllOffers(StorageDistributionImpl.java:449)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createObjectByType(StorageResource.java:1349)
        at fr.gouv.vitam.storage.engine.server.rest.StorageResource.createOrUpdateBackupOperation(StorageResource.java:695)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

Du coup, je suis un peu perplexe.

croftophile commented 5 years ago

Bonjour,

OK... Pouvez-vous s'il vous plaît ajouter dans le logback du composant offer la ligne suivante :

<logger name="fr.gouv.vitam.common.storage.s3" level="DEBUG"/>

Fichier /vitam/conf/offer/logback.xml à la fin, avant </configuration>

Puis relancer le composant offer (sudo systemctl restart vitam-offer).

Cela va activer des traces spécifiques au connecteur côté VITAM. A l'issue, merci de relancer vos tests et nous renvoyer les nouvelles traces.

croftophile commented 5 years ago

Avez-vous également bien purgé manuellement les buckets avant de relancer un déploiement ? Car nous observons des "Container already exists". Si vous êtes en installation avec 2 offres (typiquement, FileSystem et s3), recréer vos VM purge le contenu de backup (lié à FS) , mais n'a rien fait sur s3 ; il faut que vous réalisiez cette étape manuellement.

bxaxa commented 5 years ago

J'ai bien effacé tous les bucket (à la main et vérifier qu'il ne reste rien).

Petit changement. Quand j'installe Vitam from scratch, AUCUN bucket n'est crée, MAIS quand je restart vitam-offer, des buckets se créent.

j'ai essayé également de supprimer tous bucket et de restart vitam-offer, dans ce cas, les bucket apparaissent bien, mais j'ai toujours les erreurs dans les logs et rien ne fonctionne.

Du coup, je pense que l'inclusion de mes certificats est bonnes (sinon il n'y aurait aucun bucket de créé. Mais ça plante toujours.

Voici un échantillon de mes logs

2019-08-27 14:08:40,770 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:194) : [vitam-test-small-vm-3:offer:136679432] Check existance of container local_5_storageaccesslog
2019-08-27 14:08:40,771 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:40,773 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingObject(AmazonS3V1.java:384) : [vitam-test-small-vm-3:offer:136679432] Check existance of object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog
2019-08-27 14:08:40,774 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:40,942 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:215) : [vitam-test-small-vm-3:offer:136679432] Upload object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog
2019-08-27 14:08:40,943 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:41,045 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:255) : [vitam-test-small-vm-3:offer:136679432] Error when trying to upload object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog. Reason: errorMessage=The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx276532cc376540e59f145-005d653968; S3 Extended Request ID: null) com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx276532cc376540e59f145-005d653968; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:41,048 [[vitam-thread-98]] [] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1   at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:136679432] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx276532cc376540e59f145-005d653968; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 52 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageNotFoundException: Error when trying to upload object : container does not exists
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:260)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:41,170 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:194) : [vitam-test-small-vm-3:offer:136679432] Check existance of container local_5_storageaccesslog
2019-08-27 14:08:41,171 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:41,171 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingObject(AmazonS3V1.java:384) : [vitam-test-small-vm-3:offer:136679432] Check existance of object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog
2019-08-27 14:08:41,172 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:41,341 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:215) : [vitam-test-small-vm-3:offer:136679432] Upload object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog
2019-08-27 14:08:41,342 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.storageaccesslog from container name local_5_storageaccesslog
2019-08-27 14:08:41,455 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:255) : [vitam-test-small-vm-3:offer:136679432] Error when trying to upload object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog. Reason: errorMessage=The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx768bd067d1f847f8a48fc-005d653969; S3 Extended Request ID: null) com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx768bd067d1f847f8a48fc-005d653969; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:41,457 [[vitam-thread-98]] [] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1   at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:136679432] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx768bd067d1f847f8a48fc-005d653969; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 52 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageNotFoundException: Error when trying to upload object : container does not exists
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:260)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:42,762 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:194) : [vitam-test-small-vm-3:offer:136679432] Check existance of container local_5_backup_operation
2019-08-27 14:08:42,762 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:44,836 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:168) : [vitam-test-small-vm-3:offer:136679432] Create container local_5_backup_operation
2019-08-27 14:08:44,837 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:44,897 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:176) : [vitam-test-small-vm-3:offer:136679432] Error when trying to create container with name: local_5_backup_operation. Reason: errorCode=BucketAlreadyOwnedByYou, errorType=Client, errorMessage=Your previous request to create the named bucket succeeded and you already own it. com.amazonaws.services.s3.model.AmazonS3Exception: Your previous request to create the named bucket succeeded and you already own it. (Service: Amazon S3; Status Code: 409; Error Code: BucketAlreadyOwnedByYou; Request ID: txbd3029e0c0de4664ad6f3-005d65396c; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.createBucket(AmazonS3Client.java:1069)
        at com.amazonaws.services.s3.AmazonS3Client.createBucket(AmazonS3Client.java:1001)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:173)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:186)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:44,899 [[vitam-thread-98]] [] WARN  fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:181) : [vitam-test-small-vm-3:offer:136679432] Container local_5_backup_operation already exists
2019-08-27 14:08:44,899 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:215) : [vitam-test-small-vm-3:offer:136679432] Upload object aecaaaaaawegieclaav5qalm2nudfnaaaaaq in container local_5_backup_operation
2019-08-27 14:08:44,900 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:44,905 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:255) : [vitam-test-small-vm-3:offer:136679432] Error when trying to upload object aecaaaaaawegieclaav5qalm2nudfnaaaaaq in container local_5_backup_operation. Reason: errorMessage=Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null) com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:44,908 [[vitam-thread-98]] [] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1   at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:136679432] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        ... 52 common frames omitted
Wrapped by: fr.gouv.vitam.workspace.api.exception.ContentAddressableStorageServerException: Error when trying to upload object
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:263)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:44,963 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.isExistingContainer(AmazonS3V1.java:194) : [vitam-test-small-vm-3:offer:136679432] Check existance of container local_5_backup_operation
2019-08-27 14:08:44,964 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:45,029 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:168) : [vitam-test-small-vm-3:offer:136679432] Create container local_5_backup_operation
2019-08-27 14:08:45,030 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:45,071 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:176) : [vitam-test-small-vm-3:offer:136679432] Error when trying to create container with name: local_5_backup_operation. Reason: errorCode=BucketAlreadyOwnedByYou, errorType=Client, errorMessage=Your previous request to create the named bucket succeeded and you already own it. com.amazonaws.services.s3.model.AmazonS3Exception: Your previous request to create the named bucket succeeded and you already own it. (Service: Amazon S3; Status Code: 409; Error Code: BucketAlreadyOwnedByYou; Request ID: tx5ae98748602948958ebc2-005d65396d; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.createBucket(AmazonS3Client.java:1069)
        at com.amazonaws.services.s3.AmazonS3Client.createBucket(AmazonS3Client.java:1001)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:173)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.ensureContainerExists(DefaultOfferServiceImpl.java:186)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:165)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:45,072 [[vitam-thread-98]] [] WARN  fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.createContainer(AmazonS3V1.java:181) : [vitam-test-small-vm-3:offer:136679432] Container local_5_backup_operation already exists
2019-08-27 14:08:45,073 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:215) : [vitam-test-small-vm-3:offer:136679432] Upload object aecaaaaaawegieclaav5qalm2nudfnaaaaaq in container local_5_backup_operation
2019-08-27 14:08:45,074 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.generateBucketName(AmazonS3V1.java:574) : [vitam-test-small-vm-3:offer:136679432] Generated bucket name local.5.backup.operation from container name local_5_backup_operation
2019-08-27 14:08:45,079 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1       at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:255) : [vitam-test-small-vm-3:offer:136679432] Error when trying to upload object aecaaaaaawegieclaav5qalm2nudfnaaaaaq in container local_5_backup_operation. Reason: errorMessage=Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null) com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:657)
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:521)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4705)
        at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:4652)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1807)
        at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1665)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:253)
        at fr.gouv.vitam.common.storage.s3.AmazonS3V1.putObject(AmazonS3V1.java:225)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.putObject(DefaultOfferServiceImpl.java:255)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.writeObject(DefaultOfferServiceImpl.java:198)
        at fr.gouv.vitam.storage.offers.core.DefaultOfferServiceImpl.createObject(DefaultOfferServiceImpl.java:167)
        at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:407)
        at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
        at org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
        at org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
        at org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:310)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
        at org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
        at org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
        at org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
        at org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
        at org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
        at org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:873)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1623)
        at fr.gouv.vitam.common.security.filter.AuthorizationFilter.doFilter(AuthorizationFilter.java:68)
        at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1610)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480)
        at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)
        at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174)
        at org.eclipse.jetty.server.handler.HandlerList.handle(HandlerList.java:61)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
        at org.eclipse.jetty.server.Server.handle(Server.java:505)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267)
        at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)
        at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
        at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
        at fr.gouv.vitam.common.thread.VitamThreadPoolExecutor$VitamRunnable.run(VitamThreadPoolExecutor.java:153)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

2019-08-27 14:08:45,080 [[vitam-thread-98]] [] ERROR fr.gouv.vitam.storage.offers.rest.DefaultOfferResource - Caller+1   at fr.gouv.vitam.storage.offers.rest.DefaultOfferResource.putObject(DefaultOfferResource.java:420) : [vitam-test-small-vm-3:offer:136679432] Cannot create object com.amazonaws.services.s3.model.AmazonS3Exception: Your request was not formed properly (Service: Amazon S3; Status Code: 400; Error Code: BadRequest; Request ID: null; S3 Extended Request ID: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1701)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1356)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1102)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:759)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:733)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:715)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:675)
naddame commented 5 years ago

Bonjour,

Les logs montrent bien, à ce stade, qu'il n'y a pas de problème d'authentification via certificat.

La purge des buckets (vider les buckets) est important lors de redéploiement from scratch, car certains fichiers référentiels sont déjà là, si on les supprime pas le prochain redéploiement va partir en KO.

Quand vous supprimez les buckets il faut impérativement redémarrer vitam-offer pour vider le cache. Sinon les buckets sont considérés comme existants dans un cache mémoire. Lors de l'upload d'un fichier, si le bucket n'existe pas, il sera crée automatiquement.

Cdt Djamel

croftophile commented 5 years ago

Bonsoir,

Concernant ce log en particulier : 2019-08-27 14:08:41,045 [[vitam-thread-98]] [] DEBUG fr.gouv.vitam.common.storage.s3.AmazonS3V1 - Caller+1 at fr.gouv.vitam.common.storage.s3.AmazonS3V1.storeObject(AmazonS3V1.java:255) : [vitam-test-small-vm-3:offer:136679432] Error when trying to upload object 5_storage_access_logbook_20190827140710232_20190827140837044_aecaaaaaawegieclaav5qalm2nudfnaaaaaq.log in container local_5_storageaccesslog. Reason: errorMessage=The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx276532cc376540e59f145-005d653968; S3 Extended Request ID: null) com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket; Request ID: tx276532cc376540e59f145-005d653968; S3 Extended Request ID: null)

Pouvez-vous nous confirmer que le bucket local_5_storageaccesslog a bien été créé ? Car si le bucket est créé, mais que vous ne pouvez pas exécuter la méthode "put", il y a peut-être un problème de droits. Pouvez-vous vérifier ce point, s'il vous plaît ?

bxaxa commented 5 years ago

Bonjour, voici les logs juste aprés l'installation from scratch.

J'ai du attendre un moment avant que les buckets se créent

offer.2019-08-27.0_juste_apres_installation_from_scratch.log

Voici la liste des buckets:

2019-08-27 16:01         0   s3://local.0.storageaccesslog/0_storage_access_logbook_20190827155039145_20190827160113591_aecaaaaaaced5eaoaar2qalm2phuw5iaaaaq.log
2019-08-27 16:01         0   s3://local.0.storageaccesslog/0_storage_access_logbook_20190827155102166_20190827160113591_aecaaaaaaced5eaoaar2qalm2phuw5iaaaaq.log

2019-08-27 16:02         0   s3://local.0.storagelog/0_storage_logbook_20190827155039095_20190827160205805_aecaaaaaaced5eaoaar2qalm2pibo3aaaaaq.log
2019-08-27 16:02      2844   s3://local.0.storagelog/0_storage_logbook_20190827155102134_20190827160205805_aecaaaaaaced5eaoaar2qalm2pibo3aaaaaq.log

2019-08-27 16:01         0   s3://local.1.storageaccesslog/1_storage_access_logbook_20190827155039146_20190827160139575_aecaaaaaaged5eaoaar2qalm2ph3b5yaaaaq.log
2019-08-27 16:01         0   s3://local.1.storageaccesslog/1_storage_access_logbook_20190827155102167_20190827160139575_aecaaaaaaged5eaoaar2qalm2ph3b5yaaaaq.log

2019-08-27 16:01         0   s3://local.1.storagelog/1_storage_logbook_20190827155039145_20190827160100573_aecaaaaaaged5eaoaar2qalm2phrrfaaaaaq.log
2019-08-27 16:01       436   s3://local.1.storagelog/1_storage_logbook_20190827155102166_20190827160100573_aecaaaaaaged5eaoaar2qalm2phrrfaaaaaq.log

2019-08-27 16:01         0   s3://local.2.storageaccesslog/2_storage_access_logbook_20190827155039147_20190827160106173_aecaaaaaaked5eaoaar2qalm2phs46iaaaaq.log
2019-08-27 16:01         0   s3://local.2.storageaccesslog/2_storage_access_logbook_20190827155102168_20190827160106173_aecaaaaaaked5eaoaar2qalm2phs46iaaaaq.log

2019-08-27 16:02         0   s3://local.2.storagelog/2_storage_logbook_20190827155039146_20190827160219999_aecaaaaaaked5eaoaar2qalm2pie5xqaaaaq.log
2019-08-27 16:02      2408   s3://local.2.storagelog/2_storage_logbook_20190827155102167_20190827160219999_aecaaaaaaked5eaoaar2qalm2pie5xqaaaaq.log

2019-08-27 16:00         0   s3://local.3.storageaccesslog/3_storage_access_logbook_20190827155039147_20190827160013101_aecaaaaaaoed5eaoaar2qalm2phfxniaaaaq.log
2019-08-27 16:00         0   s3://local.3.storageaccesslog/3_storage_access_logbook_20190827155102169_20190827160013101_aecaaaaaaoed5eaoaar2qalm2phfxniaaaaq.log

2019-08-27 16:00         0   s3://local.3.storagelog/3_storage_logbook_20190827155039147_20190827160049899_aecaaaaaaoed5eaoaar2qalm2pho52qaaaaq.log
2019-08-27 16:00      2408   s3://local.3.storagelog/3_storage_logbook_20190827155102168_20190827160049899_aecaaaaaaoed5eaoaar2qalm2pho52qaaaaq.log

2019-08-27 16:01         0   s3://local.4.storageaccesslog/4_storage_access_logbook_20190827155039148_20190827160146252_aecaaaaaased5eaoaar2qalm2ph4wcqaaaaq.log
2019-08-27 16:01         0   s3://local.4.storageaccesslog/4_storage_access_logbook_20190827155102170_20190827160146252_aecaaaaaased5eaoaar2qalm2ph4wcqaaaaq.log

2019-08-27 16:00         0   s3://local.4.storagelog/4_storage_logbook_20190827155039148_20190827160055477_aecaaaaaased5eaoaar2qalm2phqjniaaaaq.log
2019-08-27 16:00         0   s3://local.4.storagelog/4_storage_logbook_20190827155102169_20190827160055477_aecaaaaaased5eaoaar2qalm2phqjniaaaaq.log

2019-08-27 16:01         0   s3://local.5.storageaccesslog/5_storage_access_logbook_20190827155039149_20190827160132435_aecaaaaaawed5eaoaar2qalm2phzkeqaaaaq.log
2019-08-27 16:01         0   s3://local.5.storageaccesslog/5_storage_access_logbook_20190827155102171_20190827160132435_aecaaaaaawed5eaoaar2qalm2phzkeqaaaaq.log

2019-08-27 16:00         0   s3://local.5.storagelog/5_storage_logbook_20190827155039149_20190827160035823_aecaaaaaawed5eaoaar2qalm2phlpzqaaaaq.log
2019-08-27 16:00         0   s3://local.5.storagelog/5_storage_logbook_20190827155102170_20190827160035823_aecaaaaaawed5eaoaar2qalm2phlpzqaaaaq.log

2019-08-27 16:02         0   s3://local.6.storageaccesslog/6_storage_access_logbook_20190827155039150_20190827160227336_aecaaaaaa2ed5eaoaar2qalm2pigxbyaaaaq.log
2019-08-27 16:02         0   s3://local.6.storageaccesslog/6_storage_access_logbook_20190827155102172_20190827160227336_aecaaaaaa2ed5eaoaar2qalm2pigxbyaaaaq.log

2019-08-27 16:02         0   s3://local.6.storagelog/6_storage_logbook_20190827155039150_20190827160212904_aecaaaaaa2ed5eaoaar2qalm2pidgjyaaaaq.log
2019-08-27 16:02       872   s3://local.6.storagelog/6_storage_logbook_20190827155102171_20190827160212904_aecaaaaaa2ed5eaoaar2qalm2pidgjyaaaaq.log

2019-08-27 16:01         0   s3://local.7.storageaccesslog/7_storage_access_logbook_20190827155039151_20190827160125591_aecaaaaaa6ed5eaoaar2qalm2phxuviaaaaq.log
2019-08-27 16:01         0   s3://local.7.storageaccesslog/7_storage_access_logbook_20190827155102173_20190827160125591_aecaaaaaa6ed5eaoaar2qalm2phxuviaaaaq.log

2019-08-27 16:00         0   s3://local.7.storagelog/7_storage_logbook_20190827155039150_20190827160029373_aecaaaaaa6ed5eaoaar2qalm2phj5paaaaaq.log
2019-08-27 16:00         0   s3://local.7.storagelog/7_storage_logbook_20190827155102173_20190827160029373_aecaaaaaa6ed5eaoaar2qalm2phj5paaaaaq.log

2019-08-27 16:01         0   s3://local.8.storageaccesslog/8_storage_access_logbook_20190827155039154_20190827160118759_aecaaaaabced5eaoaar2qalm2phv7jiaaaaq.log
2019-08-27 16:01         0   s3://local.8.storageaccesslog/8_storage_access_logbook_20190827155102174_20190827160118759_aecaaaaabced5eaoaar2qalm2phv7jiaaaaq.log

2019-08-27 16:00         0   s3://local.8.storagelog/8_storage_logbook_20190827155039151_20190827160044417_aecaaaaabced5eaoaar2qalm2phnsuyaaaaq.log
2019-08-27 16:00       436   s3://local.8.storagelog/8_storage_logbook_20190827155102174_20190827160044417_aecaaaaabced5eaoaar2qalm2phnsuyaaaaq.log

2019-08-27 16:02         0   s3://local.9.storageaccesslog/9_storage_access_logbook_20190827155039157_20190827160200130_aecaaaaabged5eaoaar2qalm2piacqiaaaaq.log
2019-08-27 16:02         0   s3://local.9.storageaccesslog/9_storage_access_logbook_20190827155102176_20190827160200130_aecaaaaabged5eaoaar2qalm2piacqiaaaaq.log

2019-08-27 16:01         0   s3://local.9.storagelog/9_storage_logbook_20190827155039154_20190827160153015_aecaaaaabged5eaoaar2qalm2ph6kwyaaaaq.log
2019-08-27 16:01       872   s3://local.9.storagelog/9_storage_logbook_20190827155102175_20190827160153015_aecaaaaabged5eaoaar2qalm2ph6kwyaaaaq.log

malheureusement, l'installation se finie en : 

TASK [init_contexts_and_security_profiles : Import admin security profile to functionnal-administration] *****************************************************************************************************************************
fatal: [small-vm-2]: FAILED! => {"changed": false, "connection": "close", "content": "{\"httpCode\":400,\"code\":\"400\",\"context\":\"ADMIN_MODULE\",\"state\":\"code_vitam\",\"message\":\"Bad Request\",\"description\":\"Internal Server Error\"}", "content_length": "137", "content_type": "application/json", "elapsed": 16, "json": {"code": "400", "context": "ADMIN_MODULE", "description": "Internal Server Error", "httpCode": 400, "message": "Bad Request", "state": "code_vitam"}, "msg": "Status code was 400 and not [200, 201]: HTTP Error 400: Bad Request", "redirected": false, "status": 400, "url": "http://10.65.2.29:18004/v1/admin/securityprofiles"}

Je vais ensuite effacer les buckets

Modifier la conf des logs que vous m'avez indiqué

<logger name="fr.gouv.vitam.common.storage.s3" level="DEBUG"/>

et relancer vitam-offer

Je patiente, mais plus aucun bucket n'est créé,

Voici les longs aprés restart de vitam-offer

offer.2019-08-27.0_debug_apres purge_et_retstart_vital_offer.log

bxaxa commented 5 years ago

au bout d'un certain des buckets sont créés

./s3cmd la
2019-08-27 18:01      2821   s3://local.0.storagelog/0_storage_logbook_20190827160205806_20190827180107018_aecaaaaaaced5eaoaar2qalm2q6q5sqaaaaq.log

2019-08-27 18:01      5228   s3://local.1.storagelog/1_storage_logbook_20190827160100575_20190827180115665_aecaaaaaaged5eaoaar2qalm2q6tbeiaaaaq.log

2019-08-27 18:01      2817   s3://local.2.storagelog/2_storage_logbook_20190827160220003_20190827180127801_aecaaaaaaked5eaoaar2qalm2q6v72iaaaaq.log

2019-08-27 18:01      2821   s3://local.3.storagelog/3_storage_logbook_20190827160049900_20190827180102769_aecaaaaaaoed5eaoaar2qalm2q6p4miaaaaq.log

2019-08-27 18:00      5226   s3://local.4.storagelog/4_storage_logbook_20190827160055479_20190827180053746_aecaaaaaased5eaoaar2qalm2q6nv4iaaaaq.log

2019-08-27 18:00      5226   s3://local.5.storagelog/5_storage_logbook_20190827160035834_20190827180046882_aecaaaaaawed5eaoaar2qalm2q6maiiaaaaq.log

2019-08-27 18:01      3484   s3://local.6.storagelog/6_storage_logbook_20190827160212905_20190827180058465_aecaaaaaa2ed5eaoaar2qalm2q6o2yiaaaaq.log

2019-08-27 18:00      4354   s3://local.7.storagelog/7_storage_logbook_20190827160029384_20190827180039867_aecaaaaaa6ed5eaoaar2qalm2q6kjoyaaaaq.log

2019-08-27 18:01      4792   s3://local.8.storagelog/8_storage_logbook_20190827160044420_20190827180111298_aecaaaaabced5eaoaar2qalm2q6r7aqaaaaq.log

2019-08-27 18:01      4356   s3://local.9.storagelog/9_storage_logbook_20190827160153026_20190827180121487_aecaaaaabged5eaoaar2qalm2q6uotqaaaba.log

Mais il y a toujours des erreurs

offer.2019-08-27.0.log

bxaxa commented 5 years ago

Bon, définitivement, c'est uniquement en https que ça ne fonctionne pas (mais ce n'est pas un soucis de certificat). Une configuration à l’identique en http fonctionne parfaitement.

nroselier commented 5 years ago

Bonjour,

Les implémentations validées par VITAM (en http comme https) sont les suivantes : OpenIO (utilisée en recette interne VITAM) et Netapp (implémentation utilisée par l'un de nos partenaires).

Notre équipe de développement identifie une piste d'analyse qui consisterait en l'ajout d'un appel à la méthode withRegion lors de la construction du client AmazonS3 (classe fr/gouv/vitam/common/storage/s3/AmazonS3V1.java), comme indiqué dans l'exemple suivant : 

this.client = AmazonS3ClientBuilder.standard()
                .withCredentials(new AWSStaticCredentialsProvider(credentials))
                .withClientConfiguration(clientConfig)
                .withEndpointConfiguration(endpointConfiguration)
                .withPathStyleAccessEnabled(configuration.isS3PathStyleAccessEnabled())
                .withRegion(configuration.getS3RegionName())
                .build();

Toutefois, nous sommes à ce jour en incapacité de valider une implémentation de type AWS, ne disposant pas des moyens de tests adéquats.

Si vous le souhaitez vous pouvez cependant valider ce correctif par vous même en suivant les étapes décrites ci-dessous.

1) Builder la solution logicielle VITAM avec la commande mvn package rpm:attached-rpm jdeb:jdeb install -f sources/pom.xml -P-vitam exécutée depuis le répertoire racine du dépôt VITAM Rq : il est nécessaire au préalable de builder la librairie elasticsearch-metrics-reporter-java (version 2.3.0-VITAM) dont le dépôt est disponible ici https://github.com/ProgrammeVitam/elasticsearch-metrics-reporter-java/tree/2.3.0-VITAM avec la commande maven clean install

2) Récupérer l'artefact vitam-offer-{x.y.z}-{SNAPSHOT}.{rpm|deb} et l'installer sur la machine hébergeant le composant vitam-offer

Restant à votre disposition pour toute information complémentaire,

Cordialement

TDevillechabrolle commented 4 years ago

Petit ménage de confinement dans les issues. Avez-vous pu surmonter le problème, et dans ce cas je vais clore le ticket, ou est-il toujours présent ?

vitam-prg commented 4 years ago

Bonjour Baptiste,

Est-ce que vous avez pu résoudre votre difficulté par rapport à s3 en https ?

Thierry