Feat/connect data to s3

BaseAdresseNationale / adresse.data.gouv.fr

Le site officiel de l'Adresse

https://adresse.data.gouv.fr

MIT License

153 stars 31 forks source link

Feat/connect data to s3 #1705

Closed nkokla closed 5 months ago

nkokla commented 7 months ago

This PR enable access to S3 into the /data pages

Alias folder (symlink) are computed.
The old folder adresses-odbr is removed but supported by URL-rewriting

antoineludeau commented 7 months ago

Ajouter dans le docker-compose les nouvelles variables. A copier-coller dans le docker-compose.yml à la suite des variables (tout en bas du fichier) :

S3_CONFIG_ACCESS_KEY_ID=${S3_CONFIG_ACCESS_KEY_ID}
S3_CONFIG_SECRET_ACCESS_KEY=${S3_CONFIG_SECRET_ACCESS_KEY}
S3_CONFIG_REGION=${S3_CONFIG_REGION}
S3_CONFIG_ENDPOINT=${S3_CONFIG_ENDPOINT}

antoineludeau commented 7 months ago

Les erreurs que j'ai :

Erreur lors de la récupération de la liste des objets : InvalidAccessKeyId: The AWS Access Key Id you provided does not exist in our records.
[27/02/2024 17:53:06 - ERROR] S3 Object - Try access to unknown object: adresse-data/

antoineludeau commented 7 months ago

A tester avec nouvelle structure config :

const clientS3 = new S3({ credentials: { accessKeyId: S3_CONFIG_ACCESS_KEY_ID, secretAccessKey: S3_CONFIG_SECRET_ACCESS_KEY, }, region: S3_CONFIG_REGION, endpoint: S3_CONFIG_ENDPOINT, })