chanzuckerberg / cellxgene-census

CZ CELLxGENE Discover Census
https://chanzuckerberg.github.io/cellxgene-census/
MIT License
84 stars 20 forks source link

[Bug] Census mirror is not storing S3 access logs #734

Closed atolopko-czi closed 1 year ago

atolopko-czi commented 1 year ago

After testing accesses of S3 data in the mirror, s3://cellxgene-census-public, there are no access logs being recorded s3://cellxgene-census-public-logs/.

After triaging, this is probably due to an ACL misconfiguration, where the "S3 log delivery group", http://acs.amazonaws.com/groups/s3/LogDelivery, has not been granted the necessary perms. We had similar trouble on the original bucket and had to manually update the ACL. However, this bucket perms are configured a bit differently than the original single-cell-prod cellxgene-data-public-logs bucket, such that we cannot edit the ACL. Perms must be added via the Bucket Policy instead.

atolopko-czi commented 1 year ago

Followed instructions to enable permissions for bucket logging, but still not working. Reaching out to Infra for help.

atolopko-czi commented 1 year ago

Now working. Apparently there's a non-trivial delay between accesses and logs being stored.