klahnakoski
commented
6 years ago This is in the HEAD calls,after you follow the 303s
C:\Users\kyle\code\Bugzilla-ETL>curl --head https://queue.taskcluster.net/v1/task/KzOmb6UbTLebLjGAe_bymw/artifacts/public/logs/live_backing.log
HTTP/1.1 303 See Other
Server: Cowboy
Connection: keep-alive
Content-Security-Policy: report-uri /__cspreport__;default-src 'none';frame-ancestors 'none';
X-Content-Type-Options: nosniff
Access-Control-Allow-Origin: *
Access-Control-Max-Age: 900
Access-Control-Allow-Methods: OPTIONS,GET,HEAD,POST,PUT,DELETE,TRACE,CONNECT
Access-Control-Request-Method: *
Access-Control-Allow-Headers: X-Requested-With,Content-Type,Authorization,Accept,Origin
Cache-Control: no-store no-cache must-revalidate
X-Taskcluster-Artifact-Storage-Type: s3
Location: https://taskcluster-artifacts.net/KzOmb6UbTLebLjGAe_bymw/0/public/logs/live_backing.log
Vary: Accept
Content-Type: text/plain; charset=utf-8
Content-Length: 113
Date: Fri, 03 Aug 2018 14:43:55 GMT
Via: 1.1 vegur
C:\Users\kyle\code\Bugzilla-ETL>curl --head https://taskcluster-artifacts.net/KzOmb6UbTLebLjGAe_bymw/0/public/logs/live_backing.log
HTTP/1.1 200 OK
Content-Type: text/plain; charset=utf-8
Content-Length: 406282
Connection: keep-alive
Date: Fri, 03 Aug 2018 14:46:34 GMT
Last-Modified: Fri, 27 Jul 2018 01:25:44 GMT
ETag: "01b161d0454eb6595235ff1044c28596"
Content-Encoding: gzip
x-amz-version-id: xgDy.OwMwqbbmeq.IgUiZyxb5lpQWL3a
Accept-Ranges: bytes
Server: AmazonS3
X-Cache: Miss from cloudfront
Via: 1.1 37e341ba7bedcf836aa07ae6c32b4c63.cloudfront.net (CloudFront)X-Amz-Cf-Id: fQ9SpSf8ybtjaT8R0A2OIBlqYG2zG3YxxBD0wYF7xV0RKuOyP5qO9w==
The code should land right around here: https://github.com/klahnakoski/ActiveData-ETL/blob/dev/activedata_etl/transforms/pulse_block_to_task_cluster.py#L104