search

fullstorydev / hauser

Service for moving your Fullstory export files to a data warehouse
MIT License
49 stars 23 forks source link

S3: allow export files to be stored in subdirectories #34

Closed patrick-fs closed 5 years ago

patrick-fs commented 5 years ago

Expected behavior

When the Bucket parameter in config.toml is set to either

Then the Data Bundle export files should be stored at that path. For example: somebucket/somesubdirectory/123456.csv

Actual Behavior

When the Bucket parameter is set to somebucket/somesubdirectory in config.toml, the following error is returned:

Failed to upload file /tmp/123456.csv to s3: SignatureDoesNotMatch: The request signature 
we calculated does not match the signature you provided. Check your key and signing method.

When the Bucket parameter is set to somebucket/somesubdirectory/ in config.toml, the following error is returned:

Failed to load file '/tmp/123456.csv' to warehouse: pb: The specified S3 prefix 
somesubdirectory//123456.csv' does not exist
patrick-fs commented 5 years ago

NOTE: I've already got a fix for this on my fork: https://github.com/patrick-fs/hauser/tree/patrick/s3-keypath-fix

PR forthcoming

patrick-fs commented 5 years ago

PR merged