Instead of one single S3, use the domain table?

OpenTechFund / bypass-otf_proxy

1 stars 1 forks source link

Instead of one single S3, use the domain table? #9

Closed maxpearl closed 3 years ago

maxpearl commented 4 years ago

Instead of having one single S3 log entry in auto.cfg, if read_s3 option is set, have log_stats.py read the domain table, and go through each domain use the s3 bucket set there.

This means:

modifying the model to include 's3_bucket' in domains table
add a loop to run through all domains.

maxpearl commented 3 years ago

We'll leave in place the process that allows for saving of logs to s3, but focus on analyzing logs from s3 rather than local.

maxpearl commented 3 years ago

Doing #28 first, then this will be straightforward.

maxpearl commented 3 years ago

Done. https://github.com/OpenTechFund/bypass-otf_proxy/commit/31d56d5cbe0d6894785b12faa299aafac98c1a69