m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Add ArchiveSize and FileSize to parser records #1118

Closed stephen-soltesz closed 1 year ago

stephen-soltesz commented 1 year ago

This change adds two new fields to the ParseInfo record for all datatypes:

To populate the ArchiveSize field, this change adds GetSize() to the TestSource interface and GCSSource implementation.

Part of:


This change is Reviewable

stephen-soltesz commented 1 year ago

Uh oh -- we're doin' it!

Thank you!