48 check zip sequence (#55)

[davedavemckay]

• Catch-up (#53)

• 45 zip file exclusion (#51)

• .

• existing file removal info

• .

• .

• .

• .

• .

• .

• fix mem_per_core to 1 GiB

• compare zip contents

• .

• boto3 Object get instead of load

• .

• decode

• handling metadata errors with nested try-excepts ?!!

• botocore.exceptions

• e

• .

• restored total_zips variable

• wait for results

• .

• .

• extra info

• elif

• .

• list of dicts for upload info

• less verbose

• update uploads dict

• .

• wrong i

• additional info in dicts

• typo

• .

• .

• exclude individual files

• .

• .

• .

• .

• .

• .

• .

• remove print e as error handled

• .

• .

• introduced upload timeouts

• .

• get instead of wait

• try removing result?

• .

• .

• try terminate

• .

• .

• .

• .

• .

• .

• remove duplicates

• clarified waiting loop

• .

• //

• .

• nightly - remove_duplicates not working

• use pandas to remove duplicates

• done

• type hints added to bucket_manager

• added metadata for multipart uploads of zip files

• filename exclusion

• .

• .

• fiex file exclusion

• done - testing (#52)

• removed boto3 type hints

• .

• use gc

• .

• .

• .

• catch broken pipe

• gc

• try metadata

• .

• .

• .

• .

• .

• df not series

• apply works

• workgin

• try existing zip contents

• sort isins

• ['CURRENT_OBJECTS']

• gc collect everywhere...

• Meatadata not metadata

• these_zip_contents

• brute froc

• less brute force

• .

• any

• check

• .

• .

• .

• .

• .

• .

• dropna

• .

• .

• debugging

• .

• .

• .

• .

• .

• pf replace

• .

• progress

• all

• any

• .

• .

• less verbose

• .

• deleting to_collate[parent_folder]

• change zip contents delimiter

• done.