Dev/fix twint - Githubissues

TheDataRideAlongs / ProjectDomino

Scaling COVID public behavior change and anti-misinformation

Apache License 2.0

61 stars 13 forks source link

Dev/fix twint #90

Closed lmeyerov closed 1 year ago

lmeyerov commented 1 year ago

Mostly around twint pipeline --

Fix:

Twint: use fixed fork (graphistry/twint)

Infra:

Thin out base image to minimal python 3.8

Feat:

Add historic search job
Add parquet and parquet_s3 write for historic search mode