Open revbucket opened 6 months ago
Added bff_v0.py which is a simple python script to: 1) download all .jsonl.gz's from a specified S3 directory 2) Run BFF on ^ 3) Upload the outputs back to S3
bff_v0.py
Also modified the main.rs to use the faster init for bloom filters
main.rs
Added
bff_v0.pywhich is a simple python script to: 1) download all .jsonl.gz's from a specified S3 directory 2) Run BFF on ^ 3) Upload the outputs back to S3Also modified the
main.rsto use the faster init for bloom filters