Adapt convert_to_extractive.py to BillSum and make set default arguments for BillSum
Add code to deterministically split the train split of original BillSum into smaller train and valid (ratio = 8 : 2)
Add helper functions to remove \n and extra white spaces as the very first preprocess step (before entering Spacy pipeline to do tokenization and other preprocessing)
Context
5
Summary
convert_to_extractive.py
to BillSum and make set default arguments for BillSumtrain
split of original BillSum into smallertrain
andvalid
(ratio = 8 : 2)\n
and extra white spaces as the very first preprocess step (before entering Spacy pipeline to do tokenization and other preprocessing)