prefix_range in constructor can get two types of input:
List[int] for specifying distinct amount. e.g. [3, 5] will produce prefix3 and prefix5
tuple(int) for specifying a range. e.g. (2,4) will produce prefix2, prefix3, prefix4
Implement tests for the vectorizer in difference range, tokenizer and alternate_sign flag combinations.
Important Note in order for serialized prebuilt models to work with this version of transformer, pipelines that use HashVectorizer should be retrained and dumped.
prefix_range
in constructor can get two types of input:List[int]
for specifying distinct amount. e.g.[3, 5]
will produceprefix3
andprefix5
tuple(int)
for specifying a range. e.g.(2,4)
will produceprefix2
,prefix3
,prefix4
HashVectorizer
should be retrained and dumped.[3, 5]
to keep current scores.