Open elliVM opened 4 months ago
Created prototype version where pattern is given in config and assigned to a filter.
Changing to multiple patterns per filter
patterns are now saved into bloomdb.filtertype table
Testing in QA with new pth-06 version
planned improvements:
updating to newest version of pth_06 with pattern acceleration
Testing in QA
Fixed some SQL syntax errors and moved filter creation to run before spark batch job. Change create table to include if not exists clause.
filtertype pattern field had whitespaces ascii 032 nonprinting spacing character on both ends, causing errors when selecting pattern when saving bloomfilters, will trim those away.
Fixed with trimming
Internal PR
some Fixes to PR
Fixes to testing and some minor changes, working now in QA
Pattern is used by archive to enable a bloom filter search if the filter contains a pattern of the keyword.