normalization: all characters divide into classes digits, alpha, punctuation and space
punctuation becomes space
space between two digits and between two alphas becomes space persists
all other spaces get thrown out
When indexing we must also add a name without any spaces/punctuations
When searching in beni we must try the same (de-punctuate/de-space the input) and add it to results
example
RL-50 RRCSW
when someone is looking for RL50RRCSW or RL 50R R CSW they mean to find it.
normalization: all characters divide into classes digits, alpha, punctuation and space
When indexing we must also add a name without any spaces/punctuations When searching in beni we must try the same (de-punctuate/de-space the input) and add it to results
example RL-50 RRCSW
when someone is looking for RL50RRCSW or RL 50R R CSW they mean to find it.