search

philbo87 / grocerylistorganizer

A simple utility to organize grocery lists by the location of the items in the store.
0 stars 0 forks source link

Implement partial string tokenization #1

Open philbo87 opened 8 years ago

philbo87 commented 8 years ago

"8 oz chorizo" classified as "Aisles" This should likely be in Meat. This is happening because I have made "oz" a key for Aisles, and oz gets tokenized first. Even if I added chorizo to the dictionary of items as a Meat item, this would still happen. May want to reconsider how I am tokenizing items.

philbo87 commented 8 years ago

Should add partial string tokenization to solve this

philbo87 commented 8 years ago

Issue #4 will solve the 8 oz chorizo problem, as that is actually different from partial string tokenization. I will still add partial sting tokenization to stop requiring entire item names to be in the dictionary