The TokenizerBuilder didn't do anything significant, so I removed that layer of abstraction to simplify things. I also renamed the builder to be loader, and the dictionary builder to be builder. This is at least more consistent, and I think easier to understand.
I realize this is a bit forward, sorry for not asking permission first, but still hoping it makes sense/you accept :smiley_cat:
The
TokenizerBuilderdidn't do anything significant, so I removed that layer of abstraction to simplify things. I also renamed the builder to be loader, and the dictionary builder to be builder. This is at least more consistent, and I think easier to understand.I realize this is a bit forward, sorry for not asking permission first, but still hoping it makes sense/you accept :smiley_cat: