Closed MikeHopcroft closed 5 years ago
Tokenizer code should move to token-flow project. The short-order project will then take a dependency on token-flow. The design intent is that short-order is a conversational agent that uses token-flow for low-level tokenization.
token-flow
short-order
Tokenizer code should move to
token-flowproject. Theshort-orderproject will then take a dependency ontoken-flow. The design intent is thatshort-orderis a conversational agent that usestoken-flowfor low-level tokenization.