search

dishmint / LexicalCases

Extract substrings matching a lexical pattern
https://www.paclets.com/FaizonZaman/LexicalCases
MIT License
2 stars 0 forks source link

WordToken distribution spec #304

Open dishmint opened 5 months ago

dishmint commented 5 months ago

Could be interesting to implement WordToken with a Distribution.

This might mean something like, a sequence of word tokens fitting a particular distribution.