dishmint / LexicalCases

Extract substrings matching a lexical pattern
https://www.paclets.com/FaizonZaman/LexicalCases
MIT License
2 stars 0 forks source link

Export LexicalEmbeddings #268

Closed dishmint closed 10 months ago

dishmint commented 1 year ago

A word embedding is a word-context encoding vector.

A lexical embedding is a lexical-pattern-context encoding vector.

For each l-gram of size equal to the lexical pattern in text there is a 0 or 1 representing it's position. Then take the sum of lexical patterns across text at each position to get real-valued embeddings. Then you have lexical features instead of word features.