Enable DSLstmExtrapolator.extrapolate() without corpus

Klebert-Engineering / deep-spell-9

Neural Spellcheck, Autocomplete and Fuzzy-match for SQLite FTS5 🤖

MIT License

2 stars 0 forks source link

Enable DSLstmExtrapolator.extrapolate() without corpus #3

Closed josephbirkner closed 7 years ago

josephbirkner commented 7 years ago

Currently, it is required to pass a DSCorpus to DSLstmExtrapolator.extrapolate(), because it is needed to embed/look up character/class ids for rnn invocation. This should be changed to a DSCorpusInfo which records only the embedding info, to reduce the memory requirements of complete().

josephbirkner commented 7 years ago

To filter predictions with actual database tokens, a trie representation should be used.

josephbirkner commented 7 years ago

055b21042f60b825bd08fc01eaadec06f5df8558