Add dictionary component - Githubissues

hexagram30 / language

A syntagmata and Markov chain language, word, and name generator for use in hexagram30 narratives

3 stars 1 forks source link

Add dictionary component #19

Open oubiwann opened 6 years ago

oubiwann commented 6 years ago

Component creation and ingest:

[x] Create component namespace
[ ] Setup docker for RedisSearch
[ ] Create RedisSearch connection function(s)
[ ] Define a plain text, human readable format
[ ] Create functions that convert plain text dictionary files to the format(s) needed by RedisSearch for ingest
[ ] Upon startup, the dictionary component should read all dictionary files, index them, and load them into RedisSearch

Post-ingest, programmatic access:

[ ] Create defrecord for language, word, part of speech, definition
[ ] Map db entries to record instances
[ ] Create component-based API for querying db (as well as updates)
[ ] Add support for full-text search - #26
[ ] Add an API call for searching dictionary entries - #27

For part of speech, standardize on what is used in OpenNLP (see https://www.ling.upenn.edu/courses/Fall_2003/ling001/penn_treebank_pos.html)