genesis-ai-dev / codex-editor

Codex Scripture Editor and Translator's Copilot
https://codex-editor.gitbook.io/
MIT License
7 stars 7 forks source link

Enable multiple options for chunking text #41

Open ryderwishart opened 6 months ago

ryderwishart commented 6 months ago

It would be ideal to enable the user to convert the current draft files from "one chapter per cell" to "one verse per cell", "interlinear", "one pericope per cell", "one book per cell", etc.

We need to test what the performance implications are for any given chunking mode (not to be confused with audio/obs/text modes).

ryderwishart commented 1 week ago

Recursive text splitter