Mo lines mo problems

[jdmartin]

Changes:

• Adds new, interactive visualizations
• Fixes TEI processing error ( 🤞 )
  • Removes bad chapter splits, too.
• Some db optimizations -- more needed
• Reworks begin.sh
• Adds do_viz.sh to allow menu for visualizations

Some important notes:

• There's still cleanup to do, and some of the other types of viz are broken.
  • It's been a rough few days. I think the gains still outweigh the outstanding problems.
• Dependencies have updated. Use poetry install.
• The alignments for eltec are broken, now, because there were bad files. You can get the new one here
• You will need to remake your db. So, start with begin.sh
• Once you've remade the db, I'd recommend using do_viz.sh to check out option 1.
  • You can select the author, change the threshold, and select the length and it dynamically updates. See below!

https://github.com/tarahmarie/dh-trace/assets/1966209/1b7d73f6-f909-4121-a466-545059ebdf56

Summary:

• Still work to do on cleaning and documenting.
  • I really want to rework load_relationships.py. (Especially since we seem to be ignoring ngrams from the bespoke model, right now.)
• Regenerating alignments was fraught with problems. That's a separate talk, but flagging it...