search

tarahmarie / dh-trace

MIT License
0 stars 0 forks source link

how do we get an all against all comparison? #18

Closed tarahmarie closed 3 months ago

tarahmarie commented 9 months ago

E.G. the top 25 relationships across all authors given a threshold and text length with unidirectionality based on year of publication?

jdmartin commented 9 months ago

Will investigate. We purposefully removed this functionality, earlier on, but may not be too hard to restore.

jdmartin commented 9 months ago

Check the 'all-the-things' branch, which, like the previous two, should not be merged before other things. (Choose option 2 from do_viz.sh.)

It's not pretty. It's not my best work. And it's definitely not fast.

But it's a start. I'll work on better indexing to speed it up, but I'm not sure how much we can eke out given the absurd size. Anyway, as ever, needs testing...

jdmartin commented 9 months ago

Small db tweaks (that require rebuild) have been moved to the all-the-things-and-more branch. I think they help, but the speed-up isn't so dramatic that this branch needs to be held up. I'll probably have to go back and deal with the db in a more comprehensive way, once all these extra features settle down.