Review large-scale DB creation steps

Semantics-of-Sustainability / tempo-embeddings

Tools for analysing contextual (temporal) word embeddings

Apache License 2.0

1 stars 0 forks source link

Open carschno opened 3 months ago

carschno commented 3 months ago

Create script that runs the following steps:

[X] Read data files into corpora, with format-specific readers e.g. for ANP etc.
[X] Read list of terms
[X] match terms in corpora
[X] store matching passages with embeddings in DB
[ ] visualization #33

Note: running on Snellius is blocked by #50

carschno commented 3 months ago

Related PR: #73

carschno commented 2 months ago

To fix in corpora handling:

carschno commented 2 months ago

Related PR: #81